Question 19981 in Amazon Web Sevices Question posted in
The official Amazon Web Services documentation can be found here.

How can you use PyTorch Profiler on SageMaker?

Is there a way to use the PyTorch profiler when using Amazon SageMaker?
Or can we call PyTorch profiler in the profiler config for SageMaker debugger

Tags:

2

Answers


  1. 0

    You can use the below snippet to initiate a Profiler .

    from sagemaker.pytorch import PyTorch
from sagemaker.debugger import ProfilerConfig, FrameworkProfile
profiler_config = ProfilerConfig(
    framework_profile_params=FrameworkProfile(start_step=1, num_steps=2)
)

    Then you can pass the profilfer_config to the Pytorch estimator.

    Login or Signup to reply.
  2. 0

    To use the PyTorch vanilla profiler in SageMaker Training jobs:

    1. On the SageMaker Estimator turn off the SageMaker built-in profiler (as you’ll be using the PT Vanilla profiler): estimator = PyTorch(..., disable_profiler=True, ...)
    2. In your training script add PT profiler as shown in this PT Profiler with TensorBoard tutorial.
    3. Export the profiling data to SageMaker managed output folder: on_trace_ready=torch.profiler.tensorboard_trace_handler(f'{args.output_data_dir}/profile')
    4. when the job completes. Start TensorBoard with the S3 location of the output data folder: estimator.latest_job_tensorboard_artifacts_path()
    Login or Signup to reply.
Please signup or login to give your own answer.

Back To Top
Search