Pytorch profiler to profile an inference/ training

  • what metrics from PyTorch can be used to break down idle time?
  • what metrics from PyTorch can be used to analyze HtoD/DtoD/DtoH bandwidth?
  • what’s the data structure of these metrics?
  • what’s the precision scale (millisecond?)