What is the specific difference between wait steps and warmup steps in torch.profiler.schedule?

1

Hi, guys!
I am learning about using the torch.profiler.schedule API. But from its introduction, I cannot figure out the specific difference between wait steps and warmup steps inside it.

What I can get it that the profiler would not do recording in both wait steps and warmup steps, but is there any other specific differences of operations between them?
In other words, why are the wait steps are esstianl for profiling?

Your answer and guide will be appreciated!

2

During the wait steps the profiler should be disabled and not try to profile any workloads at all.
Afterwards, during the warmup the profiler is active and profiles the workload but nothing will be recorded. After this warmup, the profiler keeps profiling the workload and this time the results are recorded.
That’s at least my understanding.

1 Like
3

Thanks sincerely for your response!