How to identify slowest step in backward computation?

1

I want to know if there is any principled way of identifying which step is taking maximum amount of time when performing loss.backward().

2

You could try out torch.utils.bottleneck to find bottlenecks in your autograd part.

1 Like
3

This is exactly what I wanted thanks.