I would like to know what are the best practices/tools to visualize what happens during loss.backward().
I am confident in my understanding of the forward pass of my model, how can I control its backward pass?
I would like to know what are the best practices/tools to visualize what happens during loss.backward().
I am confident in my understanding of the forward pass of my model, how can I control its backward pass?
you can try to set up Hooks on your layers to see what’s happening. Might be a good start, as well as learning about backpropagation.
Ok, thanks, I’ll look into what hooks are.
I have a good theoretical knowledge of back-propagation.
My question is a practical one: How can I easily/efficiently track the operations performed during loss.backward()?