Pytorch nn tutorial, passing data confusion

[yunusemre]

This post should help you. :

How are optimizer.step() and loss.backward() related?

Hi. I am pretty new to Pytorch and keep surprised with the performance of Pytorch I have followed tutorials and there’s one thing that is not clear. How the optimizer.step() and loss.backward() related? Does optimzer.step() function optimize based on the closest loss.backward() function? When I check the loss calculated by the loss function, it is just a Tensor and seems it isn’t related with the optimizer. Here’s my questions: (1) Does optimzer.step() function optimize bas…