Trying to backward through the graph a second time even when create graph and retain graph is true

[ptrblck]

@Sherine_Brahma

At the time when the aforementioned post was asked, the poster was using pytorch 0.4.1. But I am using pytorch 1.1.0.

I would recommend to update to the latest released version (1.7.0) as it would ship with bug fixes and new features.

@Sherine_Brahma

Strange thing is this exact code was working fine for a few days and then this error started popping up.

You might have accidentally changes something in the code, as it shouldn’t break “by itself”

@Sherine_Brahma

Could I please have some suggestions about what I can do or any leads to what might trigger this behaviour?

The inplace error is raised, since a tensor was overridden, which would be needed for the gradient calculation as described here.

That being said, the model behavior and convergence shouldn’t change by using the inplace or out-of-place relu.