One of the variables needed for gradient computation has been modified by an in-place operation

[Anshumaan_Dash]

Encounter the RuntimeError: one of the variables needed for gradient computation has been modified by an inplace operation

x = x + 1 is not in-place, because it takes the objects pointed to by x, creates a new Variable, adds 1 to x putting the result in the new Variable, and overwrites the object referenced by x to point to the new var. There are no in-place modifications, you only change Python references (you can check that id(x) is different before and after that line). On the other hand, doing x += 1 or x[0] = 1 will modify the data of the Variable in-place, so that no copy is done. However some functions (in y…

Check this. if it helps. Give me some time to go through your code. There is some niche way you are changing a tensor inplace.