Encounter the RuntimeError: one of the variables needed for gradient computation has been modified by an inplace operation

26

I am new to Pytorch. While running a model from github, I encountered a similar error:
RuntimeError: one of the variables needed for gradient computation has been modified by an inplace operation: [torch.FloatTensor [1, 1024, 1, 1]] is at version 2; expected version 1 instead. Hint: the backtrace further above shows the operation that failed to compute its gradient. The variable in question was changed in there or anywhere later. Good luck!

I have tried to add inplace = True to nn.Prelu() but didn’t work. Any suggestions?

Traceback (most recent call last):
File “train.py”, line 90, in
g_loss.backward()
File “/Users/zxiao/opt/anaconda3/lib/python3.7/site-packages/torch/tensor.py”, line 198, in backward
torch.autograd.backward(self, gradient, retain_graph, create_graph)
File “/Users/zxiao/opt/anaconda3/lib/python3.7/site-packages/torch/autograd/init.py”, line 100, in backward
allow_unreachable=True) # allow_unreachable flag

Here is the code snippet:

with torch.autograd.set_detect_anomaly(True):
                netG.zero_grad()
                g_loss = generator_criterion(fake_out, fake_img, real_img)
                g_loss.backward()
                
                fake_img = netG(z)
                fake_out = netD(fake_img).mean()