an inplace operation

RuntimeError: one of the variables needed for gradient computation has been modified by an inplace operation: [torch.cuda.FloatTensor [512, 1024]], which is output 0 of TBackward, is at version 4; expected version 3 instead. Hint: the backtrace further above shows the operation that failed to compute its gradient. The variable in question was changed in there or anywhere later. Good luck!Preformatted text


Have you enabled anomaly mode as suggested in the message? What is the second strack trace that it shows?


I have enable anomaly, here is second stack trace. I implement Feedback Transformer and catch this error.