How to identify the in-place operation in pytorch?

[yosider]

Can't find Inplace operation: RuntimeError: one of the variables needed for gradient computation has been modified by an inplace operation

I know this error is because inplace operation, but I don’t know where is the operation in my code. I define my model forward function as follow: def forward(self, input): x = input[0] y = input[1] x = self.feat(x) x_proj = self.proj(x) x = x_proj x = self.toimg(x, y) x = self.concat(x, y) x = self.resnet(x) return x, x_proj And I want to use x_proj to compute a extra loss: def feature_regularizer(x_proj): device = torch.device('cuda' if torch.cuda.is_…

You can use torch.autograd.set_detect_anomaly(True).