How in-place operation affect Autograd

when doing backward, autograd checks that all tensors it needs have not been modified since it recorded them. not all tensors are needed in backward, so some inplace ops may be fine.

1 Like