Autograd only disallows inplace operations on tensors when their original values are needed for the gradient computation, which means Autograd understands and accepts inplace ops only if they are mathematically correct.
@KFrank explained it in more detail with a great example here.