How to delete all the gradients in between operations

autograd
3

Hi @ptrblck the tensor I am storing is a 3x100 flotat 32 tensor, which should be 300/8*32=1.2KB, while the memory increase is 20-60 MB per step (it varies, don’t know why).