Optimizer keeps updating tensors from previous batch

2

Hi,

That looks very similar to The .grad is zero, the value change no?