Model training with automatic mixed precision is not learning

Aren’t you missing optimizer.zero_grad() in the loop?