Nan values in loss after a few epochs

vision
2

Finally fixed this issue. Turns out, switching to FP32 from FP16 autocasting helped resolve the issues with convergence.

1 Like