PyTorch Forums
Nan Loss with torch.cuda.amp and CrossEntropyLoss
mixed-precision
bruceyo
(Bruce YU)
March 26, 2021, 3:14am
17
In my case, I think nan is caused by the loss is too large to be held by float16.
show post in topic