Different training loss while training and while evaluating

2

I had the same issue.
check this thread.
Loaded model is not the same - PyTorch Forums