If you are coming across this thread late (like I did) because you have high loss after loading a saved model, this might be the solution. TL;DR - save and load the optimizer as well
If you are coming across this thread late (like I did) because you have high loss after loading a saved model, this might be the solution. TL;DR - save and load the optimizer as well