Restoring optimizer and model from saved state not fully reproducing training results?

2

I think this is related to this discussion: Saving and loading a model in Pytorch?