Pathological loss values when model reloaded

You could use forward hooks as described here.
However, this might be a bit tedious, so if you could wait for one or two days, I can debug it and see what’s going on.

Btw. thanks for the debugging so far and the code snippets! :slight_smile: