I’m sorry, but I don’t understand the first part of you question. You can obtain a state_dict using a state_dict() method of any module. Once you resume the training from a checkpoint, you should still create a new model with random weights, and call load_state_dict(serialized_dict) on it. This will replace the random values with serialized weights.
1 Like