I have modified a model by removing some stuff at the end of it. But of course when I try to load the weights, it complains that certain keys dont exist in the model.
I tried to remove the keys as follows:
# Remove keys contaning second stage keys_to_remove =  for key in ckpt_state.keys(): if "rroi" in key: keys_to_remove.append(key) for key in keys_to_remove: del ckpt_state[key]
And the models load state dict worked, but the optimizer load_state_dict crashes with
ValueError: loaded state dict contains a parameter group that doesn't match the size of optimizer's group
How to I remove the right stuff from the optimizer weights?