Size mismatch of embedding weights while loading

Did you manipulate this parameter after storing the state_dict?
If not, could you post a minimal code snippet to reproduce this issue, so that we could debug it?