We’re still debating what this should look like here Save/Load OptimizedModule by msaroufim · Pull Request #101651 · pytorch/pytorch · GitHub
But for now to unblock you, I would suggest avoiding the deepcopies and instead saving the original uncompiled models the state dicts should be shared between the compiled and uncompiled model