GPU memory usage increases by ~90% after torch.load

2

Yes, I have experienced the same situation before. This is quiet annoying ! I will bump on OOM if I would like to resume training from a checkpoint.