Torch.utils.checkpoint.checkpoint with multi-gpus


(speedinghzl) #1

Hi,
The program is blocked when I use Torch.utils.checkpoint.checkpoint with multi-GPUs. And when I change to single GPU training, the program works! I also try to remove the checkpoint function and the program also works with multi-GPUs. Does checkpoint function not support multi-GPUs training?

Thanks!