Do you have examples of the usage of torch.utils.checkpoint

Is there any skill to use this, I use it to run about 1/3 of my model (wrapped in a subclass of nn.Module), but only see a little bit memory usage decline.

1 Like