Activation Checkpoint for Pre-trained Models

Is it possible to use activation checkpointing for a pretrained model? If so, how would I be able to implement it for something like ResNet50?