Understanding autograd memory allocation during forward pass

autograd
1

Trying to understand what memory gets allocated during forward pass. Except for storage for activations, is there anything else that is allocated ?