Hi,
Yes I think it does.
Note that having the intermediary results as buffer vs just regular attributes doesn’t change much.
It will only change when you get the state dict or move the module to a different device. But hopefully you should not be doing that in the middle of the forward pass 