Will pytorch reserve all temporary results in the forward pass?

[albanD]

Yes, it will handle it properly.