Hi,
When defining custom Function class, we define static forward()/backward() methods, and in forward() we use ctx.save_for_backward(…) to record the input tensors for backward pass.
I’m wondering, when in inference mode (training = false), will the above ctx.save_for_backward(…) call still record the tensors for the never arriving backward pass?
Thank you!