How to reuse graph even the parameters have been updated

autograd
1

for example：
image

2

This behavior would yield to wrong gradients and will thus raise an error.
What’s your use case that you want to recalculate the gradients using stale activation values?