What is a tape-based autograd system?

Hi,

I just wonder what is a tape-based autograd system?
I see this term on PyTorch about site.
Could you guys explain a little bit for me?

Thank you a lot.

7 Likes

something that uses reverse-mode automatic differentiation:

6 Likes