Source code structure of pytorch

1

Dear community,
I want to systematically learn the source code structure of pytorch.
How should I learn? Is there any official document where I can learn from it?
Thanks.

2

I’d suggest picking a specific subset you’re interested in and going from there pytorch is massive codebase

That said if you want a high level overview of all the different main components this talk is great https://x.com/tarantulae/status/1734192354716725401?s=20

3

Thank you for your reply, these documents are very helpful to me.
Besides this, I mainly want to learn about the subset of PyTorch related to CUDA, especially the aspects related to GPU memory allocation and calls.
Do you have any suggestions?
Thanks.

4

Zach De Vito’s blog is a fantastic resource https://zdevito.github.io/

5

Thank you very much.This helped me a lot.