How to learn distributed data parellel?

I didn’t learn basic knowledge of computer before, can’t understand communication, concurrent, multiprocessing, what do I need to learn for understanding DDP?

You can start with the tutorial. I suggest you study and research the concepts you don’t know thoroughly, if that’s what your goal is. The documentation for Python multiprocessing is very thorough, for starters.

1 Like