I am going through this imagenet example: https://github.com/pytorch/examples/blob/master/imagenet/main.py
And, in line 88, the module
DistributedDataParallel is used. When I searched for the same in the docs, I haven’t found anything. Possible to redirect me to it if any such doc exist for the module.
Else, would like to know what is the difference between the DataParallel and DistributedDataParallel modules.