I am going through this imagenet example: https://github.com/pytorch/examples/blob/master/imagenet/main.py 313
And, in line 88, the module DistributedDataParallel is used. When I searched for the same in the docs, I haven’t found anything. Possible to redirect me to it if any such doc exist for the module.
Else, would like to know what is the difference between the DataParallel and DistributedDataParallel modules.