Hi yes, so DDP is being launched using the “python -m torch.distributed.launch script.py” framework, and yes, the only difference is the wrapping.
DDP is running a single process per GPU
DP is running a single process total
NCCL is the backend I am using, and I believe the recommended one from the pytorch docs.