Awesome, thanks so much for clarifying that!
If you don’t mind me asking for some additional clarifications?



 pietern:

Check out the launch utility for easy launching of multiple processes. You can use it like this


The lauch utility has to be used in combination with DistributedDataParallel right, or can it be used on its own?
Using DistributedDataParallel does it mean that it has to be used in combination with torch.utils.data.distributed.DistributedSampler?
Thanks again!