Solved by ptrblck in post #2 
              
              
                As given in the DDP docs, DistributedDataParallel is able to use multiple machines: 

DistributedDataParallel (DDP) implements data parallelism at the module level which can run across multiple machines. Applications using DDP should spawn multiple processes and create a single DDP instance per proc…