Solved by LeviViana in post #2 
              
              
                The documentation presents you a detailed tutorial on how it can be done. 
You could use torch.distributed as well, which is useful if your GPUs are not located in a single machine. 
Here is a very simple snippet for you to get a grasp on how it could be done. I’m using torch.distributed.launch here…