Solved by ptrblck in post #2 
              
              
                Yes, I would recommend to use a single script with the DataLoader, create multiple model, push each one to the desired device via to('cuda:id') and just pass the data to each model. 
Since the training is done on different devices, it should be executed in parallel. 
Your approach of running multip…