Solved by albanD in post #3 
              
              
                Hi, 
They are completely independent. 
DataLoader processes will only be used to load data from your Dataset. 
The processes for DistributedDataParallel have nothing to do with it.