Solved by seungjun in post #9 
              
              
                Hi @Janine, 
This is not related to PyTorch version but the DataParallel (also DistributedDataParallel) class wrapper of PyTorch nn class models. 
DataParallel encloses the original model as it member variable, self.module. 
In case you need both single-GPU and multi-GPU model training, you can chan…