Yes. It can’t. The size of my input image is various. Therefore, if using the dataloader, the batch size can only be 1. And the 1 batch size results in that  the dataparallel can’s work on multi gpus, because of this code replicas = self.replicate(self.module, self.device_ids[:len(inputs)])