I am having a very similar issue in using nn.DataParallel. I am working on 3 Tesla V100 GPUs. When I use two GPUs the code runs perfectly. But when I use all three GPUs the code fails during the forward pass. There is no error information given. The only error message I get is “Killed”. Could you help me with one, please? I am not using any docker.