As I wrote in the other thread.
Don’t add nn.DataParallel inside your model class class Net(nn.Module)
Use the following pattern:
# create model
model = Net()

# move to GPU
model = model.cuda()

# split up input batch to all GPUs
model = nn.DataParallel(model)