Hi @albanD, thanks for the quick response. I looked at https://pytorch.org/tutorials/beginner/blitz/data_parallel_tutorial.html#create-model-and-dataparallel 20, and it first put the model into DataParallel and then put the model onto device, which is what I did, could you elaborate a bit what I am missing here?