Hello @ptrblck , sorry for my late answer.
It seems to be the same issue as with nn.DataParallel The process gets stuck and the volatile GPU usage seems to be 100%, attached the screenshot of nvidia-smi

image944×208 25.6 KB