All of them are using the device I specified, I do this by using grep -r .cuda() ,  to()  and  device
And it is not only about the default device, we have 9 gpus here, all of them get duplicate processes.
Each of them will occupy 12 MB, all processes have the same PID.
WX20200416-142757@2x1246×374 103 KB