So what should I do if I want to use the distributed model for inference in the single-GPU windows?
I was using nn.DataParallel in these two machines, I must call nn.DataParallel(model) before loading the  model. I’m now just trying to do the same thing with DistributedDataParallel but got the problem.