Thanks for your reply
It means when I load a model for test which is trained with nn.DataParallel(device_ids=[3,0,1,2])(default GPU 03), the number of available GPUs  must is 3 at least. And I can’t make the number of available GPUs less than 3 with CUDA_VISIBLE_DEVICES i.e CUDA_VISIBLE_DEVICES=0 ?