That’s theoretically correct. If you set CUDA_VISIBLE_DEVICES PyTorch is unable to see the other gpus
Therefore, and if you are sure you are not commiting a mistake assigning cuda visible devices, you are facing a either bug or a wrong library setup.
Can you check if, after setting cuda visible devices you cannot access to the others?
you can use torch.cuda.device_count()