I am trying to split my data to run on multiple GPUs, but my program is only able to find 1 GPU. Here is what I have so far:
os.environ["CUDA_VISIBLE_DEVICES"]

Gives: 0,1, which is correct as I have 2 GPUs in the node I want to train on. However,
torch.cuda.device_count()

Gives 1, which is not what I was expecting. I am setting the torch device as cuda and not specifying a device ID there.