Hi, I am using a computation server with multiple nodes each of which has 4 GPUs and they are managed with SLURM. I want my code to send the data and model to one or multiple GPUs. I assumed if I use torch.device("cuda") it makes the device to be a GPU without particularly specifying the device name (0,1,2,3).  I would like to make sure if I understand the difference between these two command correctly.
torch.device("cuda") # without specifying the cuda device number 
torch.device("cuda:0") # use cuda device 0

Is that correct?