Solved by albanD in post #2 
              
              
                Hi, 
Are you sure the second GPU is properly available? What does device_count() returns? 
You might be hidding the second GPU with CUDA_VISIBLE_DEVICES=0 as well.