Solved by kaiyuyue in post #13 
              
              
                Hi, in your bash, your command should like: 
CUDA_VISIBLE_DEVICES=0,3 python train.py

and in your train.py, the gpus config should be set [0,1].