You could specify the device when pushing the model parameters and data to the device via .to('cuda:1') or use CUDA_VISIBLE_DEVICES=1 python script.py args to execute your script. In the latter approach GPU1 will be mapped to 'cuda:0' in your script.