So, Im using the iPython Notebook, and doing something like:
%%bash
CUDA_VISIBLE_DEVICES=1,2,3

netG = torch.nn.DataParallel(netG, [2,3,4])
netD = torch.nn.DataParallel(netD, [2,3,4])


%%bash
gpustat
%%bash
gpustat
ip-172-31-27-23  Fri Oct 20 02:38:19 2017
[0] Tesla K80        | 56'C,   0 % |   879 / 11439 MB | ubuntu(283M) ubuntu(288M) ubuntu(303M)
[1] Tesla K80        | 35'C,   0 % |     2 / 11439 MB |
[2] Tesla K80        | 46'C,   0 % |   206 / 11439 MB | ubuntu(204M)
[3] Tesla K80        | 42'C,   0 % |   206 / 11439 MB | ubuntu(204M)
[4] Tesla K80        | 47'C,   0 % |   206 / 11439 MB | ubuntu(204M)
[5] Tesla K80        | 38'C,   0 % |     2 / 11439 MB |
[6] Tesla K80        | 47'C,   0 % |     2 / 11439 MB |
[7] Tesla K80        | 41'C,   0 % |     2 / 11439 MB |

Gives me:
RuntimeError: all tensors must be on devices[0]

Is there a way around this in the notebook?