Is it absolutely necessary to specify? I have had excellent results with
something like:
model = <specify model here>
model = torch.nn.DataParallel(net, device_ids=range(torch.cuda.device_count()))
Which just runs your model as efficiently as possible over as many gpus as
you have.