what if you have a large amount of data to process (evaluate, not train) and you want to take advantage of mulitple gpus?  in this case would it be best to use the DataParallel class and just use a larger batch size?  or would replicating the model using something similar to the example:
modelA = modelA.to(‘cuda:0’)
modelB = modelB.to(‘cuda:1’)
be the way to go?