Is it possible to train multiple models on multiple GPUs where each model is trained on a distinct GPU simultaneously?
for example, suppose there are 2 gpus,
model1 = model1.cuda(0)
model2 = model2.cuda(1)
then train these two models simultaneously by the same dataloader.