Yes, though I’m not sure how to do it so that each mini-batch is synchronised.
I’ve tried experimenting by wrapping DataParallel around the nn.GRU but then it’s complaining of the incorrect hidden dimensions.
Edit Is there an alternative way to run the model on the GPU simultaneously on two GPUs manually without using the DataParallel method?