Hi,
I have a Pytorch model for machine translation. I rented a 4 GPU machine.
The dataset is very large.
How to train my model using the 4 GPUs?
I see the model uses only 1 GPU.
So, my question is:


What are the mechanics of training on 4 GPUs?


Any way I can make my model run on the 4 GPUs?


Thanks.