I would like to train some models to multiple GPUs.
Let suppose that I use model from HF library, but I am  using my own trainers,dataloader,collators etc.
Where I should focus to implement multiple GPU training? I need to make changes only in the Trainer class? If yes, can you give me a brief description?
Thank you in avance.