Hi everyone 
I am trying to run my code on multiple GPUs. According to this tutorial, this is as easy as passing my model into a function with the corresponding GPU IDs I would like to use.
However, if I have a model that uses a custom forward method with a for loop, will that be handled correctly by the multiple GPUs?
Also: where do I send the images and labels from the batches to? When using a single GPU I do something like:
for batch in loader:
   # unpack a batch and throw the images and labels on a specific device
   images = batch[0].to(device)
   labels = batch[1].to(device)

How does that look like for multiple GPUs?
Any help is very much appreciated!
All the best
snowe