Hello,
I am trying to train a multi-modal model on multiple GPUs using torch.nn.DataParallel.
However, I have multiple modalities so the input to the model is a dictionary.
Is there any way to make this work on multiple GPUs? As far as I’ve understood DataParallel only works if the input to the model is a tensor.
My input to the model looks like the following:
{
'modality_1': torch.Tensor((bs, *img_size)),
'modality_2':  torch.Tensor((bs, *img_size)),
'modality_3':  torch.Tensor((bs, *img_size)),
}