Solved by ptrblck in post #3 
              
              
                If your Datasets have the same sizes, which seems to be the case, you could just iterate both DataLoaders in the for loop. 
Note that the indices for each loader might be different if you use shuffling. 
train_dataset = TensorDataset(torch.randn(100, 3, 24, 24))
val_dataset = TensorDataset(torch.ran…