I’d probably look at torch.utils.data.ConcatDataset 104 instead of concatenating at the dataloader level (could be done using itertools.chain).
On a more abstract level, are you sure you don’t need a test set?
Best regards
Thomas