To concatenate two Datasets, you could use ConcatDataset. If you want to use shuffling, you would have to make sure both datasets return tensors in the same shape. Otherwise, you should define the lengths and batch_size such that batches do not contain samples from both datasets.
I’m not sure, how you would like to concatenate the datasets, so let me know, if I misunderstood the question.