The current implementation does not discard data, it randomly samples from all the concatenated datasets. This means that each dataset will be sampled with probability len(dataset)/len(all_datasets)
To change this behavior, I think one could use WeightedRandomSampler, setting the appropriate weights.