Are both datasets identical or different?
If they are identical and you would like to sample in a random but defined order, you could use a SubsetRandomSampler 151, where you can define your own indices, for both DataLoaders.