Well if you want to do shuffling, just generate half of the images from the first dataset and other half from the other dataset and pass then to your model.
If your batchsize=32. Get 16 images from first dataloader and 16 images from second dataloader and pass them to your network, independently or shuffled.