If you really need samples from both classes, I would write an own Dataset and return a tuple containing both samples.
The WeightedRandomSampler uses probabilities to sample the classes, so some batches might be randomly get more samples of a certain class than the other.
Let me know, if you get stuck with your Dataset.