I think you could write a custom sampler, which could use the WeightedRandomSampler implementation 5 as the base and create indices with non-duplicates using the batch size.
What kind of issues are you seeing with these duplicates?