Hey, sorry for my late reply.
Correct me if I am wrong but I assumed that "_iter_()"returns the order of indexes that will be sampled during dataloading. In other words, given a list [0, 1, 2, 3] and a batch size of 2, the indexes of the two mini–batches would be [0, 1] and [2, 3].
Given that the above is correct, to solve my initial issue, I simply sampled without replacement each mini–batch independently. In theory this would translate to sampling with replacement over multiple mini–batches while maintaining unique instance within each mini–batch. Let me know if I am missing something!