Solved by ptrblck in post #2 
              
              
                If you are using the shuffle option in the DataLoader, a RandomSampler will be created as seen here. This sampler sets  replacement argument to False by default so that a random permutation will be applied as seen here. 
This makes sure that each sample is only drawn once in this setup. 
Note that …