Solved by ptrblck in post #2 
              
              
                By default the DataLoader will use a SequentialSampler, if shuffle=False, otherwise RandomSampler with the default argument replacement=False, which would yield each sample only once in each epoch.