Solved by ZimoNitrome in post #3 
              
              
                If you would still like one initial shuffling you could maybe shuffle your dataset at the start somehow or make a custom sampler: 
import torch
from torch.utils.data.sampler import Sampler
from typing import Iterator, Sized

class ConstantRandomSampler(Sampler[int]):
    def __init__(self, data_sour…