Thanks for sharing your thoughts on this issue. Allow me to say that torch.manual_seed did not help at all, neither did worker_init_fn, not sure if I am doing something wrong.  And; you are correct, passing RandomSampler would solve the issue. As a simple solution to my problem, However, I enabled the dataset class to return two instances of the same image instead of one, each transformed differently.