apparently the dataloader is not deterministic and in this post shows hows to make it deterministic:

  
    
    
    DataLoader is not deterministic vision
  
  
    Hi, 
I am using DataLoader and even with single worker getting different generation of image order.  How can I make it generate the same image order every time ?  (and does it depend on #workers?) 
Code is initialized with: 
random.seed(1)
torch.manual_seed(1)
torch.backends.cudnn.deterministic = True

In addition, I would like to be able to serialize DataLoader’s internal state to file so that if I stop the run at the middle of an epoch and resume it later then I can continue from the same plac…