The following appears to be the same issue:

  
    
    
    Non Reproducible result with GPU 
  
  
    I tried that workaround in the simple case of the cifar10 tutorial: 
http://pytorch.org/tutorials/beginner/blitz/cifar10_tutorial.html 
after having added only the Flip transform line: 
transforms.RandomHorizontalFlip(), 
I also inserted a seed initialization: 
torch.manual_seed(0) 
and I even disabled the shuffle. 
I am still not able to reproduce the results. Any other idea?
  


If I use num_workers=0, I can get back the augmentation without losing the deterministic behavior, exactly as reported in the link above.