Solved by InnovArul in post #23 
              
              
                I had a look at the github issue and the relevant files. 
It is a tricky issue and it is caused by the line that updates the rng state (unnecessarily?): https://github.com/pytorch/pytorch/blob/master/torch/utils/data/dataloader.py#L437 
I see there are 2 workarounds. 


The Dataloader code can be fi…