I am observing this phenomena in PyTorch 0.4.0. Setting num_workers > 1 and shuffle = False, is shuffling the data. I think this is counterintuitive to the users of PyTorch and changes should be made so that num_workers does not shuffle the data.