It seems that ransforms.RandomCrop() and transforms.RandomHorizontalFlip() used the “plain” python seed, not the torch one. I fixed the reproducibilty issue with:
import random
random.seed(0)
Reproducibility is conserved while enabling shuffle but not with num_workers>0.