Currently, I am also facing the similar issue of reproducibility on pytorch.
As suggested, I tried disabling cudnn. But pytorch slows down the execution by 5-10x.
Edit:
With cudnn disable, I am still not able to reproduce the results. I found out that the issue is because of torchvision transform file. When I disable the following lines in the code,
transforms.RandomCrop(32, padding=4),
transforms.RandomHorizontalFlip(),
then I am able to reproduce the same results. Setting seed using random.seed() doesn’t work either. Is this behavior expected or am I doing something wrong ?