I now have this exact same problem, but I’m running pytorch 1.10.0+cu102. It always occurs midway through epoch 2 of CIFAR10. Any other ideas?
Edit: The problem comes and goes. It just disappeared with one run and returned 2 runs later…