I guess you might be using the PyTorch binaries with the CUDA 10.2 runtime, while you would need CUDA>=11.0. Check the shipped CUDA version via print(torch.version.cuda) and make sure it’s 11.



 tjk:

The cuda version of our workstation is 11.1, cudnn version is 11.3 and pytorch version is 1.8.2.


Your local CUDA toolkit won’t be used if you’ve installed the binaries, as they ship with their own CUDA runtime, cuDNN, NCCL etc., unless you are building from source or a custom CUDA extension (also cuDNN is currently at version 8, so you might have read the wrong version tag).