@el_youssfi_azeddine thank you! I didn’t know that I need to install cuDNN which solved my issues it seems. At least I can import torch now without error. I’ve got following set up working now:

RTX2080 Ti
Python 3.9.4
NVIDIA-SMI Driver Version 461.33
cuDNN v8.1.1.33 for CUDA 11.2
pytorch 1.8.1

Took me a day to figure it out but hey, let the training begin!
Okay, nevermind, now I get a cuDNN error “CUDNN_STATUS_VERSION_MISMATCH”. I’ll try to roll back to 1.7.1 and 11.0 I guess…