Solved by ptrblck in post #2 
              
              
                You don’t need local CUDA and cudnn installations, if you are using the conda binary. 
Only the NVIDIA driver will be used. 
Based on the output you are seeing, I assume you’ve installed the CPU binary. 
Could you reinstall PyTorch with the desired CUDA version using the install command from here an…