Solved by ptrblck in post #2 
              
              
                The binaries ship with their own CUDA, cudnn, etc. so that you don’t need to install these libs locally, if you are fine with the provided versions. 
Could you uninstall PyTorch in your conda environment and reinstall it (with cudatoolkit=10.1)? 
If you want to use e.g. CUDA10.2, you would have to i…