Solved by ptrblck in post #2 
              
              
                The global cudnn and CUDA installations won’t be used, if you install the binaries. 
However, since you are using an Ampere GPU, you would need to use CUDA>=11.0 with cudnn>=8, which aren’t used in the PyTorch 1.4.0 binaries.