How did you install PyTorch?
If you’ve installed the binaries, note that they will ship with their own CUDA, cudnn etc., so you don’t need to install these libraries locally unless you want to build from source or CUDA extensions.
Could you post the install log, please?
Were you able to use PyTorch with this GPU before?