Uninstall all PyTorch installations in your current environment or create a new environment and try to install the latest nightly again.
The binaries ship with their own CUDA, cudnn etc., so your system CUDA installation won’t be used.