Hm… I would recommend to visit the Nvidia CUDA archive: CUDA Toolkit Archive | NVIDIA Developer
and install the latest (or your torch version) compatible CUDA version for PyTorch.
Me personally have never gotten a mismatched CUDA version to work properly with my PyTorch installations. NVIDIA develops CUDA drivers faster than PyTorch and other projects have time to adapt to them.