While I’m still learning about these versions - the Nvidia GPU version of CUDA must not be confused with the compatible version with PyTorch. You can look at the CUDA version for the GPU as the best allowed version.
Does your GPU support up to x.x version of CUDA? Then use the y.y PyTorch compatible version of CUDA up to that x.x version.