If you install a binary package of PyTorch (e.g., from pip, conda), it should use its own version of CUDA distinct from the install on your system. (Only the driver version of your install would be used.) So there shouldn’t be any issues here.