If you’ve built PyTorch using different CUDA versions (local installations) in different conda environments, you wouldn’t need to change the CUDA path as long as you are not rebuilding PyTorch or CUDA extensions.
I.e. running PyTorch operators alone would work in your conda environments using the libraries built with the different CUDA compilers.