Note that the pip wheels and conda binaries ship with their own CUDA runtime (as specified during the installation) so you would only need a compatible NVIDIA driver (unless you want to build PyTorch or a custom CUDA extension from source which would then use your local CUDA toolkit installation).