You can just install the NVIDIA driver, select a desired PyTorch binary using the posted link, and install it.
E.g.
conda install pytorch torchvision torchaudio cudatoolkit=10.2 -c pytorch

will install PyTorch with the CUDA 10.2 runtime (as well as cudnn7.6.5).