Note that you don’t need a local CUDA toolkit installation, as the conda binaries and pip wheels will ship with their CUDA (cudnn, NCCL, etc.) runtimes.

This sounds awesome! I had to install CUDA before, when running TF code, but such an install is way more convenient using PyTorch!