I think 1.4 would be the last PyTorch version supporting CUDA9.0.
Note that you don’t need a local CUDA toolkit, if you install the conda binaries or pip wheels, as they will ship with the CUDA runtime. You would only have to make sure the NVIDIA driver is updated to the needed version corresponding to the CUDA runtime version.