Did you install the PyTorch binaries or did you build from source?
In the former case the binaries will already ship with CUDA.
Could you check the CUDA version you are using by printing torch.version.cuda?
Since you are using a Turing GPU, CUDA10 is recommended.