The binaries with with their own CUDA, cudnn, etc. libraries, and won’t use your local CUDA installation.
Your GPU with compute capability 2.0 is not supported using the binaries, as the only cc>=3.7 is supported with the latest binaries.
Usually you would need to build PyTorch from source for an older GPU, but I’m not sure at the moment, if 2.0 is supported at all or if it’s too old.