If you are using virtual environments (e.g. via conda) you can have multiple installations on your system (one per environment)
Since the CUDA11 nightly binaries are not ready yet, you could install the latest PyTorch version with CUDA10.2 from the binaries or try to build from source using your local CUDA11 installation.