If you’ve installed the CUDA10.2 binaries, the first CUDA operation would call into the JIT and compile the kernels for your compute architecture.
You could use the nightly binaries, which are build with CUDA11 and support sm_80 via:
conda install pytorch torchvision cudatoolkit=11.0 -c pytorch-nightly