I downloaded the version with CUDA 11.3 and it worked perfectly. I still have no idea what was wrong with my CUDA 10.2 version though.
>>> import torchvision
>>> torchvision.__version__
'0.11.2+cu113'