Could you create a new environment and install PyTorch as well as torchvision again?
Something seems to be broken in your installation, when you are able to import torchvision, but not torchvision.datasets.