Solution worked for me, I was installing only PyTorch via Anaconda Navigator. Using command line and the command specified on the page fixed it for me. Thanks.
conda install pytorch torchvision cudatoolkit=10.0 -c pytorch

This one.