This worked for me!

conda update pytorch torchvision -c pytorch

The following NEW packages will be INSTALLED:
cudatoolkit: 8.0-3

The following packages will be UPDATED:
pytorch:     0.2.0-py36h53baedd_4cu80 soumith [cuda80] --> 0.3.0-py36_cuda8.0.61_cudnn7.0.3h37a80b5_4 pytorch
torchvision: 0.1.9-py36h7584368_1     soumith --> 0.2.0-py36h17b6947_1                       pytorch