I tried the following and after each, I still see the same behaviour:

Updating pytorch
Uninstalling and reinstalling pytorch
using conda update --all to update all my packages
Uninstalling anaconda using anaconda-clean and then reinstalling it, installing pytorch via conda install pytorch torchvision cuda80 -c soumith