ok the problem is pytorch version 0.1.11_4. It had this problem and I updated it to 0.1.11_5 which did not have this issue.
Can you do:
conda uninstall pytorch
conda install pytorch -c soumith

Verify that it is installing 0.1.11_5