Due to compatibility issues, I am using pytorch=0.2.0 with python=2.7
I installed it using  conda install pytorch=0.2.0 cuda80 -c soumith as it was pointed out on the forum that this will lead to reduction in lag while using .cuda() for the first time, however I do not see any improvements and loading still takes ~3mins.
(P.S I’m using tesla v100)