Hello I just encountered this problem as well. I am running pytorch on a cluster. Here is the information about the sysmtem and code I am running:

Python 2.7 and CUDA 7.5 with latest pytorch.
GPU I am using is 1080 Ti.
My model is a simple bidirectional layered GRU followed by two linear layers. The Model.cuda() can take about 10 minutes. I am not sure if this is normal.

Thanks in advance for any help!!!