Got this error again after about 110K steps using nn.DataParallel. Following is the system config:
cuda: 9.1
pytorch: 0.3.0.post4 (conda install pytorch torchvision cuda90 -c pytorch)
Nvidia driver version: 387.26
GPU: 2x 1080ti