Reverted to cuda-8.0 and installed pytorch from source. But still had the same problem.
Single GPU cuda runs OK, but two GPUs, the code hangs.  The stacktrace was posted above.  Please help. Stuck here.
1080Ti cards.  nvidia-smi shows 100% GPU-util in both cards.