I’m investigating this. It is hard to find a K80 (we dont have them). I found one possible deadlock in nccl primitives bindings, i am fixing this. i am hoping that will resolve the K80 issue. I will ping back here once i push that fixes to master.