Solved by mrshenli in post #2 
              
              
                Hey @crnyu, the above error seems to suggest the code is using gloo instead of NCCL. Have you tried configure GLOO_SOCKET_IFNAME instead?