crnyu:

RuntimeError: [enforce fail at /opt/conda/conda-bld/pytorch_1616554800319/work/third_party/gloo/gloo/transport/tcp/device.cc:208] ifa != nullptr. Unable to find interface for: [0.31.32.145]



Hey @crnyu, the above error seems to suggest the code is using gloo instead of NCCL. Have you tried configure GLOO_SOCKET_IFNAME instead?