I am facing the same issue with 2 node training on a different model: “Unexpected poll revent: 25 on socket: 90: Software caused connection abort”. I am using the torch.distributed.launch utility.
Anyone able to resolve it? Or have any idea what might be causing it?