@mrshenli Try to run the code like this,



 matrix:

How to run:
Env. variable exports for all of these 3 nodes:
export MASTER_ADDR=<Node 0 IP>
export MASTER_PORT=<Node 0 port>
export GLOO_SOCKET_IFNAME=network interface
export TP_SOCKET_IFNAME=network interface
On Node 0: python <filename> 0
On Node 1: python <filename> 1
On Node 2: python <filename> 2


You might not be able to regenerate this error locally using mp.spawn.
Thank you, all for helping me out.