sakh251:

I also had to specify the backend to avoid other error as this:


Yep, default backend is ProcessGroup is you are using PyTorch version <= v1.6. We changed the default backend to TensorPipe in v1.7. BTW, which version are you using?
Regarding the connection error, have you tried using ProcessGroup backend instead of TensorPipe backend. I would assume it will run into the same problem, but if it does not, we can narrow down the problem. cc @lcw

Yes, I changed it to the master node:

What did you specify for the worker node? And the Connection refused error only occur on worker?