I updated my pytorch to 1.7 now I get this error on worker node:
image1257×263 41.3 KB
As I checked with nc command I can open any port and two nodes can see each other on them.
Now the worker try to connect to a random port on master node that has not opened as I monitored.

I ran same code on single machine, It is the netstate of estabilished connection:
image1210×814 179 KB