Yes, they were unset.
By the way, if I swap scripts with rank=0 and rank=1 on these machines,
then script with rank=1crashes:
python train_dist.py 1 2
RANK: 1 wsize: 2
terminate called after throwing an instance of ‘gloo::IoException’
what():  [/opt/conda/conda-bld/pytorch_1544176307774/work/third_party/gloo/gloo/transport/tcp/pair.cc:724] connect [127.0.1.1]:3978: Connection refused
Script with rank=0 still waiting for connection