Solved by mbehzad in post #7 
              
              
                Hi @mrshenli you are right indeed. I updated to PyTorch 1.8.1 and used the gloo backend and file init_method() and it works. 
For anyone wondering, following is a sample code that works on Windows. However, I do not suggest distributed processing on windows. 
import torch.distributed as dist

dist.i…