Solved by mrshenli in post #3 
              
              
                Currently, torch.distributed does not support Windows yet. Just created a poll/issue to track how many people would need this feature: https://github.com/pytorch/pytorch/issues/37068