Hey @nickvu, I would expect DataParallel to work with Windows. What error did you see when using it?
cc @VitalyFedyunin @ngimel
Echoing @ptrblck’s comment, yep, Windows support for DDP (with only FileStore rendezvous and Gloo backend) will be included in v.17 as a beta feature. If you encountered any issue with it, please join the discussion here:

  
      github.com/pytorch/pytorch
  
  
    
  
	  
  

  
    
      [RFC] Add Windows support to torch.distributed package 54
    

    
      
        opened 
        
          
        
        Jul 27, 2020
      
      


      
        
          
          gunandrose4u
        
      
    
  



  🚀 Feature
Enable torch.distributed package supported on windows platform, this feature is only the first step, limited features supported compare to linux...



    module: windows
    oncall: distributed
    triaged
    windows-triaged