Solved by mrshenli in post #5 
              
              
                Looks like we still miss that return at least in master. I am not sure whether some earlier changes were applied but got revert or not. Adding it in https://github.com/pytorch/pytorch/pull/42131 

I was just starting out with DistributedDataParallel and was not sure whether it’s possible to switch m…