Good point.
This used to be possible and was not reinstated when we moved to c10d for PyTorch 1.0. I created an issue on GitHub to bring this functionality back: https://github.com/pytorch/pytorch/issues/22128 9.