Hi
I found version v0.4.1 is released and there is a check in torch/nn/parallel/distributed.py
if dist._backend not in (dist.dist_backend.NCCL, dist.dist_backend.GLOO):
raise ValueError(‘Invalid backend, only NCCL and GLOO backends are supported by DistributedDataParallel’)
Does this mean MPI is not supported anymore?