Usama-Zafar:

dist.init_process_group(backend=“mpi”, group_name=“main”)


BTW, the way you call init_process_group does not look correct to me. You will need to either provide rank+world_size or provide an initialized store. The former will be easier.