Hey @ankahira
Two questions:

What parameters did you pass to init_process_group invocation in train_dist.py?
Can you check if RANK and WORLD_SZIE are set properly for each process?

Sudarshan wrote a great example 137 of how to use launcher.py, which might be helpful to you.