Hi
Some questions:

could you provide code of your example() that contains torch.distributed.init_process_group
what is world_size in your example? (seems like on each node you should spawn number of processes = number of GPUs = 2)
could you add logging to before and after torch.distributed.init_process_group and see if process group is being inited correctly