Yes, I’ve updated the code with the example function and some loggings. The issue is at the torch.distributed.init_process_group as the error log shows.
Regarding the world_size, I specify 4 processes, where each node contains 2.