Solved by mrshenli in post #8 
              
              
                The init_process_group API only sets up the process where this function is invoked. And, as the world_size is set to 1, It only expects one process in the distributed training gang. If you would like to use multiple processes, please see this example. 

but this causes problems later in my code, wh…