Hey @yueyilia, would I be correct if I assume the world_size is NUM_TRAINER_PROCESSES + 2 * num_envs_each_server? Have you trired increasing the value of num_worker_threads to, say, 128?
BTW, when you replace init_rpc with init_process_group and use the same rank and world_size, port, and, address, does it work?