Solved by mrshenli in post #2 
              
              
                Yes, this is possible, but there is one caveat. The current implementation of init_rpc() sets the default process group. It actually shouldn’t do that, and we are fixing it (see this issue). With the current RPC implementation, I see two ways to implement this feature. 
Option 1
First, call init_rpc(…