meandmymind:

For me I will have only one “main” and one “remote” worker so it’s not hard. But for general rpc it’s not good.


RPC framework is mainly used for model parallelism. It seems that your use case is very different from this purpose.
Update: We have an ongoing project called elastic RPC, which should be able to work for your use case.