Hi all,
I am using RPC to send and receive data with multiple CPUs.
Currently, I use “gloo” backend.
My code is:
rpc.rpc_async(my_target, add_outlinks, args=(arr_send[i],source))

I have nearly 1 million objects.
For each object, I send to (size-1) workers to run the function add_outlinks.
Totally, with 1 million objects, we have to send 1*(size-1) times.
arr_send[i] is from 10 to 1 000 000 numbers.
I run the same function on UPC++, It takes around several minutes. However, with torch-RPC, I set timeout to 10000s ~ 166 minutes, and the program is topped by timeout.
Could you tell me the best way to send data with Pytorch?
Thanks,