Does tensorpipe RPC backend 2 work in this case? It is still experimental, but we plan to make it the default backend and focus on it in future releases.
Regarding the error, I suspect this is a limitation in Gloo. I don’t have enough resource to verify this locally. If possible, can you try if init_process_group 2 and all_reduce work with 1024 nodes?