Thanks for the help!
Is there any experimental code for Gloo with IB support that i can have a try?
The new NCCL2 backend seems quite ready, I will try it and feedback soon.
Thanks again for your effort!