Solved by mrshenli in post #2 
              
              
                It should be possible. And there are several levels of APIs that you can use: 

send/recv APIs: https://pytorch.org/docs/stable/distributed.html#torch.distributed.send

collective communication APIs: https://pytorch.org/docs/stable/distributed.html#torch.distributed.all_reduce

RPC APIs: 
a. https:/…