Hi,
I noticed that each async torch.distributed request object holds a pointer to the sent tensor,
therefore the buffer memory is not freed in the sender process until we explicitly call wait() or is_completed().
I am looking for a way to overcome this.
any suggestions?