Hi, do you solve the problem? I also need to gather tensors of different sizes, but during training stage. The function I want to use is dist.all_gather. I know how to gather tensors of the same size, but I cann’t find any tutorials how to gather different-size tensors.
Thanks