Is this the same as Multiprocessing - Barrier Blocks all Processes? 7
BTW, for future questions on torch.distributed, could you please add a “distributed” tag. People working on the distributed package are monitoring that channel.