Is there a good way to share information between DDP processes? Even if it’s just something from process-0 to the other processes.
My use-case is that I need to coordinate some data-loading/sampling across my different processes, and it would be good if I could, for example, determine what to sample in process-0 and distribute that information to the other processes.