Solved by iffiX in post #3 
              
              
                The collective communications are designed for tightly coupled processes, to give you a better idea of how they work, I borrowed some images from mpi: 
[image] 
[image] 
[image] 
Each collective communication primitive is a blocking process for all processes in your created processgroup (whether it …