Hey @soulslicer,

But as soon as the first process hits the barrier, it stops all the other processes! Why is this?

This is not the expected behavior. Could you please share the code to repro? Do other processes call c10d APIs (e.g., allrecue/allgather) but the first process is not participating?