I was running a training using DDP. When the pytorch pruning lib is used, I found that there is very little inconsistency in the prune mask density. I used global_unstructured. Is it supposed to be non-deterministic? perhaps due to the floating point operation? As long as DDP ensures that weights are always in sync, the pruning masks should be identical as well all the time?