@thyeros Ideally pruning on the same weight and bias array, should result the same masks as the L1 norms would be the same (in case of L1Unstructured)
Can you check whether the weights are indeed the same on all machines before you execute the pruning call