I also wanted to suggest to take a look at the GroupNorm paper, which you’ve already done.
However, I don’t have any stats to share when one or the other approach would work better, so in case you are comparing both, it would be great to hear back which experiment outperformed the other one.