No it is by channel, but so the various *Norm modules provide all sorts of variations. I would always recommend to experiment with things to be certain they work as expected: set 1 channel mean to 1 and the others to 0 and all std to 0 and see what happens.
Then look at what changes when setting 1 std to 2 etc.
Best regards
Thomas