Thanks a lot @tom !!
I appreciate your explanation.
To compute per channel running_mean, it computes the mean across all activations for that channel (including all the examples) OR just first mean across examples and then mean across activations ?