Jeeze, this is what I get for jumping in trying to implement white-paper models without putting in the time to fully understand the requisite components. I think what you suggested is correct, but to clarify, is it the case that statistics are computed along slices of the channel dimension and the mini-batch dimension for convolutional layers, but only slices of the mini-batch dimension for dense layers?