@jdhao, I wasn’t talking about the scaling, I was talking about the bias term.
Moreover, in the case of images all pixels are within the same range so stuff like normalizing different features units doesn’t apply here.
Put my question differently, after this “Centering” does the Bias of the first layer filter is around 0?