The named_parameters of BatchNorm are the weight and bias, which relate to the gamma and beta from the BatchNorm paper 2.
These are the learnable parameters of the layer, which might eliminate the normalization performed by the running stats.
That’s expected behavior.