These are not nn.Parameter but buffers. They are plain Tensors and are registered with register_buffer().
These buffers should not require gradients. The error you’re seeing is because the formula to compute the gradient wrt the running statistics is not implemented for batchnorm.