Pinterest, Engineering, Monetization.
look at the formula for Batch Norm and its underlying process during the forward pass. Batch Norm has two learnable parameters, namely beta and gamma, along with two non-learnable parameters, mean moving average and variance moving average. Here’s how the Batch Norm layer operates: Calculate Mean