Pinterest, Engineering, Monetization.
practitioners. At Pinterest, we leverage Batch Norm in combination with other normalization techniques like minmax clip, log norm, and layer norm to effectively normalize our input data. However, we have encountered cases where Batch Norm itself can introduce model instability. Let’s take a closer