Ah right, the gamma, beta parameters. It seems feasible to extend computation explained here to per-example computation  https://kratzert.github.io/2016/02/12/understanding-the-gradient-flow-through-the-batch-normalization-layer.html 52