Gotcha, thanks so much for the explanation. I guess it still weirds me out that the running mean and variance should be continually changing when feeding the same data into the layer, but I don’t have a great handle on how that calculation is performed (and got a bit lost trying to delve into the C code that actually implements it).
Nonetheless, thanks for the explanation and the recommended ways to deal with it!