I’ve also reset the running estimates and set the layer to eval, so that these running estimates will be used and no batch statistics will be calculated.
It’s not pretty as you might get errors if you forget to switch this layer to eval, so that’s why I also suggested the other approach of removing the layers completely.