Solved by colesbury in post #2 
              
              
                I don’t think it’s in the caffe2 model. You probably don’t need it. It’s only used when computing running_mean/var with a simple moving average. By default we use an exponential moving average.