Solved by ptrblck in post #2 
              
              
                The running_var update is performed using the unbiased variance as seen in my manual example and the PyTorch backend implementation.