Solved by mMagmer in post #4 
              
              
                @JanoschMenke torch BatchNorm1d doesn’t use unbiased estimator for variance. 
And running_mean and running_var only apply when model is in eval mode. 
Also, BatchNorm1d module has learnable affine parameters. That you should consider when computing output. But it initializes with 0 and 1 for bias an…