Hi @ptrblck, thanks for your reply. I have looked at your implementation and found that I should calculate the mean and variance along the first and third axis, but after I change it, the result is still different.
Ex = input.mean(dim=[0, 2], keepdim=True)
Varx = torch.sqrt(input.var(dim=[0, 2],  keepdim=True)) 

And setting unbiased=False also does not work.
And I have check the running mean and running var, it is the same. ( I have update the question above) Could you please take a look at my code?
Thanks a lot