@ptrblck ,
Thank you!
how are running_mean and running_var used in code?
I mean in what case they are used?
I am experiencing the following issue:
there are 2 bn layers in  2  models respectively. the input, weight, bias are all the same, and the only difference is running_mean and running_var.  in model.train() case, the output of those 2 bn layer are different. why?