Hi @zazzyy,
Thank you very much for your kind response. I totally agree with you that the the running_mean and the running_var are calculated by batch statistics during training.
But during test time, we use the pop_mean and pop_var for test, which represent the entire dataset statistics. Please refer to the training step2 in the answer of Le Quang Vu here 39. The pop_mean and pop_var get updated during the training stage as well.
I suppose that the pop_mean and pop_var here are equivalent to running_mean and running_var in pytorch so that they need to be updated?
Thank you in advance for any help.