Thank you, and I truly appreciate your very clear explanation.
Would it be possible to use running_stats instead of input_stats for normalization during the training stage?
Because I am dealing with the training data of differrent domains, and therefore the direct use of input_stats harms the performance directly.
Thank you.