For the pre-learned BN layers, would it be possible to force the model to use the running_stats for normalization during fine-tuning (in the training mode), instead of input_stats? Specifically,
training - normalize input with running_stats and update running_stats with input_stats using momentum formula
I am sorry for my confused sentences.