Brando_Miranda:

I am asking since my model seems to have them be zero despite no training having been done yet


That’s expected, since the running_mean will be initialized with zeros and the running_var with ones.
Both are update during the training, so if no training was performed yet, they will keep their initial values.
If you don’t want to use the running stats but want to normalize the input activations with their batch stats, use track_running_stats=False.