The batchnorm stats will be updated by default during training (the model is by default in training mode or you can additionally call model.train()) while these running stats will be used during validation after calling model.eval(). I’m unsure how you would like to update these stats so could you explain the use case and question a bit more?