FaultyBagnose:

Over which periods are the batch norm running statistics collected?


During model.train() the batch statistics will be used to update the running stats using the momentum.



 FaultyBagnose:

Are they reset or discarded each time I switch the model between modes?


No. You can check them via bn.running_mean and bn.running_var.