For training, the statistics does not matter as it does not concern the training process.
For validation, I want to use the batch stats.
For test, I want to use the global stats over the whole dataset.
So the solution would be: set track_running_stats=False, calculate the global stats offline and assign it to the model parameters?
Is there any easy to calculate the global stats?
Thanks.