Hi!  thanks for your answer but not quite…
I’m asking:  the metrics  is calculated per batch, but I want the mse on the entire validation dataset. How do I do this? Do i have to store all the predictions somehow? How do I “store”  them if so?
Also, when you  say “it depends on the metric”. This sounds  like behind the scenes  ignite figures out whether to hold on the the storage of the history of predictions or not. #1) Does that mean that ignite’ MSE will automatically calculate the MSE on the entire validation set, not just one batch at a time? #2) But how do I do it  for a personal metric that ignite doesn’t have already?
Thanks!