The running stats were updated using all training batches, so if you assume that an interpolation of the parameters works fine, it might also work on the running stats.
EDIT: your use case might also be similar to Stochastic Weight Averaging 7, so you could take a look how the parameters are averaged and how batchnorm layers are treated.