Thanks for the update.
It sounds as is the running estimates might overfit to the training data.
How large is the currently used batch size and did you change the momentum in the batchnorm layers?
If the training batch size is small (e.g. <16), the running stats might be too noisy, which would result in a bad validation performance.