That’s an interesting observation.
Did you have a look at the running stats before the loss exploded and during this issue?
Are you shuffling the Dataset in each epoch?
Have you tried to freeze the BatchNorm layers after a while? Currently I cannot imagine why the running stats should get that worse, if your model has already been trained for more than 400 epochs successfully.