Max pooling isn’t change in eval and train, so as long as you can load the model, you should be fine.
I still think it’s due to a bad estimate of the running stats, because you get a better result “retraining” only the batch norm layers.