The model was trained using batch norm, so I wouldn’t expect its performance to stand up without using batch mean and variance. You can, however, set the batch norm layers to run in eval mode and thus use the saved mean and variance.
model.train(True)
bn1.train(False)
bn2.train(False)
etc...