The running estimates will still be calculated and updated during training while only applied in evaluation. Therefore you should still call model.eval() before starting the evaluation.
Let me know, if I’ve misunderstood your question.