Doing model.eval does nothing. You can remove that line and you will get the same result.
I guess this happens because your model contains batchnorm or similar layer for which the statistics are not very high quality?