Hi again!
I looked in the manual and the momentum value should be lower (not higher as I wrote above) to get more stable statistics. I have lowered it and restarted training. Now it lookes like evaluation mode is getting more stable, but I might need to try more values.