Yes, the Dropout layer was still a non-deterministic part of your network. This is one of the main reasons for eval(). I’ve never tried it, but I assume setting the dropout probability to 0.0 would have worked as well. Not sure, thought.