+1 for what KFrank just said, you need to wait a bit more for your model to overfit.
If you want a good starting point to improve your model, start by playing with your learning rate.

Related article: https://towardsdatascience.com/understanding-learning-rates-and-how-it-improves-performance-in-deep-learning-d0d4059c1c10 1