Your model might get into a saddle point, where the gradient is pretty low.
After epoch 10 is could escape the saddle point and gained some speed.
This is a good illustration:
          
            
           12

Taken from: http://www.offconvex.org/2016/03/22/saddlepoints/ 34