Following is answer for your reply:


You train your model and the accuracy is good for the training set.  => Yes
You evaluate this model, the accuracy is still good, and you save it.   => Yes(achieved 87% accuracy)
After loading the model you train it again. => No, I only loaded the model
When evaluating again the accuracy is bad. => Yes(70% accuracy)



Did you use an adaptive optimizer (Adam, etc.)?
If so, did you take care of lowering the learning rate?
Did you also save the optimizer and reloaded it?

I used Adadelta for optimization, but I wanted to use the saved model as feature extractor, so I don’t retrain the model.