I found great article https://medium.com/octavian-ai/which-optimizer-and-learning-rate-should-i-use-for-deep-learning-5acb418f9b2 211
It’s a great research and I solved the problem.
Thank you very much for help!