Machine Learning, Gradient Descent, Data Visualization, Data Science.
Adam uses both first and second moments, and is generally the best choice. There are a few other variations of gradient descent algorithms, such as Nesterov accelerated gradient, AdaDelta, etc., that are not covered in this post. Lastly I shall leave you with this momentum descent with no decay.