Machine Learning, Gradient Descent, Data Visualization, Data Science.
minimum (the left well) and local minimum (the right well) So, in what ways is Momentum better than vanilla gradient descent? In this comparison on the left, you can see two advantages: Momentum simply moves faster (because of all the momentum it accumulates) Momentum has a shot at escaping local