Machine Learning, Gradient Descent, Data Visualization, Data Science.
sum_of_gradient in eq. 1 to get eq. 3.) Step-by-step illustration of momentum descent. Watch live animation in the app. For the rest of this post, I sloppily use gradient x and gradient y in the visualization; in reality, because it’s gradient *descent*, it’s actually the negative of the gradient.