Machine Learning, Gradient Descent, Data Visualization, Data Science.
accumulated pushes it forward, and the ball keeps rolling back and forth. We can apply the concept of momentum to our vanilla gradient descent algorithm. In each step, in addition to the regular gradient, it also adds on the movement from the previous step. Mathematically, it is commonly expressed