Artificial Intelligence, Deep Learning, Machine Learning, Gradient Descent, Optimization.
moving with an exponential decaying cumulative average of previous gradients and current gradient. Now let’s see how Momentum GD would perform on the same error surface, Momentum-based GD Animation From the animation, it is evident that Momentum based gradient descent is moving faster than the