Artificial Intelligence, Deep Learning, Machine Learning, Gradient Descent, Optimization.
in the direction of gradient history and another in the direction of the current gradient because of this two-step movement we are overshooting the minima. Instead of moving two steps at a time, why not first move a little in the direction of gradient history, compute the gradient at that point and