Artificial Intelligence, Deep Learning, Machine Learning, Gradient Descent, Optimization.
update the parameters. In essence, what we are doing in Nesterov Accelerated Gradient Descent is that we are looking forward to see whether we are close to the minima or not before we take another step based on the current gradient value so that we can avoid the problem of overshooting. Comparison