Machine Learning, Gradient Descent, Stochastic, Optimization, TensorFlow.
easily. Nestrov’s Accelerated Gradient Here, instead of blindly taking a step in the opposite direction of the gradient as we did in momentum, we “look ahead” to see what the surface in front of us looks like. This helps to avoid overshooting that might happen if we move forward without looking