Machine Learning, Deep Learning, Stochastic Gradient, Data Science, Editors Pick.
the function. So, while the gradient hasn’t converged, on each iteration you will Compute the negative gradient at w. Update point w with it the result of 2a, and go back to step 1. Mathematically speaking, on each iteration, you run an update rule, where you define the next point you’ll descent