Machine Learning, Deep Learning, Stochastic Gradient, Data Science, Editors Pick.
do, a point that’s further down the function. Gradient Descent update rule for step t+1. That’s why it’s crucial that the function is convex. If the function is not convex, you might think you’ve found the absolute minimum, but you actually landed at a local minimum. Example of Gradient Descent