Machine Learning, Deep Learning, Stochastic Gradient, Data Science, Editors Pick.
gone wrong. In non convex functions, Gradient Descent might find the local minimum instead of the absolute minimum of the function. Looking at the update rule, there’s the current point w, the gradient, and then there’s the learning rate alpha. What is this learning rate alpha? The learning rate