Machine Learning, Deep Learning, Stochastic Gradient, Data Science, Editors Pick.
alpha is the size of the step Gradient Descent takes all the way until it reaches the global minimum, and it directly impacts the performance of the algorithm. Learning rate is too big When the learning rate is too big, you’re taking big steps. You may step over the minimum a few times, and then go