Machine Learning, Data Science, Artificial Intelligence, Data, Deep Learning.
fixed learning rate. As we approach a local minimum, gradient descent will automatically take smaller steps so there is no need to decrease the learning rate over time. Credit: Stanford CS229 Course Notes. Trajectory for gradient descent is like climbing down into a valley 3 Types of Gradient