Artificial Intelligence, Machine Learning, Deep Learning, Neural Networks.
if the learning rate is too large, you might jump over the minima and reach the other side of the valley. Learning Rate too small or too large | Source: Image by the author. Thankfully, there are various methods like GridSearch, Learning Rate Scheduling, Cyclic learning rates, Adaptive Algorithms,