Machine Learning, Artificial Intelligence, Neural Networks, Data Science, Towards Data Science.
in faster learning, but convergence is more difficult and often unstable. A smaller learning rate results in slower learning, and whilst convergence is possible, it may only occur after an inordinate number of epochs, which is computationally inefficient. Clearly, there is a sweet spot in between