Calculus, Linear Algebra, Machine Learning, Mathematics, Math For Machine Learning.
minima.so these steps are known as learning step(alpha). why we need learning rate: We can take elephant steps in the initial phase. But while moving near minima, we need to take baby steps, because we may cross over the minima and move to a point where slope increases.So in order to control the