Artificial Intelligence, Deep Learning, Machine Learning, Gradient Descent, Optimization.
small. If the derivatives are small then the update of the parameter will also be small. Hence in the areas where the curve is gentle, the updates are small whereas in the areas where the curve is steep the updates are large So What? We have figured out the reason why the gradient descent update is