Artificial Intelligence, Deep Learning, Machine Learning, Gradient Descent, Optimization.
about the gradient descent update rule but we don’t know why the movement is slow in some parts and fast in some parts of the contour surface. Let’s take a simple function shown below, As you can see from the figure, the curve is a combination of very steep region and gentle region. The slope