Artificial Intelligence, Deep Learning, Machine Learning, Gradient Descent, Optimization.
cluster of light blue contours where the distance between consecutive contours is less it takes larger and larger steps towards convergence. Momentum-based Gradient Descent From our discussion on gradient descent, it is clear it takes a lot of time to navigate regions having a gentle slope because