Gradient Descent, Machine Learning, Neural Networks, Optimization, Linear Regression.
of steepest descent, moving closer to a valley. This process is repeated until a local minimum, the bottom of a valley, is reached. It’s important to note that some cost functions may have multiple local minima. When running gradient descent, the algorithm converges to the nearest local minimum