Machine Learning, Gradient Descent, Stochastic Gradient, Batch Gradient Descent, Regression.
towards the global minimum, sometimes it also helps to avoid local minima. But why exactly? This is why. In general, the gradient direction is perpendicular to the corresponding contour, because we want to decrease the value of the cost function in the shortest path, which will be the steepest path