Machine Learning, Optimization, Random Walk, Data Science, Gradient Descent.
direction (from some orthonormal basis) to step in, 2) Check if this step would result in a lower value for the cost function (if it doesn’t then we pick a new random direction) 3) Continue in that direction for a random number of steps as long as the cost function decreases with each step Once