Machine Learning, Optimization, Random Walk, Data Science, Gradient Descent.
to find the true minima of the cost function, often we’ll get stuck in a local minima and the algorithm will stop, thinking it’s in the true minimum. Stochastic gradient descent attempts to solve the complexity issue by modifying step 2 to only evaluate the derivative of one randomly chosen