Machine Learning, Optimization, Random Walk, Data Science, Gradient Descent.
descent can just update its guess at the best intercept and coefficients by using the gradient evaluated at the new row. However, in certain cases calculating the sum of the gradients even for a single point may prove either prohibitively expensive or downright impossible. When this is the case we