Machine Learning, Linear Regression, Gradient Descent, Python, Stochastic Gradient.
stepsize in this post. Pick the right stepsize for SGD will take lots of trials. Here are some tips: Try to find a large and small stepsizes first, and intermediate ones exponentially spaced in between Decrease stepsize as iteration increases: stepsize = stepsize / i, where i is i_th iteration