Machine Learning, Linear Regression, Gradient Descent, Python, Stochastic Gradient.
well, while there are some small differences between SGD with the other two. Least square solution will always find the best fitted line since the gradient = 0. However, for many machine learning problems, the feature dimension can be really large, then solve gradient = 0 might not be feasible. For