Machine Learning, Linear Regression, Gradient Descent, Python, Stochastic Gradient.
example, if N < D, then we can’t solve gradient = 0. Even if we can solve it, gradient descent is computationally more efficient when feature dimension is really high. However, gradient descent can be super slow when the dataset is large because the entire dataset is used to compute RSS to update