Machine Learning, Gradient Descent, Stochastic Gradient, Batch Gradient Descent, Regression.
term (w0) for now. Data sample (1,1) is chosen first, so the Cost function C becomes: C(W) = (1*w1 + 1*w2–1)², now we optimize W to decrease the cost. This C(W) is a surface, we want to find the global minimum of this surface. Data sample (3,4) is chosen, so the Cost function C becomes: C(W) =