Optimization, Mathematics.
of generality, which gives a simple closed form for loss after $t$ steps. (for derivation, see Gradient Descent on a Quadratic post) ‌ $$\begin{equation} L(t)=\sum_{i=1}^n (1-\alpha h_i)^{2t} h_i w_0² \label{loss2} \end{equation} $$ ‌ Each starting point $w_0$ gives a different loss trajectory, but