Gradient Descent, Neural Networks.
rather than to all zeros. We’ll see later why that’s the case, but after initializing the parameter to something, each loop or gradient descents with computed predictions. So, you basically compute your Y hat I, for I equals one through M, say. Then, you need to compute the derivative. So, you need