Computational Physics, Python, Linear Algebra, Svd, Code.
Loop: Use weights to calculate a prediction Calculate the derivative of the loss Update the weights Repeat step 2 lots of times. Eventually, we end up with some decent weights. Key: We want to decrease our loss and the derivative tells us the direction of the steepest descent. Stochastic Gradient