Backpropagation, Mathematics, Calculus, Machine Learning, Neural Networks.
gradient of W², of the expected size. In gradient descent we can imagine ourselves subtracting this gradient (multiplied by some learning rate) from our current set of weights. I purposefully left out the calculation of the partial derivatives w.r.t the bias terms, but you can pretty easily follow