Neural Networks, Gradient Descent.
for Mean Square Error Given a gradient at a point, gradient descent is an algorithm which uses the gradient information to find the optimal/minimal parameters of the Loss function (optimum is reducing the loss to minimum) The parameters in the context of Neural Networks are weights (and biases). So