Machine Learning, Optimization, Gradient Descent, Deep Learning, Learning Parameters.
180-degree angle w.r.t. the gradient. At a given point on the loss surface, we move in the direction opposite to the gradient of the loss function at that point. This is the golden Gradient Descent Rule!! Weight/Parameter Update Rule Algorithm Now that we have a more principled way of moving in the