Neural Networks, Gradient Descent.
It is the measure of the slope. Wikipedia -slope Let’s take small incremental steps (learning rate) in the direction of the least slope -towards the negative of the slope. We can move towards a local extremum, which in the context of optimization is typically a minimum assuming that the function is