Machine Learning, Optimization, Gradient Descent, Deep Learning, Learning Parameters.
Gradient Descent gives us a principled way of traversing the error surface so that we can reach the minimum value quickly without resorting to brute force search. Deriving The Gradient Descent Rule It is reasonable to randomly initialize w and b and then update them iteratively in the best way