Machine Learning, Optimization, Gradient Descent, Deep Learning, Learning Parameters.
also derived Gradient Descent update rule from scratch and interpreted what goes on with each update geometrically using the same toy neural network. We also addressed a significant limitation of GD, issue of slowing down at gentle regions, in its raw form with a curve illustration. Momentum-Based