Machine Learning, Optimization, Gradient Descent, Deep Learning, Learning Parameters.
this blog post, we build up the motivation for Gradient Descent using a toy neural network. We also derive Gradient Descent update rule from scratch and interpret what happens geometrically using the same toy neural network. Citation Note: Most of the content and figures in this blog are directly