Machine Learning, Optimization, Gradient Descent, Deep Learning, Learning Parameters.
taken from Lecture 5 of CS7015: Deep Learning course offered by Prof. Mitesh Khapra at IIT-Madras. A Trite Metaphor Imagine you’re standing on a mountain, there could be a lot of possible paths available to you to descend. Gradient Descent (GD) in a nutshell gives you a principled way of descending