Deep Learning, Optimization, Gradient Descent, Momentum, Learning Parameters.
content and figures in this blog are directly taken from Lecture 5 of CS7015: Deep Learning course offered by Prof. Mitesh Khapra at IIT-Madras. Momentum-Based Gradient Descent The intuition behind MBGD from the mountaineer’s perspective (yes the same trite metaphor we used in part-1) is If I am