Optimization, Learning Parameters, Gradient Descent, Stochastic Gradient, Deep Learning.
parameters and briefly look at what line search is. Read all about it in the next post of this series at: Learning Parameters, Part 4: Tips For Adjusting Learning Rate & Momentum, Line Search Acknowledgment A lot of credit goes to Prof. Mitesh M Khapra and the TAs of CS7015: Deep Learning course by