Deep Learning, Optimization, Gradient Descent, Momentum, Learning Parameters.
we will digress a little bit and talk about stochastic versions of these algorithms. Read all about it in the next post of this series at: Learning Parameters, Part 3: Stochastic & Mini-Batch Gradient Descent Acknowledgment A lot of credit goes to Prof. Mitesh M Khapra and the TAs of CS7015: Deep