Machine Learning, Deep Learning, Neural Networks, Optimization, Towards Data Science.
networks or how to train them, feel free to read my first post before reading this one. In this post I’ll talk about simple addition to classic SGD algorithm, called momentum which almost always works better and faster than Stochastic Gradient Descent. Momentum [1] or SGD with momentum is method