Machine Learning, Deep Learning, Neural Networks, Optimization, Towards Data Science.
Network Society, 12(1):145–151, 1999 [2] Distill, Why Momentum really works [3] deeplearning.ai [4] Ruder (2016). An overview of gradient descent optimization algorithms. arXiv preprint arXiv:1609.04747 [5] Ruder (2017) Optimization for Deep Learning Highlights in 2017. [6] Stanford CS231n lecture