Machine Learning, Deep Learning, Neural Networks, Optimization, Towards Data Science.
This is part 2 of my series on optimization algorithms used for training neural networks and machine learning models. Part 1 was about Stochastic gradient descent. In this post I presume basic knowledge about neural networks and gradient descent algorithm. If you don’t know anything about neural