Artificial Intelligence, Deep Learning, Machine Learning, Gradient Descent, Optimization.
discuss the different variants of gradient descent optimization algorithm. Citation Note: The content and the structure of this article is based on the deep learning lectures from One-Fourth Labs — Padhai. Rest of the article is structured as follows, Gradient Descent Momentum Gradient Descent