Artificial Intelligence, Deep Learning, Machine Learning, Gradient Descent, Optimization.
Nesterov Accelerated Gradient Descent Mini-Batch & Stochastic Gradient Descent Adaptive Gradient Descent — AdaGrad Root Mean Square Propagation Gradient Descent — RMSProp Adaptive Moment Estimation — Adam Gradient Descent Gradient Descent is one of the most commonly used optimization techniques to