Machine Learning, Gradient Descent, Optimization, Deep Learning, Artificial Intelligence.
alleviate this problem, several variations of gradient descent methods have been proposed. Based on the amount of data used per iterations, Gradient Descent is divided into 1. Full Batch Gradient Descent 2. Mini Batch Gradient Descent and 3. Stochastic Gradient Descent Variations of Gradient