Artificial Intelligence, Deep Learning, Machine Learning, Gradient Descent, Optimization.
oscillations are smaller and the chances of escaping the minima valley are also smaller. Mini-Batch and Stochastic Gradient Descent Should we use entire data for computing the gradients? Consider that you have a huge dataset with million data points if we use the batch gradient, the algorithm will