Artificial Intelligence, Deep Learning, Machine Learning, Gradient Descent, Optimization.
computing gradients in batches is called the Mini-Batch Gradient Descent. If we have one million data points with a batch size of 10, we will have 100,000 batches and we would have made 100,000 updates to the parameters. If we take the idea of mini batch Gradient descent to the extreme and look one