Optimization, Learning Parameters, Gradient Descent, Stochastic Gradient, Deep Learning.
it sees a mini_batch_size number of data points. The stochastic estimates should now be slightly better. Mini-Batch In Action Let’s see this algorithm in action when we have k/mini_batch_size = 2. Even with a batch size of k=2, the oscillations have reduced slightly. Why? Because we now have