Deep Learning, Regularisation, Optimization Algorithms, Deep Neural Networks, Gradient Descent.
the number of mini batches we saw in our above example. Let’s dive deeper and understand mini-batch gradient descent in detail. Understanding Mini-Batch Gradient Descent In batch gradient descent, our cost function should decrease on every single iteration: In the case of mini-batch gradient