Deep Learning, Regularisation, Optimization Algorithms, Deep Neural Networks, Gradient Descent.
global minima. If the mini-batch size is between 1 to m: It is mini-batch gradient descent. The size of the mini-batch should not be too large or too small. Below are a few general guidelines to keep in mind while deciding the mini-batch size: If the training set is small, we can choose a