Deep Learning, Regularisation, Optimization Algorithms, Deep Neural Networks, Gradient Descent.
iteration. It takes too much time per iteration. If the mini-batch size = 1: It is called stochastic gradient descent, where each training example is its own mini-batch. Since in every iteration we are taking just a single example, it can become extremely noisy and takes much more time to reach the