Deep Learning, Regularisation, Optimization Algorithms, Deep Neural Networks, Gradient Descent.
Suppose we make a mini-batch containing 1000 examples each. This means we have 5000 batches and the training set will look like this: Here, X{t}, Y{t} represents the tth mini-batch input and output. Now, let’s look at how to implement a mini-batch gradient descent: for t = 1:No_of_batches # this is