Optimizer, Gradient Descent, Machine Learning, Adam, Sgd.
smaller mini-batches and train using those. So, if there are 100 data in the training set and we take 25 as our sampling size, we obtain 4 mini-batches. The error is calculated as: where k is the number of samples in a batch. So, in each epoch, the error is calculated for 4 batches and updated 4