Machine Learning, Deep Learning, Algorithms, Loss Function, Optimization.
of doing gradient descent: Batch gradient descent: Uses all of the training instances to update the model parameters in each iteration. Mini-batch Gradient Descent: Instead of using all examples, Mini-batch Gradient Descent divides the training set into smaller size called batch denoted by ‘b’.