Linear Regression, Machine Learning, Introduction, Gradient Descent.
subsets (mini-batches) is another hyperparameter we have to optimize. In mini-batch gradient descent, the error is not necessarily decreasing after each iteration, because we don’t look at the entire dataset. A detailed explanation of gradient descent, its variants, and its pros and cons can be I.