Machine Learning, Neural Networks, Gradient Descent, Optimization, Data Science.
examples in training dataset Since we are considering just one example at a time the cost will fluctuate over the training examples and it will not necessarily decrease. But in the long run, you will see the cost decreasing with fluctuations. Cost vs Epochs in SGD (Source: