Artificial Intelligence, Deep Learning, Machine Learning, Gradient Descent, Optimization.
is very gentle then we need to run many many epochs just to come out that flat surface and enter into the slightly steep region from there you will start seeing some improvements in loss function. In order to avoid this kind of scenarios, we need to improve our update rule. Contour Maps Before we