Optimizer, Gradient Descent, Machine Learning, Adam, Sgd.
multiplication with very small values over and over. This is called Vanishing Gradient Problem. 3. The behavior of different types of gradient descent techniques. In my previous article, we talked about three types of gradient descent techniques. Batch Gradient Descent: Here the full batch is fed