Optimizer, Gradient Descent, Machine Learning, Adam, Sgd.
entering a suboptimal state. AdaGrad Optimizer Adaptive Gradient optimizer uses a technique of modifying the learning rate during training. It starts with a high learning rate and the rate decreases as it converges. It is seen that this method helps to converge better and as when we approach the