Artificial Intelligence, Deep Learning, Machine Learning, Gradient Descent, Optimization.
predictions. To aid such sparse features we want to make sure that whenever that feature value is not zero whatever is the derivate at that point it should get boosted by a larger learning rate. AdaGrad Intuition If a particular parameter is getting updated frequently that means the derivative is