Artificial Intelligence, Deep Learning, Machine Learning, Gradient Descent, Optimization.
instead of using the same learning rate across all the features in the dataset, we might need different learning rate for different features. Why do we need Adaptive Learning rate? Consider a dataset that has a very important but sparse variable, if that variable is zero in most of the training