Artificial Intelligence, Deep Learning, Machine Learning, Gradient Descent, Optimization.
history, the effective learning rate would be very small. In the case of sparse features, gradient history value would be very less leading to large effective learning rate. Consider that we have data with two features w (sparse feature) and b which means w undergoes fewer updates. Now we will