Machine Learning, Loss Function, Optimisation, Lua, Deep Learning.
Gradient Decent algorithms can further be improved by tuning important parametes like momentum, learning rate etc. Adagrad is more preferrable for a sparse data set as it makes big updates for infrequent parameters and small updates for frequent parameters. It uses a different learning Rate for