Machine Learning, Loss Function, Optimisation, Lua, Deep Learning.
outperforms other techniques. Stochastic Gradient Decent was much faster than the other algorithms but the results produced were far from optimum. Both, Adagrad and Adam produced better results that SGD, but they were computationally extensive. Adam was slightly faster than Adagrad. Thus, while