Machine Learning, Loss Function, Optimisation, Lua, Deep Learning.
provide heuristic approach without requiring expensive work in tuning hyperparameters for the learning rate schedule manually. Working with Optimisation Functions: We used three first order optimisation functions and studied their effect. Stochastic Gradient Decent Adagrad Adam Gradient Descent