Machine Learning, Loss Function, Optimisation, Lua, Deep Learning.
are used to update weights and biases i.e. the internal parameters of a model to reduce the error. They can be divided into two categories: Constant Learning Rate Algorithms: Most widely used Optimisation Algorithm, the Stochastic Gradient Descent falls under this category. Here η is called as