Machine Learning, Loss Function, Optimisation, Lua, Deep Learning.
Function. Optimisation functions usually calculate the gradient i.e. the partial derivative of loss function with respect to weights, and the weights are modified in the opposite direction of the calculated gradient. This cycle is repeated until we reach the minima of loss function. Thus, the