Machine Learning, Loss Function, Optimisation, Lua, Deep Learning.
learning rate has to be increased as we approach the minima. Adaptive Learning Algorithms: The challenge of using gradient descent is that their hyper parameters have to be defined in advance and they depend heavily on the type of model and problem. Another problem is that the same learning rate is