Machine Learning, Loss Function, Optimisation, Lua, Deep Learning.
valley which directly affects the overall training time which gets too large. While a learning rate that is too large can hinder convergence and cause the loss function to fluctuate around the minimum or even to diverge. A similar hyperparameter is momentum, which determines the velocity with which