Machine Learning, Data Science, Deep Learning, Artificial Intelligence, Data.
Ratio(arXiv) Author : Jun Lu Abstract : It is well known that we need to choose the hyper-parameters in Momentum, AdaGrad, AdaDelta, and other alternative stochastic optimizers. While in many cases, the hyper-parameters are tuned tediously based on experience becoming more of an art than science.