Machine Learning, Artificial Intelligence, Neural Networks, Data Science, Towards Data Science.
cyclical learning rates Whilst this is a nice idea, it tells us nothing about what learning rate scheme we should set and the magnitude of these learning rates. Estimating the Learning Rate How can we get a good learning rate estimate? This may seem complex but it is actually not too difficult.