Advanced Optimization, Conjugrate, Bfgs.
good learning rate alpha so that it can even pick a different learning rate for every iteration. And so then you don’t need to choose it yourself. These algorithms actually do more sophisticated things than just pick a good learning rate, and so they often end up converging much faster than