Machine Learning, Software Development, Artificial Intelligence, Technology, Data Science.
it with ~11k followers. Provably Faster Gradient Descent via Long Steps Well this explains a lot. Or at least…it might. A classic optimization result is the convergence rate of gradient descent with constant step sizes over iterations T on an L-smooth convex function f: They generalize this result