A very neat result!! Opens a new frontier to push Gradient Descent's theory!

Wild that we might have different optimal exponents for the obj gap convergence rates 1/T^p of
Short Stepsize GD: p=1
Anytime GD: p>=1.03
Final Iterate GD: p=1.27 (conjectured)
General Grad Methods: p=2