Optimization, Mathematics.
E_1\left(\frac{2s}{n}\right)$$ Here $E_1$ is the exponential integral. This approximation is valid when the number of steps $s$ grows slower than dimensionality squared $n²$, confirmed by George Nemes here. We can plot integral approximation of loss against exact loss after s steps and see that