Optimization, Mathematics.
$s$ as the “dual epoch” — normalize steps by the number of parameters rather than by number of examples. As you see in worst case analysis (post), reaching dual epoch=1 is the first point in time when worst case analysis becomes sensitive to the smallest eigenvalue. And these expansions show that