I haven’t been able to do as many steps as the blue curve, but here’s the result:

image.png1240×378 30.5 KB

Seems a lot less jumpy than 2080 already when the loss gets small though more rough than the blue curve.
I think that tells there’s something wrong with 2080Ti?