That’s wild.  I’ve never seen behavior like that before.  It doesn’t just decrease to a stable value, it goes way down, then bounces back up…The growth_interval manipulation may be the best approach, so it aggressively tries many new values in the beginning.
Does the full run converge to roughly the same accuracy as FP32?