rwightman:

(usually all this is wrapped in a optim creation factory that also picks the optimizer to create from config or cmd args…


Nice. Thank you.
But I am just curious why even the official training code still ignores this fundamental error.