I’d say resuming the optimizer states is always recommended on a personal view.
I can’t tell whether loading the states of optimizer would improve the performance or not.
But it definitely helps on better reproducibility and more rigorous experiments.