there isn’t a way we provide to reset these parameters to initial state. Your best bet is to reinitialize them.
One thing to do is to have the Trainer take the constructor parameters needed to create the optimizer / scheduler and the trainer creates these objects itself. That way, if the trainer wants to re-initialize these objects, it has the necessary initial state to do so.