I didn’t write the part with do_train/do_eval and those arguments are not used by Trainer, only the scripts that use Trainer (not at the scripts yet). Maybe we can add something in the postinit of the TrainingArguments that if do_eval is not set it defaults to evaluation_strategy != "no"?


Yep, definitely possible.


logs are handled badly right now IMO cleanup is scheduled for later (see 4)


Progress bars are a mess in the Trainer right now, I usually run it with disable_tqdm=True for now, this is something I intend to clean after a PR I’m preparing with state + callbacks (since then progress bars can be handled nicely in a callback).


log_history needs to be saved at each checkpoint to because it will be reloaded from there if you resume training. (They are not all duplicates each contain the history up until that point.)


Rounding should be done by the user IMO. I have no idea why total_flos are in the logs, you should ask @teven