  resume training easily with trainer.train(resume_from_checkpoint="output_dir/last-checkpoint").
"all_checkpoints": all checkpoints are pushed like they appear in the output folder (so you will get one
  checkpoint folder per folder in your final repository)
Logging
By default [Trainer] will use logging.INFO for the main process and logging.WARNING for the replicas if any.
These defaults can be overridden to use any of the 5 logging levels with [TrainingArguments]'s
arguments:
log_level - for the main process
log_level_replica - for the replicas
Further, if [TrainingArguments]'s log_on_each_node is set to False only the main node will
use the log level settings for its main process, all other nodes will use the log level settings for replicas.
Note that [Trainer] is going to set transformers's log level separately for each node in its
