@sgugger The information that the trainer gives me before training are these:
INFO - transformers.trainer -   ***** Running training *****
INFO - transformers.trainer -     Num examples = 13121
INFO - transformers.trainer -     Num Epochs = 4
INFO - transformers.trainer -     Instantaneous batch size per device = 8
INFO - transformers.trainer -     Total train batch size (w. parallel, distributed & accumulation) = 16
INFO - transformers.trainer -     Gradient Accumulation steps = 1
INFO - transformers.trainer -     Total optimization steps = 3284
Epoch:   0% 0/4 [00:00<?, ?it/s]
Iteration:   0% 0/821 [00:00<?, ?it/s]
Iteration:   0% 1/821 [00:00<08:07,  1.68it/s]

After training I find myself among the results the various checkpoints that advance from 750 to 750: