I think the total steps are “1963915” if i’m not wrong. I attached a picture relating to it. Please take a look.

bert-steps769×437 32.6 KB

Note: this is the picture for when I do not specify the “evaluation strategy”. If I specify that, then the validation loss will also appear. (But again, not the accuracy).
It is also worth mentioning that the model is really being trained. This is because when I use the fill_mask function and load my model, the masked tokens are predicted in a great way! It’s just I want to report the “accuracy”.