you could use save_stpes arg to specify the number of update steps after which to save the checkpoint. If you use
--evaluation_strategy steps
--eval_steps 50
--save_steps 50

then it will eval and save checkpoint after every 50 steps