Hello @julia, welcome to the forum! I think you have created two topics for the same purpose, I will answer here.
If I understand correctly, you are trying to save a checkpoint every time you do an evaluation. This can be done, using the finetune_trainer.py script, changing the parameter save_steps to be the same as eval_steps.
For example if you want to evaluate and save a checkpoint every 1k steps, you call

python finetune_trainer.py --evaluation_strategy steps --eval_steps 1000 --save_steps 1000

Hope this help