The learning_rate parameter is just the initial learning rate, but it is usually changed during training.
You can find the default values of TrainingArguments at Trainer. You can see that lr_scheduler_type is linear by default.
As specified in its [documentation(Optimization), linear creates a schedule with a learning rate that decreases linearly from the initial learning rate after an initial warmup period.