Thank you for your answer. Unfortunately, this solution doesn’t solve my problem. However, I noticed that, after fine-tuning phase,  the model seems to be quite stable (no improvment) for some high-frequency words, while it drastically worse for others.