How to improve language model ex: BERT on unseen text in training? so I am using pre-trained language model for binary classification. I fine-tune the model by training on data my downstream task. The results are good almost 98% F-measure.
However, when I remove a specific similar sentence from the training data and add it to my test data, the classifier fails to predict the class of that sentence. For example, sentiment analysis task

"I love the movie more specifically the acting was great"

I removed from training all sentences containing the words " more specifically" and surprisingly in the test set they were all misclassified, so the precision decreased by a huge amount.
Any ideas on how can I further fine-tune/improve my model to work better on unseen text in training to avoid the problem I described above? (of course without feeding the model on sentences containing the words "more specifically")
Note: I observed the same performance regardless of the language model in use (BERT, RoBERTa etc).

Interesting. There are reasons why this sentence is hard to process, so some training examples may be needed.
Grammatically, it is two sentences not one - both "loved" and "was" are root words, not dependent on any other. There is no punctuation to indicate this. If your model was pretrained on well formed sentences, then it is not surprising that it is struggling.
Secondly, the use of the word "specifically" is an unusual one. It indicates that the following sentence is more specific than the preceding one, but neither are stated as a complement. i.e. it has a similar meaning to, but is stated differently to, "I love the movie, and to be specific I love the acting."
This use of specific is similar to the German use of "Hoffentlich" / the US English "Hopefully", where the listener is suppose to understand that the hopeful person is the (unnamed) speaker. This is not standard usage in British English.
One approach would be to train with similar sentence using adverbs other than "specifically", e.g.

*

*I love this movie more generally I love everything with Tom Cruise in it.

*I did not like this move more precisely I hated the ending

*I hate that book more emphatically I loathe it

