BERT outperformed XLNet
Hi,

I am doing a tweet sentiment classification (binary) project and I want to compare the F1 scores of XLNet and BERT. I expected XLNet to outperform BERT , however, BERT outperformed XLNet other permutation language models.I know it shouldn't be necessarily the case but I can't explain the reason. I used Huggingface transformers and pretrained model. Where should I look to understand the result?

dataset link : http://help.sentiment140.com/for-students

the reason why I think XLNet would outperform BERT : https://towardsdatascience.com/what-is-xlnet-and-why-it-outperforms-bert-8d8fce710335
This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the [contributing guidelines](https://github.com/huggingface/transformers/blob/master/CONTRIBUTING.md) are likely to be ignored.