Replicating RoBERTa-base GLUE results
Hello! I had originally posted this on the [forums](https://discuss.huggingface.co/t/replicating-roberta-base-glue-results/19328) but it seems like there's not much foot traffic there, so hoping to get more visibility here.

I'm trying to replicate RoBERTa-base GLUE results as reported in the [model card](https://huggingface.co/roberta-base#evaluation-results). The numbers in the model card look like they were copied from the paper. Has anyone made an attempt to actually match these numbers with `run_glue.py`? If so, what configuration was used for the trainer? 

If I follow the original configs from [fairseq](https://github.com/facebookresearch/fairseq/tree/fcca32258c8e8bcc9f9890bf4714fa2f96b6b3e1/examples/roberta/config/finetuning), I am unable to match the reported numbers for RTE, CoLA, STS-B, and MRPC.

Any pointers would be much appreciated, thanks!
Another option would be to open a discussion in the community tab in https://huggingface.co/roberta-base/discussions and tag the model authors there<|||||>Thanks for the suggestion, that's a neat feature! I opened a discussion [here](https://huggingface.co/roberta-base/discussions/1) (although, it's not quite clear how to discover the model authors by handle).<|||||>This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the [contributing guidelines](https://github.com/huggingface/transformers/blob/main/CONTRIBUTING.md) are likely to be ignored.