Fine-tuning bart-base on XSum and got 34.0 as ROUGE1 (40.61 with higher lr)
Hi, I'm wondering whether there are any benchmarks for fine-turning bart-base on XSum. I found this one [https://huggingface.co/VictorSanh/bart-base-finetuned-xsum/tree/main](url) which also shows the R1 is 35 -ish. Does it suppose to be this low?
Just an update, I increased lr and got ROUGE-F(1/2/l): 40.61/17.48/32.62<|||||>Maybe @patrickvonplaten or @patil-suraj have an idea<|||||>Hi @XinnuoXu 

That model was trained a while ago, and there were some bugs in BART related to `decoder_start_token_id` at that time, see https://discuss.huggingface.co/t/bart-lm-odd-beam-search-output/618/13
which could be the reason for this.<|||||>This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the [contributing guidelines](https://github.com/huggingface/transformers/blob/master/CONTRIBUTING.md) are likely to be ignored.