Hey , do you know why your result is worse than
patrickvonplaten/roberta2roberta-cnn_dailymail-fp16 ?
I also want to reproduce the result. And I got similar rouge-2 score such as 9.6 or 9.7.
But in the original paper , the rouge-2 score is  18.9.
It is weird.
Do we need to increase the batch size or  train more steps ?