Hey @patrickvonplaten ,it seems like the result doesn’t match this paper’s result .

  
      arxiv.org
  
  
    
1907.12461.pdf 1

214.58 KB

  
  
    
    
  
  


for example ,the roberta2roberta model
the rouge2 fmeasure in the paper for cnn dataset is 18.5
but your result is 16.79.