Thanks for the pointer - that seems to do pretty much the same fix as I did. Should this be added to the datasets.metrics ROUGE implementation? It would be nice if one could use it to reproduce the results.