13 We also employed sequence-based measures using the ROUGE tool set ( Lin and Hovy 2003 ) , with similar results to those obtained with the word-by-word measures .
automatic evaluation of summaries using ngram cooccurrence statistics
C Y Lin E H Hovy
Table 5 presents the coverage and unique/best coverage of each method ( the percentage of queries covered only by this method or for which this method produces a better reply than other methods ) , and the average and standard deviation of the precision and F-score obtained by each method ( calculated over the requests that are covered ) . 13 We also employed sequence-based measures using the ROUGE tool set ( Lin and Hovy 2003 ) , with similar results to those obtained with the word-by-word measures . Performance of the different methods for each data set : ( a ) coverage , ( b ) F-score , and ( c ) precision .
13 We also employed sequence-based measures using the ROUGE tool set ( @@CITATION ) , with similar results to those obtained with the word-by-word measures .