We use two measures from Information Retrieval to determine the quality of an automatically generated response : precision and F-score ( van Rijsbergen 1979 ; Salton and McGill 1983 ) .
an introduction to modern information retrieval
G Salton M J McGill
Although this method of assessment is less informative than human-based evaluations , it enables us to evaluate the performance of our system with substantial amounts of data , and produce representative results for a large corpus such as ours . We use two measures from Information Retrieval to determine the quality of an automatically generated response : precision and F-score ( van Rijsbergen 1979 ; Salton and McGill 1983 ) . Precision measures how much of the information in an automatically generated response is correct ( i.e. , appears in the model response ) , and F-score measures the overall similarity between the automatically generated response and the model response .
We use two measures from Information Retrieval to determine the quality of an automatically generated response : precision and F-score ( van Rijsbergen 1979 ; @@CITATION ) .