While corpus driven efforts along the PARSEVAL lines ( Black et al. , 1991 ) are good at giving some measure of a grammar coverage , they are not suitable for finer grained analysis and in particular , for progress evaluation , regression testing and comparative report generation .
a procedure for quantitatively comparing the syntactic coverage of english grammars
A Black S Abney D Flickinger C Gdaniec R Grishman P Harrison D Hindel R INgria F Jelinek F Klaavans M Liberman M Marcus S Roukos B Santorini T Strzalkowski
and its degree of overgeneration ( does it generate only the sentences of the described language ? ) While corpus driven efforts along the PARSEVAL lines ( Black et al. , 1991 ) are good at giving some measure of a grammar coverage , they are not suitable for finer grained analysis and in particular , for progress evaluation , regression testing and comparative report generation . Another known method consists in developing and using a test suite that is , a set of negative and positive items against which the grammar can be systematically tested .
While corpus driven efforts along the PARSEVAL lines ( @@CITATION ) are good at giving some measure of a grammar coverage , they are not suitable for finer grained analysis and in particular , for progress evaluation , regression testing and comparative report generation .