Problems such as these have motivated research on more abstract , dependencybased parser evaluation ( e.g. , Lin 1995 ; Carroll , Briscoe , and Sanfilippo 1998 ; Carroll et al. 2002 ; Clark and Hockenmaier 2002 ; King et al. 2003 ; Preiss 2003 ; Kaplan et al. 2004 ; Miyao and Tsujii 2004 ) .
the parc 700 dependency bank
Tracy Holloway King Richard Crouch Stefan Riezler Mary Dalrymple Ron Kaplan
Because a tree-based gold standard for parser evaluation must adopt a particular style of linguistic analysis ( reflected in the geometry and nomenclature of the nodes in the trees ) , evaluation of statistical parsers and grammars that are derived from particular treebank resources ( as well as hand-crafted grammars/parsers ) can suffer unduly if the gold standard deviates systematically from the ( possibly ) equally valid style of linguistic analysis provided by the parser . Problems such as these have motivated research on more abstract , dependencybased parser evaluation ( e.g. , Lin 1995 ; Carroll , Briscoe , and Sanfilippo 1998 ; Carroll et al. 2002 ; Clark and Hockenmaier 2002 ; King et al. 2003 ; Preiss 2003 ; Kaplan et al. 2004 ; Miyao and Tsujii 2004 ) . Dependency-based linguistic representations are approximations of abstract predicate-argument-adjunct ( or more basic head-dependent )
Problems such as these have motivated research on more abstract , dependencybased parser evaluation ( e.g. , Lin 1995 ; Carroll , Briscoe , and Sanfilippo 1998 ; Carroll et al. 2002 ; Clark and Hockenmaier 2002 ; @@CITATION ; Preiss 2003 ; Kaplan et al. 2004 ; Miyao and Tsujii 2004 ) .