We report performance in terms of two metrics : ( 1 ) the Fmeasure score as computed by the commonly-used MUC scorer ( Vilain et al. , 1995 ) , and ( 2 ) the accuracy on the anaphoric references , computed as the fraction of anaphoric references correctly resolved .
a modeltheoretic coreference scoring scheme
M Vilain J Burger J Aberdeen D Connolly L Hirschman
As in SC induction , we use the ACE Phase 2 coreference corpus for evaluation purposes , acquiring the coreference classifiers on the 422 training texts and evaluating their output on the 97 test texts . We report performance in terms of two metrics : ( 1 ) the Fmeasure score as computed by the commonly-used MUC scorer ( Vilain et al. , 1995 ) , and ( 2 ) the accuracy on the anaphoric references , computed as the fraction of anaphoric references correctly resolved . Following Ponzetto and Strube ( 2006 ) , we consider an anaphoric reference , NPi , correctly resolved if NPi and its closest antecedent are in the same coreference chain in the resulting partition .
We report performance in terms of two metrics : ( 1 ) the Fmeasure score as computed by the commonly-used MUC scorer ( @@CITATION ) , and ( 2 ) the accuracy on the anaphoric references , computed as the fraction of anaphoric references correctly resolved .