Agreement between two annotation sets is calculated here in terms of Cohen 's kappa ( Cohen , 1960 ) 1 and corrected kappa ( Brennan and Prediger , 1981 ) 2 .
coefficient kappa some uses misuses and alternatives
Robert L Brennan Dale J Prediger
A measure was derived for each annotated feature using the agreement analysis facility provided in ANVIL . Agreement between two annotation sets is calculated here in terms of Cohen 's kappa ( Cohen , 1960 ) 1 and corrected kappa ( Brennan and Prediger , 1981 ) 2 . Anvil divides the annotations in slices and compares each slice .
Agreement between two annotation sets is calculated here in terms of Cohen 's kappa ( Cohen , 1960 ) 1 and corrected kappa ( @@CITATION ) 2 .