We measure the inter annotator agreement using the Fleiss Kappa ( Fleiss et al. , 1981 ) measure ( x ) where the agreement lies around 0.79 .
the measurement of interrater agreement statistical methods for rates and proportions2212–236
Joseph L Fleiss Bruce Levin Myunghee Cho Paik
Out of this , 1500 verb sequences are unique to each of them and rest 500 are overlapping . We measure the inter annotator agreement using the Fleiss Kappa ( Fleiss et al. , 1981 ) measure ( x ) where the agreement lies around 0.79 . Next , out of the 500 common verb sequences that were annotated by all the three linguists , we randomly choose 300 V1 + V2 pairs and presented them to 36 native Bangla speakers .
We measure the inter annotator agreement using the Fleiss Kappa ( @@CITATION ) measure ( x ) where the agreement lies around 0.79 .