Isaac I. Bejar
Subject Matter Experts' Assessment of Item Statistics
Educational Testing Service
study conducted determine degree subject matter experts could predict difficulty discrimination items test standard written english two studies conducted first study meant serve training exercise second study meant simulate conditions ratings would obtained practice concluded despite extended training period raters approach high level accuracy able pinpoint factors contribute difficulty discrimination research attempt uncover factors examining items linguistic psycholinguistic perspective argued coupling linguistic features items subject matter ratings may possible attain accurate predictions difficulty discrimination