Ian Jones|Matthew Inglis
The problem of assessing problem solving: can comparative judgement help?
Loughborough University|Loughborough University
school mathematics examination papers typically dominated short structured items fail assess sustained reasoning problem solving contributory factor situation need student work marked reliably large number markers varied experience competence report study tested alternative approach assessment called comparative judgement may represent superior method assessing openended questions encourage range unpredictable responses innovative problem solving examination paper specially designed examiners evaluated mathematics teachers administered 750 secondary school students varied mathematical achievement students work assessed mathematics education experts using comparative judgement well specially designed resourceintensive marking procedure report two main findings research first examination paper writers freed traditional constraint producing mark scheme designed questions less structured problembased typical current school mathematics examination papers second comparative judgement approach assessing student work proved successful measures interrater reliability validity findings open new avenues school mathematics indeed areas curriculum might assessed future