Sheila M. Bird|Cox Sir David|Vernon T. Farewell|Geriant Harvey|Tim Holt|S C
Performance Indicators: Good, Bad, and Ugly
Medical Research Council|University of Strathclyde|Medical Research Council|University of London|Universidad de Londres|University of Southampton|University of York
summary striking feature uk public services 1990s rise performance monitoring pm records analyses publishes data order give public better idea government policies change public services improve effectiveness pm done well broadly productive concerned done badly costly merely ineffective harmful indeed destructive performance indicators pis public services typically designed assess impact government policies services identify well performing underperforming institutions public servants pis third role public accountability ministers stewardship public services deserves equal recognition hence government monitoring public services monitored pis especially governments dual role pm must done integrity shielded undue political influence way national statistics shielded everyones interest ministers parliament professions practitioners wider public confidence pm process find conclusions convincing introducing pm public service pm protocol written orderly record decisions made also reasoning calculations led decisions pm protocol cover objectives design considerations definition pis sampling versus complete enumeration information collected context likely perverse behaviours sideeffects might induced reaction monitoring process also practicalities implementation procedures data collection analysis presentation uncertainty adjustment context together dissemination rules explicitly defined reflect good statistical practice usually tentative nature pis seen screening devices overinterpreted quantitative performance targets set need sound basis take account prior emerging knowledge key sources variation integral pm design aspirational targets distinctive role one largely irrelevant design pm procedure motivational targets rationally based may demoralize distort anticipated actual sideeffects pm including individuals behaviour priorities may need monitored intrinsic part pm process independent scrutiny pm schemes public services set must report publicly extent nature scrutiny related assessed drawbacks benefits reflect ethical concerns conform good statistical practice research needed merits different strategies identifying institutions individuals public release pm data new pm schemes evaluated efficient designs evaluating series new policies monitored pis royal statistical society considers attempts educate wider public well policy makers issues surrounding use pis important high priority given sponsoring wellinformed public debate disseminating good practices implementing across government