David M. Lane
The Problem of Too Many Statistical Tests: Subgroup Analyses in a Study Comparing the Effectiveness of Online and Live Lectures
Rice University|Creative Commons
statistical analyses performed analysis research data likely one conclusions errormultiple statistical analyses occur sample contains several subgroups researchers perform separate analyses subgroupfor example separate analyses may done different ethnic groups different levels education andor gendersmedia reports research frequently omit information number subgroup analyses performed thus leaving reader insufficient information assess validity conclusionsthis article discusses problems media report research analyzed conducting many subgroup analysesthe article concludes quantitatively literate reader skeptical articles report subgroup analyses without reporting number analyses done