Appendix C: Study Quality Assessment Rating Guide Quality Measure Quality Scoring Quality Pts. Design: Longitudinal = 1 Study Characteristics Description Author Pub Year Study Design Quasi-natural = difference in two populations not Observational manipulated by researcher Experimental Quasi/Natural Experiment Model Estimate Other Did/would policy affect: Exclude studies that do not address one or more (Positive, Negative, No outcomes; exclude studies evaluating process rather than Effect, Mixed, N/A) outcome Rate studies with both positive/no effect findings as positive Purchase Uses data from stores Consumption Uses observed/reported consumption BMI/Obesity Longitudinal? Repeated measures (pre/post with no control) = 0.5 Other = 0 Design: Appropriately matched control group (comparison Control group? group other than change over time) = 1 No/poorly matched group = 0 Population: Study describes population characteristics using Description objective or well-validated self-report measures (e.g., definition of diabetes or pre-diabetes) = 1 Population: Study describes representativeness of sample to Representativeness geographic or membership (e.g., of a health plan) population (incomplete studies using secondary data from well-documented representative surveys, e.g. NHANES) = 1 Population: deals with selection by reporting response Response rate rate and describing responders vs. non-responders
Study Characteristics Description Author Pub Year Study Design Observational Experimental Quasi/Natural Experiment Model Estimate Other Quasi-natural = difference in two populations not manipulated by researcher Did/would policy affect: (Positive, Negative, No Effect, Mixed, N/A) Exclude studies that do not address one or more outcomes; exclude studies evaluating process rather than outcome Rate studies with both positive/no effect findings as positive Purchase Uses data from stores Consumption Uses observed/reported consumption BMI/Obesity Appendix C: Study Quality Assessment Rating Guide Quality Measure Quality Scoring Quality Pts. Design: Longitudinal? Longitudinal = 1 Repeated measures (pre/post with no control) = 0.5 Other = 0 Design: Control group? Appropriately matched control group (comparison group other than change over time) = 1 No/poorly matched group = 0 Population: Description Study describes population characteristics using objective or well-validated self-report measures (e.g., definition of diabetes or pre-diabetes) = 1 Population: Representativeness Study describes representativeness of sample to geographic or membership (e.g., of a health plan) population (incomplete studies using secondary data from well-documented representative surveys, e.g. NHANES) = 1 Population: Response rate deals with selection by reporting response rate and describing responders vs. non-responders