Yes No ☐ ☐ If multiple settings, were they appropriate for study design? Yes No ☐ ☐ ☐ NA Probability Purposeful or Study Methods: Sample (Describe sampling strategy, Was sample size sufficient based on sampling (i.e. Theoretical study design and data analysis? inclusion/exclusion criteria, sample size, and characteristics of sample random) sampling Yes No ☐ ☐ [i.e. people, places, events]) Non-probability Sample size: based *Was sample representative of population (i.e. on judgment and study? convenience) experience often Yes No NA ☐ ☐ ☐ smaller than Sample size: *If an intervention was used were sample quantitative goal – based on characteristics equivalent between control to gain deeper statistical test and intervention groups? understanding of used and power concept analysis goal to – generalize results other populations Study Methods: Study Procedures (Describe *interventions, if tested, Data Collection Data Collection Was data collection method described Methods: Methods and clearly? Yes No data collection methods, measurement instruments or data collection ☐ ☐ techniques: Surveys (include Was data collection method a good fit tools [including interview guides], timing/sequencing of data collection, response rate) Interviews, focus with the study purpose and design? human subjects protection) groups, Measurement Yes No ☐ ☐ observations, instruments, *For surveys, was response rate documents, (audio tools, adequate (≥25% to 40%)? and videotaping, questionnaires) *Were measurement instruments validity field notes) If intervention and reliability discussed (psychometrically Collection and used, describe tested with adequate reliability Analysis often occur fidelity or how (Chronbach alpha ≥0.70)? simultaneously researcher made *If intervention used, was it described sure the clearly? Yes No NA intervention was ☐ ☐ ☐ consistently used #Was discussed (credibility, with all subjects. transferability, dependability, confirmability) (see Appendix C Table 3) Yes No ☐ ☐ Study Methods: Data Analysis (Describe methods used to analyze data) See Appendix C See Appendix B Were the analysis methods appropriate? Yes No ☐ ☐
☐ Yes ☐ No If multiple settings, were they appropriate for study design? ☐ Yes ☐ No ☐ NA Probability sampling (i.e. random) Non-probability (i.e. convenience) Sample size: based on statistical test used and power analysis – goal to generalize results other populations Purposeful or Theoretical sampling Sample size: based on judgment and experience often smaller than quantitative – goal to gain deeper understanding of concept Study Methods: Sample (Describe sampling strategy, inclusion/exclusion criteria, sample size, and characteristics of sample [i.e. people, places, events]) Was sample size sufficient based on study design and data analysis? ☐ Yes ☐ No *Was sample representative of population study? ☐ Yes ☐ No ☐ NA *If an intervention was used were sample characteristics equivalent between control and intervention groups? Data Collection Methods: Surveys (include response rate) Measurement instruments, tools, questionnaires) If intervention used, describe fidelity or how researcher made sure the intervention was consistently used with all subjects. Data Collection Methods and techniques: Interviews, focus groups, observations, documents, (audio and videotaping, field notes) Collection and Analysis often occur simultaneously Study Methods: Study Procedures (Describe *interventions, if tested, data collection methods, measurement instruments or data collection tools [including interview guides], timing/sequencing of data collection, human subjects protection) Was data collection method described clearly? ☐ Yes ☐ No Was data collection method a good fit with the study purpose and design? ☐ Yes ☐ No *For surveys, was response rate adequate (≥25% to 40%)? *Were measurement instruments validity and reliability discussed (psychometrically tested with adequate reliability (Chronbach alpha ≥0.70)? *If intervention used, was it described clearly? ☐ Yes ☐ No ☐ NA #Was discussed (credibility, transferability, dependability, confirmability) (see Appendix C Table 3) ☐ Yes ☐ No See Appendix C See Appendix B Study Methods: Data Analysis (Describe methods used to analyze data) Were the analysis methods appropriate? ☐ Yes ☐ No
research_appraisal_tool_1-11-17.docx