Tracking measures The tracking measure is sufficient/appropriate proof that the activity was completed. Responsible parties Lists the parties responsible for completing the activity and whether those individuals are budgeted or non-budgeted. Listed parties match personnel and responsibilities listed in budget justification. Evaluator should not be the only one listed on all evaluation activities; a staff person coordinates and works on evaluation, too. Reporting Describes the overall reporting plan for the objective as a whole, how and with whom results will be shared (for example with decision makers, with various segments of the community). Reporting back to stakeholders should happen throughout the contract period, not just at the end with the evaluation report. Results should be utilized and communicated in fact sheets, press releases, ads, social media posts, community presentations or incorporated into journal articles. Within tobacco control, findings can be shared with colleagues at coalition meetings, announced on Prop. 99 calls or InfoHub. Clearly states how reports (or findings) will be used/disseminated. States the evaluation design: i.e. non-experimental or quasi-experimental if it include a control group and/or at least 3 waves, not just pre-/post measurement . Limitations/Challenges: lists any anticipated limitations/challenges (e.g. low response rates, late policy adoption or implementation, non-representative results, political or economic factors, etc.) and suggests ways to prevent/overcome these challenges. NEW: A Final Evaluation Report (FER) is required for each primary objective; those covering more than one jurisdiction also need at least one interim (brief) evaluation report (p. 35). A Brief Evaluation Report (BER) is required for each non-primary objective. Reports should follow the 2017 Tell Your Story guidelines. Plan Type and Process vs. Outcome Measures The objective wording, plan type, and use of outcome and/or process evaluation activities must match. Objectives types that are Policy implementation, Policy adoption & implementation, Individual behavior change, or Other with measurable outcome require outcome evaluation activities. See figure Process evaluation measures are useful in just about every objective – for collecting data to shape/inform activities, build momentum or understand what worked well. Outcome evaluation is used to confirm or measure the extent of change brought about as a result of the intervention. For tobacco control, that means number of tobacco licenses purchased, number of citations issued, presence of ‘no smoking’ signage, tobacco litter counts, observed smoking incidences or complaints, etc. Counting the number of policies
Tracking measures The tracking measure is sufficient/appropriate proof that the activity was completed. Responsible parties Lists the parties responsible for completing the activity and whether those individuals are budgeted or non-budgeted. Listed parties match personnel and responsibilities listed in budget justification. Evaluator should not be the only one listed on all evaluation activities; a staff person coordinates and works on evaluation, too. Reporting Describes the overall reporting plan for the objective as a whole, how and with whom results will be shared (for example with decision makers, with various segments of the community). Reporting back to stakeholders should happen throughout the contract period, not just at the end with the evaluation report. Results should be utilized and communicated in fact sheets, press releases, ads, social media posts, community presentations or incorporated into journal articles. Within tobacco control, findings can be shared with colleagues at coalition meetings, announced on Prop. 99 calls or InfoHub. Clearly states how reports (or findings) will be used/disseminated. States the evaluation design: i.e. non-experimental or quasi-experimental if it include a control group and/or at least 3 waves, not just pre-/post measurement . Limitations/Challenges: lists any anticipated limitations/challenges (e.g. low response rates, late policy adoption or implementation, non-representative results, political or economic factors, etc.) and suggests ways to prevent/overcome these challenges. NEW: A Final Evaluation Report (FER) is required for each primary objective; those covering more than one jurisdiction also need at least one interim (brief) evaluation report (p. 35). A Brief Evaluation Report (BER) is required for each non-primary objective. Reports should follow the 2017 Tell Your Story guidelines. Plan Type and Process vs. Outcome Measures The objective wording, plan type, and use of outcome and/or process evaluation activities must match. Objectives types that are Policy implementation, Policy adoption & implementation, Individual behavior change, or Other with measurable outcome require outcome evaluation activities. See figure Process evaluation measures are useful in just about every objective – for collecting data to shape/inform activities, build momentum or understand what worked well. Outcome evaluation is used to confirm or measure the extent of change brought about as a result of the intervention. For tobacco control, that means number of tobacco licenses purchased, number of citations issued, presence of ‘no smoking’ signage, tobacco litter counts, observed smoking incidences or complaints, etc. Counting the number of policies