EXHIBIT F: Implementation Analysis Plan Template (Tier 2B Grantees Only) Example data and methods that may be used to assess implementation elements Implementation element Types of data used to assess Methods used to operationalize whether the element of the and describe each intervention was implemented implementation element as intended (variable or data to be reported is shown in italics) Adherence How much of the program Length (number of minutes) Average session duration, (and each of its components) of program sessions that were calculated as the average of the was offered—for example, the captured in the data system observed session lengths number of sessions delivered, (measured in minutes) average frequency, and Number of text messages sent number of visits held that were recorded from the Average number of text messenger service messages sent across all individuals in the treatment What content was delivered to Number of topics covered, as Total number of topics covered, the youths—for example, the measured through a fidelity calculated as the average of the total number of topics covered tracking log or protocol total number of topics checked and the proportion of material by each health educator in the that was received List of sessions recorded in daily fidelity tracking log or attendance logs protocol Who delivered the material to List of staff members hired Percentage of staff trained, calculated as the number of staff the youths—for example, the number and type of staff Training logs who were trained divided by the delivering the program to total number of staff who participants, their position Records on facilitators for delivered the program requirements or qualifications, each session and the percentage of staff trained and receiving ongoing support Dosage How much programming was attendance records Percentage of students attending received—for example, the the required or recommended average number (percentage) Views on a website, captured proportion of lessons of sessions attended, the in web analytics percentage of the sample that Average time spent on the web Number of text message did not attend at all, and the application, calculated as the confirmations received total average time spent on the average length of time a youth application actively clicks on the content (measured in minutes) Percentage of text messages received, calculated as the number of text message confirmations received divided
EXHIBIT F: Implementation Analysis Plan Template (Tier 2B Grantees Only) Example data and methods that may be used to assess implementation elements Implementation element Types of data used to assess whether the element of the intervention was implemented as intended Methods used to operationalize and describe each implementation element (variable or data to be reported is shown in italics) Adherence How much of the program (and each of its components) was offered—for example, the number of sessions delivered, average frequency, and number of visits held Length (number of minutes) of program sessions that were captured in the data system Number of text messages sent that were recorded from the messenger service Average session duration, calculated as the average of the observed session lengths (measured in minutes) Average number of text messages sent across all individuals in the treatment What content was delivered to the youths—for example, the total number of topics covered and the proportion of material that was received Number of topics covered, as measured through a fidelity tracking log or protocol List of sessions recorded in attendance logs Total number of topics covered, calculated as the average of the total number of topics checked by each health educator in the daily fidelity tracking log or protocol Who delivered the material to the youths—for example, the number and type of staff delivering the program to participants, their position requirements or qualifications, and the percentage of staff trained and receiving ongoing support List of staff members hired Training logs Records on facilitators for each session Percentage of staff trained, calculated as the number of staff who were trained divided by the total number of staff who delivered the program Dosage How much programming was received—for example, the average number (percentage) of sessions attended, the percentage of the sample that did not attend at all, and the total average time spent on the application attendance records Views on a website, captured in web analytics Number of text message confirmations received Percentage of students attending the required or recommended proportion of lessons Average time spent on the web application, calculated as the average length of time a youth actively clicks on the content (measured in minutes) Percentage of text messages received, calculated as the number of text message confirmations received divided
2017-tpp-annual-progress-report-guidance-508.docx