Question Answer Additional Resources If we use the Tiered Fidelity Measure, Yes, the TFI can be used to assess MTSSB For more on Fidelity: will it cover the requirement to measure If your regardless of your specific “practice.” all Tier 1, Tier2, and Tier 3 or will we practice has another fidelity measure with still need fidelity measures for each multiple tiers that is fine to use in conjunction practice (e.g., Skillstreaming, Check with a fidelity measure that assesses the and Connect etc.)? framework. How would we measure fidelity of a Any evidence-based practice should have an specific program like RENEW? accompanying fidelity measure. If the practice/ program does not have a fidelity measure either contact the authors, or consider using the TFI Can you address the possible problems Self-reports have a long history of being For additional resources on Coaching: caused by relying on self-reports from inaccurate. However, when the self-report is schools, particularly concerning from consensus of a team (not summary of fidelity? individuals) and done with an external coach McIntosh et al., (2015) Technical present, the accuracy of the information has Adequacy of the PBIS Tiered Fidelity been demonstrated to be valid and reliable. Inventory. Submitted for publication What about trainings that are being For any training provided clearly identify the provided as part of the SCTG that are expected outcomes for your participants. not intended to be "practices" that will Those outcomes may be knowledge be implemented. Therefore, there would development but not necessarily not be any fidelity measure. For implementation, this is especially relevant for example, we are providing Trauma some targeted or individual interventions. In Informed Care in Schools 2 hour that situation where implementation is not overview but there is no expectation for expected are there other teacher responsibilities implementation. (e.g. identification of students, providing progress data, etc.)? Be sure to clarify how attendees will use that information. Consider
Question Answer Additional Resources If we use the Tiered Fidelity Measure, will it cover the requirement to measure all Tier 1, Tier2, and Tier 3 or will we still need fidelity measures for each practice (e.g., Skillstreaming, Check and Connect etc.)? Yes, the TFI can be used to assess MTSSB regardless of your specific “practice.” If your practice has another fidelity measure with multiple tiers that is fine to use in conjunction with a fidelity measure that assesses the framework. Any evidence-based practice should have an accompanying fidelity measure. If the practice/ program does not have a fidelity measure either contact the authors, or consider using the TFI For more on Fidelity: How would we measure fidelity of a specific program like RENEW? Can you address the possible problems caused by relying on self-reports from schools, particularly concerning fidelity? Self-reports have a long history of being inaccurate. However, when the self-report is from consensus of a team (not summary of individuals) and done with an external coach present, the accuracy of the information has been demonstrated to be valid and reliable. For additional resources on Coaching: McIntosh et al., (2015) Technical Adequacy of the PBIS Tiered Fidelity Inventory. Submitted for publication What about trainings that are being provided as part of the SCTG that are not intended to be "practices" that will be implemented. Therefore, there would not be any fidelity measure. For example, we are providing Trauma Informed Care in Schools 2 hour overview but there is no expectation for implementation. For any training provided clearly identify the expected outcomes for your participants. Those outcomes may be knowledge development but not necessarily implementation, this is especially relevant for some targeted or individual interventions. In that situation where implementation is not expected are there other teacher responsibilities (e.g. identification of students, providing progress data, etc.)? Be sure to clarify how attendees will use that information. Consider
FAQs_EvaluationWebinar_RH_JSB.docx