can use attribution analysis, which aims to determine the proportion of observe change that can be attributed to the activity being evaluated. However, as the evaluation also wished to assess how far the desired outcome of BOS Training, improved school-based management of BOS, was achieved, the evaluation team conducted observation visits to selected schools. These visits aimed to observe processes in these schools, and collect perceptions of training in a different setting (1-3 months and then 4-8 months after the training, to see how trainees applied the knowledge acquired during the training and the challenges they faced). Changes at this level may well be associated with training, but cannot be attributed to the training, as many other factors may be contributing. The Scope, Population, Sampling, and Instruments In light of the aims of the BOS training and the evaluation framework above, in its evaluation, the team assessed: Pre-training knowledge/skills Delivery of training of BOS trainers Delivery of training to school BOS teams Participant satisfaction (with training delivered) Participant commitment (as an immediate outcome of training) Participant change in knowledge/skills (as immediate outcome of training) Post-training participant behaviour (in terms of actions) There are two levels of evaluation activities for this assignment: activity level and impact level. Table 1 below summaries the scope of evaluation, methodology, and the activity. 1: Evaluation Matrix Scope/Level of Indicator Methodology Evaluation Pre-training/Preparation Pre-training knowledge/skills Literature Number of central BOS training Data from central BOS team members trained; number of management BOS trainers trained by central BOS training team (by district of origin). Number of BOS training and resource packages printed and delivered to districts prior to commencement of BOS training. Activity Level Number of principals, school Data from Central BOS treasurers and school committee Management representatives that have Training feedback and completed BOS Training, by evaluation surveys by gender district, gender and type of school. and type of school Percentage of participants that Pre- and post-training were satisfied with the overall knowledge tests or other quality of the BOS training they assessment procedures using attended (reaction) templates by district, gender and Percentage of participants that type of school. demonstrated a significant increase in knowledge as a result of the BOS Training (learning) Number and nature of complaints received in relation to BOS
can use attribution analysis, which aims to determine the proportion of observe change that can be attributed to the activity being evaluated. However, as the evaluation also wished to assess how far the desired outcome of BOS Training, improved school-based management of BOS, was achieved, the evaluation team conducted observation visits to selected schools. These visits aimed to observe processes in these schools, and collect perceptions of training in a different setting (1-3 months and then 4-8 months after the training, to see how trainees applied the knowledge acquired during the training and the challenges they faced). Changes at this level may well be associated with training, but cannot be attributed to the training, as many other factors may be contributing. The Scope, Population, Sampling, and Instruments In light of the aims of the BOS training and the evaluation framework above, in its evaluation, the team assessed: Pre-training knowledge/skills Delivery of training of BOS trainers Delivery of training to school BOS teams Participant satisfaction (with training delivered) Participant commitment (as an immediate outcome of training) Participant change in knowledge/skills (as immediate outcome of training) Post-training participant behaviour (in terms of actions) There are two levels of evaluation activities for this assignment: activity level and impact level. Table 1 below summaries the scope of evaluation, methodology, and the activity. 1: Evaluation Matrix Scope/Level of Evaluation Indicator Methodology Pre-training/Preparation Pre-training knowledge/skills Number of central BOS training team members trained; number of BOS trainers trained by central BOS training team (by district of origin). Number of BOS training and resource packages printed and delivered to districts prior to commencement of BOS training. Literature Data from central BOS management Activity Level Number of principals, school treasurers and school committee representatives that have completed BOS Training, by district, gender and type of school. Percentage of participants that were satisfied with the overall quality of the BOS training they attended (reaction) Percentage of participants that demonstrated a significant increase in knowledge as a result of the BOS Training (learning) Number and nature of complaints received in relation to BOS Data from Central BOS Management Training feedback and evaluation surveys by gender and type of school Pre- and post-training knowledge tests or other assessment procedures using templates by district, gender and type of school.
bos-training-program-independent-review.docx