What is evaluated? Data collection method Which programmes will How will the data be be evaluated to this used? level? Learner reaction: Survey at the end of each All programmes 1. To improve programme evaluates how well was module and the end of design, learning the programme delivered entire programme. materials, learning and learner satisfaction. methods and target For programmes: audience Feedback from facilitators / observers 2. To improve delivery 3. To assist in Learning: evaluates 1. Pre-programme survey programme targeting whether learning took 2. Post-learning survey place. (end of module and end of programme) Behaviour: evaluates Interview or survey with: All pilot, high cost or To confirm transfer of where the participants are priority programmes. For learning or identify 1. the participant, and applying learning other programmes, when changes to increase 2. the participant’s the evaluation data impact and to confirm manager. indicates a requirement programme is delivering required behavioural changes Business objectives: Agency and employee All pilot programmes, and To confirm programme is evaluates whether the surveys. every 12-18 months for delivering the intended programme delivered on high cost or high priority outcomes and providing its business objectives programmes for money and provided value for money. Table 9: Strategic Centre learning programme evaluation framework
What is evaluated? Data collection method Which programmes will be evaluated to this level? How will the data be used? Learner reaction: evaluates how well was the programme delivered and learner satisfaction. Survey at the end of each module and the end of entire programme. For programmes: Feedback from facilitators / observers All programmes 1. To improve programme design, learning materials, learning methods and target audience 2. To improve delivery 3. To assist in programme targeting Learning: evaluates whether learning took place. 1. Pre-programme survey 2. Post-learning survey (end of module and end of programme) Behaviour: evaluates where the participants are applying learning Interview or survey with: 1. the participant, and 2. the participant’s manager. All pilot, high cost or priority programmes. For other programmes, when the evaluation data indicates a requirement To confirm transfer of learning or identify changes to increase impact and to confirm programme is delivering required behavioural changes Business objectives: evaluates whether the programme delivered on its business objectives and provided value for money. Agency and employee surveys. All pilot programmes, and every 12-18 months for high cost or high priority programmes To confirm programme is delivering the intended outcomes and providing for money Table 9: Strategic Centre learning programme evaluation framework
APS-Leadership-and-Core-Skills-Strategy-2014-15-refresh.docx