Table 1: Evaluation Questions and Data Matrix Key Evaluation Question Information Requirements Data Sources Method of data collection or retrieval Description of the coaching - Observation at 6 services (last - Fieldwork intervention and activities coaching What were the strengths undertaken by coaches, quality - Document analysis and limitations of the of content, design (coaching - Secondary data - coaching reports program design? model) - Coaches (x 4) and coaching advisor - Individual interviews -Educators (16) and 6 managers across 8 services - Individual interviews and informal conversational interviews What changes in educators’ of a wide range of -4 coaches plus overall coaching - Interviews and coaching reports stakeholders about the value of advisor (Gowrie Victoria) practice resulted from the coaching and of this specific coaching program? intervention (self-report from - educators participating in educators and coaches reports) and end of program survey -End of program survey and and/or interviews interviews at service visits (x 8) How did the program What were the most significant Managers and/or directors of - Interviews changes that occurred in participating services influence and improve services participating in the processes and practices at program? What is the likely Coaches - Coaching reports and interviews the service level? sustainability of these changes? with coaches Case impact profiles and review of services rated through NQS 5. What are the lessons How does coaching compare -Costing information from Gowrie - Retrieval from Gowrie Victoria with other professional Victoria records learned what is development options? - Coaches required to support early What strengthened and inhibited - Interviews (individual and childhood services in effective implementation of the - Service Impact profiles group) Victoria? coaching program? (x3) re implementation of the coaching program - Interviews and service visit
Table 1: Evaluation Questions and Data Matrix Key Evaluation Question Information Requirements Data Sources Method of data collection or retrieval What were the strengths and limitations of the program design? Description of the coaching intervention and activities undertaken by coaches, quality of content, design (coaching model) - Observation at 6 services (last coaching - Secondary data - coaching reports - Coaches (x 4) and coaching advisor -Educators (16) and 6 managers across 8 services - Fieldwork - Document analysis - Individual interviews - Individual interviews and informal conversational interviews What changes in educators’ practice resulted from the coaching program? of a wide range of stakeholders about the value of coaching and of this specific intervention (self-report from educators and coaches reports) -4 coaches plus overall coaching advisor (Gowrie Victoria) - educators participating in and end of program survey and/or interviews - Interviews and coaching reports -End of program survey and interviews at service visits (x 8) How did the program influence and improve processes and practices at the service level? What were the most significant changes that occurred in services participating in the program? What is the likely sustainability of these changes? Managers and/or directors of participating services Coaches Case impact profiles and review of services rated through NQS - Interviews - Coaching reports and interviews with coaches 5. What are the lessons learned what is required to support early childhood services in Victoria? How does coaching compare with other professional development options? What strengthened and inhibited effective implementation of the coaching program? -Costing information from Gowrie Victoria - Coaches - Service Impact profiles (x3) re implementation of the coaching program - Retrieval from Gowrie Victoria records - Interviews (individual and group) - Interviews and service visit
coachingeval.docx