Alignment of the reforms and innovation with issues to be addressed Level of stakeholders who report that barriers to change and uptake of reform are identified and addressed Intermediate Outcome 3: Reported change in knowledge, skills and application by GoI Enhanced capacity among and research institutes as result of capacity strengthening by government agencies and research program institutions to design and conduct Alignment of capacity strengthening activities conducted by qualitative and quantitative policy program with expressed needs of GoI and institutes analysis. Stakeholder perceptions of the quality, appropriateness and timeliness of the technical assistance provided Intermediate Outcome 4: Increased frequency, timeliness and accessibility of Improvements in the quality and and labor data. availability of data required for Reported change in knowledge, skills and application by GOI as poverty analysis and policymaking. result of capacity strengthening by program Alignment of capacity strengthening activities conducted by program with expressed of GoI and institutes Evaluation plan 2: Key evaluation questions and data methods Key evaluation Second level Data methods What we will explore questions questions To what extent is Have the Document reviews, including: The desired effects. The the AusAID funding interventions and design documents; scale up underlying theory of change. enabling the instruments proposal; peer reviews of scale up The underlying assumptions program to meet its produced the proposal; results framework; The mix of intervention and objectives? desired effects? monitoring and evaluation activities. Could other framework; baseline report; The activities that have been interventions progress reports; workplans; and undertaken. How these are achieve better standard operating procedures determined and why. results? A rapid clarification of the program’s Progress to date. Enablers. theory of change to check for Barriers to achievement. alignment of activities and direction Satisfied of direct indirect with intended goals (as part of program beneficiaries with the workshop with program staff) results (expected and Evaluation of a small sample of unexpected) briefing papers (3-4) Reach of program Brief analysis of where work of the Who research is done for, program is being published purpose, usefulness A citation analysis The policy initiatives the User (as part of interviews) research has supported. The ‘surveys’ of perceptions and reactions to the uptake and outcomes program’s products and services A modified episode study by back’ (as part of interviews ‘tracking and reviewing documents) of a small sample of policy changes suggested by stakeholders as having been influenced by the work of the Knowledge-Based Poverty Reduction program Individual and group interviews
Alignment of the reforms and innovation with issues to be addressed Level of stakeholders who report that barriers to change and uptake of reform are identified and addressed Intermediate Outcome 3: Enhanced capacity among government agencies and research institutions to design and conduct qualitative and quantitative policy analysis. Reported change in knowledge, skills and application by GoI and research institutes as result of capacity strengthening by program Alignment of capacity strengthening activities conducted by program with expressed needs of GoI and institutes Stakeholder perceptions of the quality, appropriateness and timeliness of the technical assistance provided Intermediate Outcome 4: Improvements in the quality and availability of data required for poverty analysis and policymaking. Increased frequency, timeliness and accessibility of and labor data. Reported change in knowledge, skills and application by GOI as result of capacity strengthening by program Alignment of capacity strengthening activities conducted by program with expressed of GoI and institutes Evaluation plan 2: Key evaluation questions and data methods Key evaluation questions Second level questions Data methods What we will explore To what extent is the AusAID funding enabling the program to meet its objectives? Have the interventions and instruments produced the desired effects? Could other interventions achieve better results? Document reviews, including: design documents; scale up proposal; peer reviews of scale up proposal; results framework; monitoring and evaluation framework; baseline report; progress reports; workplans; and standard operating procedures A rapid clarification of the program’s theory of change to check for alignment of activities and direction with intended goals (as part of workshop with program staff) Evaluation of a small sample of briefing papers (3-4) Brief analysis of where work of the program is being published A citation analysis User ‘surveys’ (as part of interviews) of perceptions and reactions to the program’s products and services A modified episode study by ‘tracking back’ (as part of interviews and reviewing documents) of a small sample of policy changes suggested by stakeholders as having been influenced by the work of the Knowledge-Based Poverty Reduction program Individual and group interviews The desired effects. The underlying theory of change. The underlying assumptions The mix of intervention and activities. The activities that have been undertaken. How these are determined and why. Progress to date. Enablers. Barriers to achievement. Satisfied of direct indirect program beneficiaries with the results (expected and unexpected) Reach of program Who research is done for, purpose, usefulness The policy initiatives the research has supported. The uptake and outcomes
partnership-for-knowledge-eval-plan.docx