of the OEDC-DAC Criteria outlined above and the data sources available. The range of data sources to be used for the evaluation includes but is not limited to: stakeholder interviews (Government of Indonesia, Bank, ADB, task team leaders and other advisers, KIAT program office) Program governance documentation (including trust fund agreements, steering committee papers and minutes, annual performance assessments, financial approval documentation etc.) Program management documentation (including 6-monthly progress reports, subproject specific documentation, etc.) World Bank and ADB country strategies, implemented loan/ grant agreements DFAT program design documents for the MDB-IAP and KIAT. OECD-DAC Evaluation question Guiding questions Data source Criteria 1. How suitable are the Are the governance Program governance Relevance documentation governance and arrangements appropriate, Effectiveness implementation effective and functioning as Program Efficiency arrangements? envisaged? management documentation Interviews with DFAT officers, World Bank and ADB program managers Interviews with key GoI officials Are the World Bank and ADB Program Relevance management managing their activities in Efficiency information accordance with the agreed administrative arrangements? Interviews with DFAT officers, World Bank and ADB program managers Is the program’s Monitoring Program governance Impact documentation and Evaluation (M&E) system Efficiency providing DFAT with the Program information needed to management confidently understand and documentation report on progress? Interviews with DFAT officers, World Bank and ADB program managers Interviews with Task Team Leaders and other advisers on subprojects
of the OEDC-DAC Criteria outlined above and the data sources available. The range of data sources to be used for the evaluation includes but is not limited to: stakeholder interviews (Government of Indonesia, Bank, ADB, task team leaders and other advisers, KIAT program office) Program governance documentation (including trust fund agreements, steering committee papers and minutes, annual performance assessments, financial approval documentation etc.) Program management documentation (including 6-monthly progress reports, subproject specific documentation, etc.) World Bank and ADB country strategies, implemented loan/ grant agreements DFAT program design documents for the MDB-IAP and KIAT. Evaluation question Guiding questions Data source OECD-DAC Criteria 1. How suitable are the governance and implementation arrangements? Are the governance arrangements appropriate, effective and functioning as envisaged? Program governance documentation Program management documentation Interviews with DFAT officers, World Bank and ADB program managers Interviews with key GoI officials Relevance Effectiveness Efficiency Are the World Bank and ADB managing their activities in accordance with the agreed administrative arrangements? Program management information Interviews with DFAT officers, World Bank and ADB program managers Relevance Efficiency Is the program’s Monitoring and Evaluation (M&E) system providing DFAT with the information needed to confidently understand and report on progress? Program governance documentation Program management documentation Interviews with DFAT officers, World Bank and ADB program managers Interviews with Task Team Leaders and other advisers on subprojects Impact Efficiency