Effectiveness: Was EINRIP effective in the achievement of intended outcomes? Evaluation question / sub Evidence required Data collection method and Analytical question source approach To what extent do the The degree to which completed Document review: To trace Map planned physical infrastructure and infrastructure reflects the original and evolutions in scope against final outcomes against capacity gains established revised scope of work deliverables (project completion actuals through EINRIP reflect report, loan agreement, annual those outlined at project reports, AQC reports) inception? (E1) The extent to which roads meet original Document review: Assess validity Categorise and estimates relating to travel times, traffic of initial assumptions against tabulate KPI data volumes, accident rates and vehicle achievements (baseline & operating and maintenance costs monitoring surveys, EIRR calculations) The extent to which innovations Stakeholder interviews: To Collate and demonstrated in the design, planning understand current practice in synthesise and delivery of EINRIP have been taken Indonesian road construction feedback from up by DGH (DFAT, DGH, World Bank, ADB, stakeholders engineering consultants) What were the positive The extent to which intended benefits and negative, intended were delivered (as above) and unintended consequences associated Feedback from stakeholders as to the Stakeholder interviews: To Synthesise with EINRIP? (E2) appropriateness of roads and the EINRIP capture perspectives of DGH and feedback from approach other institutional stakeholders stakeholders Document review: To capture Synthesise perspectives of road users and evidence from communities (social surveys) communities
Effectiveness: Was EINRIP effective in the achievement of intended outcomes? Evaluation question / sub question Evidence required Data collection method and source Analytical approach To what extent do the physical infrastructure and capacity gains established through EINRIP reflect those outlined at project inception? (E1) The degree to which completed infrastructure reflects the original and revised scope of work Document review: To trace evolutions in scope against final deliverables (project completion report, loan agreement, annual reports, AQC reports) Map planned outcomes against actuals The extent to which roads meet original estimates relating to travel times, traffic volumes, accident rates and vehicle operating and maintenance costs Document review: Assess validity of initial assumptions against achievements (baseline & monitoring surveys, EIRR calculations) Categorise and tabulate KPI data The extent to which innovations demonstrated in the design, planning and delivery of EINRIP have been taken up by DGH Stakeholder interviews: To understand current practice in Indonesian road construction (DFAT, DGH, World Bank, ADB, engineering consultants) Collate and synthesise feedback from stakeholders What were the positive and negative, intended and unintended consequences associated with EINRIP? (E2) The extent to which intended benefits were delivered (as above) Feedback from stakeholders as to the appropriateness of roads and the EINRIP approach Stakeholder interviews: To capture perspectives of DGH and other institutional stakeholders Document review: To capture perspectives of road users and communities (social surveys) Synthesise feedback from stakeholders Synthesise evidence from communities
investing-in-roads-einrip-completion-evaluation-report.docx