Indicators and performance criteria Document review: To identify Issue values were higher or lower than outliers (EINRIP annual reports, identification to expected AQC reports) guide fieldwork Stakeholder interviews: To investigate possible causes for performance Sustainability: Did EINRIP positively influence the approach the Government of Indonesia now takes to road infrastructure? Evaluation question / sub Evidence required Data collection method and Analytical question source approach To what extent did EINRIP, The degree to which EINRIP Document review: To identify Map actions either through targeted activities effectively facilitated the scope and scale of EINRIP against key institutional strengthening the transfer of knowledge and skills capacity building measures. capacity areas actions or by virtue of a Stakeholder interviews: Test demonstration effect recall/application of skills (DGH) influence the road construction practices The extent to which the key lessons Document review: examine Identify key employed by DGH on its and successes from EINRIP have been approach to learning and lessons general road construction effectively shared with DGH and across communications activities? (S1) the infrastructure sector Stakeholder interviews: test Compare awareness of EINRIP lessons stakeholder (DGH, engineering responses consultants/contractors) against lessons The degree to which broader Stakeholder interviews: Assess Test viability of infrastructure institutional and financial contextual factors as inhibitors key EINRIP structures work to enable the or enablers (DGH, engineering features application of the approach advocated consultants, WB and ADB) by EINRIP Identification of examples of other Stakeholder interviews: Solicit Identify possible DGH road projects replicating the details of other road projects EINRIP type EINRIP approach following EINRIP approach (DGH, projects engineering consultants, WB and ADB) Document review: Examine Verify use of sample documents for key EINRIP approach EINRIP features
Indicators and performance criteria values were higher or lower than expected Document review: To identify outliers (EINRIP annual reports, AQC reports) Stakeholder interviews: To investigate possible causes for performance Issue identification to guide fieldwork Sustainability: Did EINRIP positively influence the approach the Government of Indonesia now takes to road infrastructure? Evaluation question / sub question Evidence required Data collection method and source Analytical approach To what extent did EINRIP, either through targeted institutional strengthening actions or by virtue of a demonstration effect influence the road construction practices employed by DGH on its general road construction activities? (S1) The degree to which EINRIP activities effectively facilitated the transfer of knowledge and skills Document review: To identify the scope and scale of EINRIP capacity building measures. Stakeholder interviews: Test recall/application of skills (DGH) Map actions against key capacity areas The extent to which the key lessons and successes from EINRIP have been effectively shared with DGH and across the infrastructure sector Document review: examine approach to learning and communications Identify key lessons Stakeholder interviews: test awareness of EINRIP lessons (DGH, engineering consultants/contractors) Compare stakeholder responses against lessons The degree to which broader infrastructure institutional and financial structures work to enable the application of the approach advocated by EINRIP Stakeholder interviews: Assess contextual factors as inhibitors or enablers (DGH, engineering consultants, WB and ADB) Test viability of key EINRIP features Identification of examples of other DGH road projects replicating the EINRIP approach Stakeholder interviews: Solicit details of other road projects following EINRIP approach (DGH, engineering consultants, WB and ADB) Identify possible EINRIP type projects Document review: Examine sample documents for key EINRIP features Verify use of EINRIP approach