Annex 8: Evaluation Framework Evaluation Questions Types of answers/ Methods for data collection Sampling or selection Data Analysis Evidence Needed e.g., records, structured observation, Key informant Approach methods e.g.… interviews, mini-survey (If one is needed) Method Data sources PROGRAM DESIGN Is there any evidence Analytic description of the Document/ Literature National Strategic None Content analysis and that programs (HIV, technical approaches/ review & grant interpretation of TB, malaria and strategies and objectives of documents, qualitative findings maternal and child the programs (HIV, TB, Project theory of health) have malaria and maternal and change, M&E plan, incorporated health); evidence of performance community based CSS involving established (activity, approaches through community health workers quarterly, annual, CHWs into their and other program strategies? relevant) reports; work plans, budgets, financial reports; survey reports Is there evidence to Analytic descriptions of the Document Review of Disease specific Sampling of districts and Content analysis suggest that CHWs entire national and district program documents, Policy, Strategic communities to be and have participated in coordination structures (up periodic performance Plan, and decided upon during Grounded theory and contributed to the to lowest service delivery reports, minutes of implementation development of protocol approach for analysis three disease control level), quality of the performance review guidelines Sampling of levels and interpretation of program, and MNCH? relationship that exists meetings Grant documents health facilities and qualitative findings whether it’s also supportive Focus Group District annual communities will be done Consultative meetings, and mutually beneficial Discussions with performance to achieve a balance selection, analysis, Analytic description of partners, reports between the districts and feedback and verification supportive mechanism for stakeholders, and Key informants between good and poor of Change’ ‘Significant the work of the CHWs, data target groups at from technical performing health stories recording and reporting district, health facility side and facilities/communities. systems as well as and Community level. stakeholders at all methodologies used in Key Informant relevant levels aggregation and forward interviews (PR, especially the transmission to the centre; MOHCW (Directorate community evidence of use of of Nursing), ZAN and information generated to HSS CCM influence management subcommittee) and decisions and refine external informants implementation (partners,
Annex 8: Evaluation Framework Evaluation Questions Types of answers/ Evidence Needed Methods for data collection e.g., records, structured observation, Key informant interviews, mini-survey Sampling or selection Approach (If one is needed) Data Analysis methods e.g.… Method Data sources PROGRAM DESIGN Is there any evidence that programs (HIV, TB, malaria and maternal and child health) have incorporated community based approaches through CHWs into their program strategies? Analytic description of the technical approaches/ strategies and objectives of the programs (HIV, TB, malaria and maternal and health); evidence of CSS involving established community health workers Document/ Literature review National Strategic & grant documents, Project theory of change, M&E plan, performance (activity, quarterly, annual, and other relevant) reports; work plans, budgets, financial reports; survey reports None Content analysis and interpretation of qualitative findings Is there evidence to suggest that CHWs have participated in and contributed to the three disease control program, and MNCH? Analytic descriptions of the entire national and district coordination structures (up to lowest service delivery level), quality of the relationship that exists whether it’s also supportive and mutually beneficial Analytic description of supportive mechanism for the work of the CHWs, data recording and reporting systems as well as methodologies used in aggregation and forward transmission to the centre; evidence of use of information generated to influence management decisions and refine implementation Document Review of program documents, periodic performance reports, minutes of performance review meetings Focus Group Discussions with partners, stakeholders, and target groups at district, health facility and Community level. Key Informant interviews (PR, MOHCW (Directorate of Nursing), ZAN and HSS CCM subcommittee) and external informants (partners, Disease specific Policy, Strategic Plan, and implementation guidelines Grant documents District annual performance reports Key informants from technical side and stakeholders at all relevant levels especially the community Sampling of districts and communities to be decided upon during development of protocol Sampling of levels health facilities and communities will be done to achieve a balance between the districts and between good and poor performing health facilities/communities. Content analysis and Grounded theory approach for analysis and interpretation of qualitative findings Consultative meetings, selection, analysis, feedback and verification of ‘Significant Change’ stories
CSS%20Evaluation%20Report%20(Revised%20Edition-August%202012).docx