ATTACHMENT C: RHPI Evaluation Summary Approach Correlation Evaluation Anticipated Purpose Objective Method Limitations Between Component Outcomes Evaluations Recommendation The purpose of To Data is gathered Data may be RAP results RAP is Adoption the RAP is to document by interviewing limited due to: represent primary data Progress (RAP) gather project CEOs Completion of individual for ROCI Report information on the outcomes, approximately 6 the RAP project analysis. adoption of successes, 12 months interview, outcomes – consultant best and lessons post-project. availability of and status of Also practice learned the data from progress. provides recommendations, from RHPI Utilizes a scoring the hospital, background and ultimately sponsored system to and Assessment information project outcomes. projects. determine the robustness of findings and and possibly overall adoption the CEO outcomes supporting The goal of RAP is To rate. response to data are evidence to to demonstrate a demonstrate the data used to the financial hospital’s how the -RAP Score request and monitor and and quality progress over project ranges from 1 to interview modify evaluations. time by showing impacted 5. The concept is questionnaire. internal the extent to the hospital that the higher processes to which a facility and how it’s the score, then Accuracy of improve has implemented being the greater the reported services to recommendations. sustained number of financial and hospitals. long-term. recommendations outcome data were is dependent Evidence implemented by upon the gathered will the hospital to CEO’s support the sustain the knowledge at Office of project, which the time of Rural Health should improve reporting. Policy’s performance. performance -Progress on improvement anticipated initiatives. outcomes is recorded.
ATTACHMENT C: RHPI Evaluation Summary Approach Evaluation Component Purpose Objective Method Limitations Anticipated Outcomes Correlation Between Evaluations Recommendation Adoption Progress (RAP) Report The purpose of the RAP is to gather information on the adoption of consultant best practice recommendations, and ultimately project outcomes. The goal of RAP is to demonstrate a hospital’s progress over time by showing the extent to which a facility has implemented recommendations. To document project outcomes, successes, and lessons learned from RHPI sponsored projects. To demonstrate how the project impacted the hospital and how it’s being sustained long-term. Data is gathered by interviewing CEOs approximately 6 – 12 months post-project. Utilizes a scoring system to determine the overall adoption rate. -RAP Score ranges from 1 to 5. The concept is that the higher the score, then the greater number of recommendations were implemented by the hospital to sustain the project, which should improve performance. -Progress on anticipated outcomes is recorded. Data may be limited due to: Completion of the RAP interview, availability of the data from the hospital, and robustness of the CEO response to the data request and interview questionnaire. Accuracy of the reported financial and outcome data is dependent upon the CEO’s knowledge at the time of reporting. RAP results represent individual project outcomes and status of progress. Assessment findings and outcomes data are used to monitor and modify internal processes to improve services to hospitals. Evidence gathered will support the Office of Rural Health Policy’s performance improvement initiatives. RAP is primary data for ROCI analysis. Also provides background information and possibly supporting evidence to the financial and quality evaluations.
RHPI%20-%20RAP%20Program%20Evaluation%20Tool.docx