1. Step 5: Justify Conclusions Luann D’Ambrosio, MEd

2. Understand how to arrive at conclusions Describe the importance of using standards for comparisons Describe how to make appropriate recommendations based on conclusions Objectives

3. CDC Evaluation Framework

4. Make recommendations Analyze why there are differences (e.g., money, time, personnel) Determine if standard has been achieved, i.e., are you over, under, or on target (answers evaluation question) Look at indicators to identify differences, trends, gaps, lack of data Making Conclusions Indicators Standard Differences Recommendations

5. Example: Quality Improvement From Jan 1 to Dec 31, 2012, 90% of all program enhancements are directly attributable to QI initiatives How effective is your QI program? Evaluation question Standard

6. What Happened? IndicatorWhat happened Total # of program changes9 % of program changes89% (8 of 9 changes) Total # of new/revised policies/protocols 0 % of new/revised program policies/protocols 0% # of new or changed program priorities 5 program priorities have resulted from using the PDSA principles % of staff improving productivity15% % of clients indicating satisfaction with program changes 100% % decrease in program costs10%

7. What Can We Conclude? QI program met its standard. QI program is extremely effective and did what it was intended to do. QI process would be very effective in developing new or revised policies or protocols. Staff efficiencies, decreased program costs, and client satisfaction indicated that QI process had positive effect on program.

8. What Can We Recommend? Continue the QI process as a result of the evaluation. Consider a QI process for other programs in the department. Provide QI training of stakeholders. Others?

9. Making Recommendations for Improvement Program strengths or best practices Ways of addressing challenges or opportunities Alternative approaches to reach program objectives Ways to expand or reduce the program Termination of all or part of a program Recommendations should be based on the purpose of your evaluation. Keep in mind your program’s resource limitations.

10. Questions?