Step 5: Justify Conclusions
Objectives Understand how to arrive at conclusions Describe the importance of using standards for comparisons Describe how to make appropriate recommendations based on conclusions
CDC Evaluation Framework
Making Conclusions Look at indicators to identify differences, trends, gaps, lack of data Indicators Standard Determine if standard has been achieved, i.e., are you over, under, or on target (answers evaluation question) Analyze why there are differences (e.g., money, time, personnel) Differences Make recommendations Recommendations
Example: Quality Improvement Evaluation question How effective is your QI program? Standard From Jan 1 to Dec 31, 2012, 90% of all program enhancements are directly attributable to QI initiatives
What Happened? Indicator What happened Total # of program changes 9 89% (8 of 9 changes) Total # of new/revised policies/protocols % of new/revised program policies/protocols 0% # of new or changed program priorities 5 program priorities have resulted from using the PDSA principles % of staff improving productivity 15% % of clients indicating satisfaction with program changes 100% % decrease in program costs 10%
What Can We Conclude? QI program met its standard. QI program is extremely effective and did what it was intended to do. QI process would be very effective in developing new or revised policies or protocols. Staff efficiencies, decreased program costs, and client satisfaction indicated that QI process had positive effect on program.
What Can We Recommend? Continue the QI process as a result of the evaluation. Consider a QI process for other programs in the department. Provide QI training of stakeholders. Others?
Making Recommendations for Improvement Program strengths or best practices Ways of addressing challenges or opportunities Alternative approaches to reach program objectives Ways to expand or reduce the program Termination of all or part of a program Recommendations should be based on the purpose of your evaluation. Keep in mind your program’s resource limitations.
Questions?