1. Step 5: Justify Conclusions

2. Objectives Understand how to arrive at conclusions
Describe the importance of using standards for comparisons
Describe how to make appropriate recommendations based on conclusions

3. CDC Evaluation Framework

4. Making Conclusions
Look at indicators to identify differences, trends, gaps, lack of data
Indicators
Standard
Determine if standard has been achieved, i.e., are you over, under, or on target (answers evaluation question)
Analyze why there are differences (e.g., money, time, personnel)
Differences
Make recommendations
Recommendations

5. Example: Quality Improvement
Evaluation question
How effective is your QI program?
Standard
From Jan 1 to Dec 31, 2012, 90% of all program enhancements are directly attributable to QI initiatives

6. What Happened? Indicator What happened Total # of program changes 9
89% (8 of 9 changes)
Total # of new/revised policies/protocols
% of new/revised program policies/protocols 0%
# of new or changed program priorities
5 program priorities have resulted from using the PDSA principles
% of staff improving productivity
15%
% of clients indicating satisfaction with program changes
100%
% decrease in program costs
10%

7. What Can We Conclude? QI program met its standard.
QI program is extremely effective and did what it was intended to do.
QI process would be very effective in developing new or revised policies or protocols.
Staff efficiencies, decreased program costs, and client satisfaction indicated that QI process had positive effect on program.

8. What Can We Recommend?
Continue the QI process as a result of the evaluation.
Consider a QI process for other programs in the department.
Provide QI training of stakeholders.
Others?

9. Making Recommendations for Improvement
Program strengths or best practices
Ways of addressing challenges or opportunities
Alternative approaches to reach program objectives
Ways to expand or reduce the program
Termination of all or part of a program
Recommendations should be based on the purpose of your evaluation. Keep in mind your program’s resource limitations.

10. Questions?