Step 5: Justify Conclusions

Slides:



Advertisements
Similar presentations
1 of 17 Information Strategy The Features of an Information Strategy © FAO 2005 IMARK Investing in Information for Development Information Strategy The.
Advertisements

REGIONAL CONFERENCES Planning, Doing, and Using Evaluation.
REGIONAL CONFERENCES Planning, Doing, and Using Evaluation.
Title Presentation Date:. Comprehensive Plan Briefly describe your overall quality plan for your department. Describe what areas are important to assure.
DEPAUL UNIVERSITY SERVICE LEVEL AGREEMENTS AND PERFORMANCE METRICS Marge Hayes Ashton Hayes Group January 31, 2000.
Talbert House Project PASS Goals and Outcomes.
Challenge Questions What outcomes have we achieved?
Evaluation. Practical Evaluation Michael Quinn Patton.
Key Elements, Emerging Trends and Promising Practices in Monitoring and Evaluation of Development Results Lawrence S. Cooley, President Management Systems.
Purpose of the Standards
Evaluating Physical Activity Intervention Programs Thomas Schmid, PhD Physical Activity and Health Branch CDC Atlanta, Georgia, USA.
Continuous Quality Improvement (CQI)
Program Collaboration and Service Integration: An NCHHSTP Green paper Kevin Fenton, M.D., Ph.D., F.F.P.H. Director National Center for HIV/AIDS, Viral.
Performance Measurement: A Brief Introduction For Kunuwanimano Child and Family Services.
Academy for Leadership & Development. Strategic Planning – Process An effective strategic plan: Involves the primary stakeholders Involves the primary.
March 26-28, 2013 SINGAPORE CDIO Asian Regional Meeting and Workshop on Engineering Education and Policies for Regional Leaders Programme Evaluation (CDIO.
Early Childhood Outcomes Center1 Using Data for Program Improvement Christina Kasprzak, NECTAC/ECO Ann Bailey, NCRRC July 2010.
Model Name Transition Project Learning Network Workshop 3 IYF Transition Project.
De-escalation Training Pack Section 1 Introduction and scene setting.
Idaho Energy Plan Proposal (RFI) Energy Policy Institute (EPI)
Evaluation design and implementation Puja Myles
Ohio Improvement Process (OIP) Facilitating District-wide Improvement in Instructional Practices and Student Performance.
CRITICAL THINKING AND THE NURSING PROCESS Entry Into Professional Nursing NRS 101.
External Review Team: Roles and Responsibilities A Very Brief Training! conducted by JoLynn Noe Office of Assessment.
Kansas Tobacco Prevention for Specific Populations.
Framework for establishing and promoting RPCM. Tentative Table of Contents 1.Defining culture and terminology – What is safety culture /attributes of.
Step 5: Justify Conclusions Luann D’Ambrosio, MEd.
ORGANIZATION CAPACITY ASSESSMENT (2013) Produced in April 2013.
Required Skills for Assessment Balance and Quality: 10 Competencies for Educational Leaders Assessment for Learning: An Action Guide for School Leaders.
Selection Criteria and Invitational Priorities School Leadership Program U.S. Department of Education 2005.
Source: Patton, p1.. Program Evaluation: The systematic use of empirical information to assess and improve programs or policies.
HRPP METRICS Cynthia Monahan, MBA, CIP IRB Director Boston University Charles River Campus IRB.
Strategic planning A Tool to Promote Organizational Effectiveness
Stages of Research and Development
Performance Indicators
Incorporating Evaluation into a Clinical Project
Rebecca McQuaid Evaluation 101 …a focus on Programs Rebecca McQuaid
Building evaluation in the Department of Immigration and Citizenship
Designing Effective Evaluation Strategies for Outreach Programs
Functional Area Assessment
Chapter 03 Project Design
Evaluation Plan Akm Alamgir, PhD June 30, 2017.
Monitoring & Evaluation Processes A A walkthrough of the whole process
Right-sized Evaluation
STRATEGIES FOR fire & EMS Efficiencies
Quality of Education.
SNA Strategic Plan #SNAleadership.
Provincial Evaluation Plan By Kathleen Douglas-England
MaryCatherine Jones, MPH, Public Health Consultant, CVH Team
Results Based Management
What’s the connection to Ohio’s other initiatives?
Improving Data, Improving Outcomes Conference, September 2014
An Introduction to the Problem Solving Process
An Introduction to the Problem Solving Process
METHOD VALIDATION: AN ESSENTIAL COMPONENT OF THE MEASUREMENT PROCESS
Using outcomes data for program improvement
Introduction to M&E Frameworks
Technology Planning.
Using Data for Program Improvement
Module 8 ACTION PLANS.
WHAT is evaluation and WHY is it important?
Using Data for Program Improvement
Strategic Planning Final Plan Team Meeting
Process Improvement Overview
In 5 minutes.
Assessment components
Data for PRS Monitoring: Institutional and Technical Challenges
Disability Program Navigator Training A Joint Initiative of the U. S
Step 1 Stakeholders.
NON-ACADEMIC ASSESSMENT REPORTING FY’19
Presentation transcript:

Step 5: Justify Conclusions

Objectives Understand how to arrive at conclusions Describe the importance of using standards for comparisons Describe how to make appropriate recommendations based on conclusions

CDC Evaluation Framework

Making Conclusions Look at indicators to identify differences, trends, gaps, lack of data Indicators Standard Determine if standard has been achieved, i.e., are you over, under, or on target (answers evaluation question) Analyze why there are differences (e.g., money, time, personnel) Differences Make recommendations Recommendations

Example: Quality Improvement Evaluation question How effective is your QI program? Standard From Jan 1 to Dec 31, 2012, 90% of all program enhancements are directly attributable to QI initiatives

What Happened? Indicator What happened Total # of program changes 9 89% (8 of 9 changes) Total # of new/revised policies/protocols % of new/revised program policies/protocols 0% # of new or changed program priorities 5 program priorities have resulted from using the PDSA principles % of staff improving productivity 15% % of clients indicating satisfaction with program changes 100% % decrease in program costs 10%

What Can We Conclude? QI program met its standard. QI program is extremely effective and did what it was intended to do. QI process would be very effective in developing new or revised policies or protocols. Staff efficiencies, decreased program costs, and client satisfaction indicated that QI process had positive effect on program.

What Can We Recommend? Continue the QI process as a result of the evaluation. Consider a QI process for other programs in the department. Provide QI training of stakeholders. Others?

Making Recommendations for Improvement Program strengths or best practices Ways of addressing challenges or opportunities Alternative approaches to reach program objectives Ways to expand or reduce the program Termination of all or part of a program Recommendations should be based on the purpose of your evaluation. Keep in mind your program’s resource limitations.

Questions?