Step 5: Justify Conclusions Luann D’Ambrosio, MEd.

Slides:

Advertisements

Similar presentations

1 of 17 Information Strategy The Features of an Information Strategy © FAO 2005 IMARK Investing in Information for Development Information Strategy The.

Advertisements

Engaging Your Community in Practical Program Evaluation Stephanie Welch, MS-MPH, RD, LDN Knox County Health Department Phone (865)

MAPP Process & Outcome Evaluation

REGIONAL CONFERENCES Planning, Doing, and Using Evaluation.

REGIONAL CONFERENCES Planning, Doing, and Using Evaluation.

Communities First Mike Durke. Key Lessons 2002: Early days 2003: Deputy Minister Review 2006: Interim Evaluation 2008: ‘Communities Next’ 2009: Wales.

How to Evaluate Your Health Literacy Project Jill Lucht, MS Project Director, Center for Health Policy

Title Presentation Date:. Comprehensive Plan Briefly describe your overall quality plan for your department. Describe what areas are important to assure.

Decision Making Tools for Strategic Planning 2014 Nonprofit Capacity Conference Margo Bailey, PhD April 21, 2014 Clarify your strategic plan hierarchy.

DEPAUL UNIVERSITY SERVICE LEVEL AGREEMENTS AND PERFORMANCE METRICS Marge Hayes Ashton Hayes Group January 31, 2000.

The Lumina Center Grantseeking Workshop Series Presents Outcomes & Evaluations April 20, 2006.

Talbert House Project PASS Goals and Outcomes.

Challenge Questions What outcomes have we achieved?

Evaluation. Practical Evaluation Michael Quinn Patton.

Key Elements, Emerging Trends and Promising Practices in Monitoring and Evaluation of Development Results Lawrence S. Cooley, President Management Systems.

Purpose of the Standards

Evaluating Physical Activity Intervention Programs Thomas Schmid, PhD Physical Activity and Health Branch CDC Atlanta, Georgia, USA.

Continuous Quality Improvement (CQI)

1 Types of Evaluation. 2 Different types of evaluation Needs assessment Process evaluation Impact evaluation Cost-benefit analysis.

Evaluation Office 1 Evaluating Capacity Development David Todd Senior Evaluation Officer GEF Evaluation Office.

Program Collaboration and Service Integration: An NCHHSTP Green paper Kevin Fenton, M.D., Ph.D., F.F.P.H. Director National Center for HIV/AIDS, Viral.

Performance Measurement: A Brief Introduction For Kunuwanimano Child and Family Services.

Date Coordinator Name(s) Other Leadership Name(s) ABC Coalition Clean Cities Re-designation.

Strategic Planning Session David Rudder, Ph.D. Rudder Consultants, LLC. May 17, 2006.

Fundamentals of Evaluation for Public Health Programs ROBERT FOLEY, M.ED. NIHB TRIBAL PUBLIC HEALTH SUMMIT MARCH 31,

Academy for Leadership & Development. Strategic Planning – Process An effective strategic plan: Involves the primary stakeholders Involves the primary.

Comp 20 - Training & Instructional Design Unit 6 - Assessment This material was developed by Columbia University, funded by the Department of Health and.

March 26-28, 2013 SINGAPORE CDIO Asian Regional Meeting and Workshop on Engineering Education and Policies for Regional Leaders Programme Evaluation (CDIO.

Monitoring & Evaluation: The concepts and meaning Day 9 Session 1.

Early Childhood Outcomes Center1 Using Data for Program Improvement Christina Kasprzak, NECTAC/ECO Ann Bailey, NCRRC July 2010.

Model Name Transition Project Learning Network Workshop 3 IYF Transition Project.

The Big Picture The Role of Evaluation in Public Health Luann D’Ambrosio, MEd.

De-escalation Training Pack Section 1 Introduction and scene setting.

The Needs Assessment Used with permission of: John R. Slate, Ph.D.

Idaho Energy Plan Proposal (RFI) Energy Policy Institute (EPI)

Illinois Department of Children & Family Service/Chicago State University STEP Program - NHSTES May THE STEP PROGRAM Supervisory Training to Enhance.

ANNOOR ISLAMIC SCHOOL AdvancEd Survey PURPOSE AND DIRECTION.

Evaluation design and implementation Puja Myles

Ohio Improvement Process (OIP) Facilitating District-wide Improvement in Instructional Practices and Student Performance.

SACS/CASI District Accreditation  January 2007  April 2007  May 2007  January – April 2008  Board Approval for Pursuit of District Accreditation.

CRITICAL THINKING AND THE NURSING PROCESS Entry Into Professional Nursing NRS 101.

External Review Team: Roles and Responsibilities A Very Brief Training! conducted by JoLynn Noe Office of Assessment.

Kansas Tobacco Prevention for Specific Populations.

Framework for establishing and promoting RPCM. Tentative Table of Contents 1.Defining culture and terminology – What is safety culture /attributes of.

Building on Achievement for Continued Success Club Officer Training.

FFC Framework for assessing Conditional Grants 16 March 2010 Financial and Fiscal Commission 1.

Aspect 1 Defining the problem - Problem: The design context will normally offer a variety of potential problems to solve. A focused problem and need is.

SELF-ASSESSMENT IN TVET SCHOOLS Project financed under Phare EUROPEAN UNION MERI/ NCDTVET - PIU Material produced under Phare 2006 financial support Phare.

ORGANIZATION CAPACITY ASSESSMENT (2013) Produced in April 2013.

Required Skills for Assessment Balance and Quality: 10 Competencies for Educational Leaders Assessment for Learning: An Action Guide for School Leaders.

Selection Criteria and Invitational Priorities School Leadership Program U.S. Department of Education 2005.

Evaluation What is evaluation?

Critical Program Movement: Integration of STD Prevention with Other Programs Kevin Fenton, MD, PhD, FFPH Director National Center for HIV/AIDS, Viral Hepatitis,

Strategic planning A Tool to Promote Organizational Effectiveness

Stages of Research and Development

Rebecca McQuaid Evaluation 101 …a focus on Programs Rebecca McQuaid

Designing Effective Evaluation Strategies for Outreach Programs

Monitoring & Evaluation Processes A A walkthrough of the whole process

STRATEGIES FOR fire & EMS Efficiencies

Quality of Education.

SNA Strategic Plan #SNAleadership.

Debriefing Presentation Covenant Health

What’s the connection to Ohio’s other initiatives?

Using outcomes data for program improvement

Using Data for Program Improvement

ISO 9001 Auditing Practices Group

Step 5: Justify Conclusions

Using Data for Program Improvement

ISO 9001 Auditing Practices Group

Assessment components

Presentation transcript:

Step 5: Justify Conclusions Luann D’Ambrosio, MEd

Understand how to arrive at conclusions Describe the importance of using standards for comparisons Describe how to make appropriate recommendations based on conclusions Objectives

CDC Evaluation Framework

Make recommendations Analyze why there are differences (e.g., money, time, personnel) Determine if standard has been achieved, i.e., are you over, under, or on target (answers evaluation question) Look at indicators to identify differences, trends, gaps, lack of data Making Conclusions Indicators Standard Differences Recommendations

Example: Quality Improvement From Jan 1 to Dec 31, 2012, 90% of all program enhancements are directly attributable to QI initiatives How effective is your QI program? Evaluation question Standard

What Happened? IndicatorWhat happened Total # of program changes9 % of program changes89% (8 of 9 changes) Total # of new/revised policies/protocols 0 % of new/revised program policies/protocols 0% # of new or changed program priorities 5 program priorities have resulted from using the PDSA principles % of staff improving productivity15% % of clients indicating satisfaction with program changes 100% % decrease in program costs10%

What Can We Conclude? QI program met its standard. QI program is extremely effective and did what it was intended to do. QI process would be very effective in developing new or revised policies or protocols. Staff efficiencies, decreased program costs, and client satisfaction indicated that QI process had positive effect on program.

What Can We Recommend? Continue the QI process as a result of the evaluation. Consider a QI process for other programs in the department. Provide QI training of stakeholders. Others?

Making Recommendations for Improvement Program strengths or best practices Ways of addressing challenges or opportunities Alternative approaches to reach program objectives Ways to expand or reduce the program Termination of all or part of a program Recommendations should be based on the purpose of your evaluation. Keep in mind your program’s resource limitations.

Questions?