Katherine Perdomo Alanna Pugliese CATEGORIES OF EVALUATION.

Slides:



Advertisements
Similar presentations
Program Evaluation: What is it?
Advertisements

Generalized Model for Program Planning
Overview M&E Capacity Strengthening Workshop, Maputo 19 and 20 September 2011.
Effective Practices for Preventing and Addressing Young Children’s Challenging Behaviors Mary Louise Hemmeter, Ph.D.: University of Illinois at Urbana-Champaign.
EVALUATION (PROCEED) by Lawrence Green Muji Sulistyowati
Logic Models and Evaluation Glen W. White 1 Jamie Simpson 2 1 University of Kansas, Research and Training Center on Independent Living 2 Kansas Department.
I am cutting rocks.
Clinical Supervision Foundations Module Six Performance Evaluation.
Program Evaluation. Lecture Overview  Program evaluation and program development  Logic of program evaluation (Program theory)  Four-Step Model  Comprehensive.
Program Evaluation and Measurement Janet Myers. Objectives for today… To define and explain concepts and terms used in program evaluation. To understand.
Action Implementation and Monitoring A risk in PHN practice is that so much attention can be devoted to development of objectives and planning to address.
1 Minority SA/HIV Initiative MAI Training SPF Step 3 – Planning Presented By: Tracy Johnson, CSAP’s Central CAPT Janer Hernandez, CSAP’s Northeast CAPT.
Presented By: Tracy Johnson, Central CAPT
Chapter 15 Evaluation.
Chapter 2 Training For Organizations Needs Assessment.
Action Planning Guidance Illinois Public Health Institute.
Community Planning Training 1-1. Community Plan Implementation Training 1- Community Planning Training 1-3.
Translating the Core Competencies for Public Health into Action September 23, 2009 “Relationship between the Core Competencies for Public Health and PHN.
Evaluation of Math-Science Partnership Projects (or how to find out if you’re really getting your money’s worth)
How to Develop the Right Research Questions for Program Evaluation
Impact Evaluation: Initiatives, Activities, & Coalitions Stephen Horan, PhD Community Health Solutions, Inc. September 12, 2004.
Cross Border Animal Health Plan of Action – Kenya and Uganda Four Strategic areas 1. To improve prevention, management and control of cross border animal.
Selecting an Evidence-based Approach (EBA) with the Best Fit Image courtesy of Naypong at FreeDigitalPhotos.net.
Instructional leadership: The role of promoting teaching and learning EMASA Conference 2011 Presentation Mathakga Botha Wits school of Education.
Program Evaluation and Logic Models
Reclaiming Education’s Doctorates: What’s the story? (and how will we tell it?) Toward an Accounting of CPED Nashville Convening: 25 October 2007.
Implementation Science Vision 21: Linking Systems of Care June 2015 Lyman Legters.
Fundamentals of Evaluation for Public Health Programs ROBERT FOLEY, M.ED. NIHB TRIBAL PUBLIC HEALTH SUMMIT MARCH 31,
Evaluation Assists with allocating resources what is working how things can work better.
From Competencies to Outcomes: Nursing Care of Older Adults Christine Mueller, PhD, RN, FGSA, FAAN Professor, University of Minnesota, School of Nursing.
SIM Evaluation Approach Presentation to the SIM Steering Committee September 25, 2013.
Indicators for ACSM.
RHS 303. TRANSITION OF THEORY AND TREATMENT nature of existence and gives meaning to and guides the action Philosophical Base: Philosophy of occupational.
Nancy L. Weaver, PhD, MPH Department of Community Health School of Public Health Saint Louis University 16 July 2010 LOGIC MODEL FUNDAMENTALS.
Community Plan Implementation Training 1-1. Community Plan Implementation Training 1-1 Community Plan Implementation Training 1-2.
1 Nemours Health Planning and Evaluation Collaborative Learning Session I: Designing Effective Health Programs.
Context Evaluation knowing the setting Context Evaluation knowing the setting.
This work is part of the Joint Action on Improving Quality in HIV Prevention (Quality Action), which has received funding from the European Union within.
Community Planning 101 Disability Preparedness Summit Nebraska Volunteer Service Commission Laurie Barger Sutter November 5, 2007.
TigerLIFE Behavioral Unit J. Brian Smith, Ed.D., BCBA Marissa Harris, M.S., Ed.D. Graduate Student.
Social Ecological Models
Adrienne DiTommaso, MPA, CNCS Office of Research and Evaluation
2 Digital Citizenship
 2007 Johns Hopkins Bloomberg School of Public Health Section B Logic Models: The Pathway Model.
The purpose of evaluation is not to prove, but to improve.
INTRODUCING THE PSBA-GTO ACT FOR YOUTH CENTER OF EXCELLENCE IN CONSULTATION WITH HEALTHY TEEN NETWORK Planning for Evidence-Based Programming.
RE-AIM Framework. RE-AIM: A Framework for Health Promotion Planning, Implementation and Evaluation Are we reaching the intended audience? Is the program.
Introduction to Monitoring and Evaluation. Learning Objectives By the end of the session, participants will be able to: Define program components Define.
Pharmacy in Public Health: Cultural Competence Course, date, etc. info.
Using Data to Assess Quality Improvement Results February 23, 2009 Presentation at the CLP/ADRC 2010 Annual Meeting Debra J. Lipson.
Assessment/Evaluation Make evaluation a central part of planning – not an afterthought 1) Determine Needs 2) Determine Desired Outcomes 3) Determine Activities.
Monitoring and Evaluation Systems for NARS organizations in Papua New Guinea Day 4. Session 10. Evaluation.
PRECEDE – PROCEDE THEORY
Managing Organizational Change and Development
Adding the Second Story: Building Evaluation Capacity in the Field
Introduction to Program Evaluation
Tobacco control.
IX- PREPARING THE BUDGET
PRECEDE – PROCEED THEORY
Case Rate Readiness Assessment & Work Plan
Miblsi.cenmi.org Helping Students Become Better Readers with Social Skills Necessary for Success Steve Goodman Funded through OSEP.
THE PRECEDE-PROCEED PLANNING MODEL
THE PRECEDE-PROCEED PLANNING MODEL
FRAMEWORK OF EVALUATION QUESTIONS
EVALUATION RESEARCH These are those types of research that evaluate the impact of social interventions. Motivated by the desire of social scientist to.
What is a Logic Model? A depiction of a program showing what the program will do and what it is to accomplish. A series of “if-then” relationships that.
Apply knowledge of human behavior and the social environment.
Program Planning: Models and Theories
What is a Logic Model? A depiction of a program showing what the program will do and what it is to accomplish. A series of “if-then” relationships that.
Presentation transcript:

Katherine Perdomo Alanna Pugliese CATEGORIES OF EVALUATION

Preferred TermOther TermObjectives Process evaluationFormative evaluationFeedback on program implementation, site response, participant response, practitioner response, and personnel competency Impact evaluationSummative evaluationFeedback on knowledge, attitudes, beliefs and behavior of participants; programs and policies of organizations and governments Outcome evaluationSummative evaluationFeedback on health status morbidity and mortality RELATIONSHIP OF TWO FRAMEWORKS FOR CATEGORIZING EVALUATIONS

 “How well is the program being implemented?”  Process Evaluation should answer the question: How much of the intervention was provided, to whom, when, and by whom?  For programs directed to individual-level behavior change  Reviews the program’s materials and plans to see whether they are consistent with program objectives  For organizational-level objectives  Reviews what organizational change strategies were used and how effective they were at achieving the change goal.  For government-influencing programs  Change strategy would be documented and evaluated and the law, ordinance, policy or program adoption would be reported. PROCESS EVALUATION

 Process measures provide feedback as to whether the program is being carried out as planned.  Process evaluation is important in determining:  The impact and outcome results of an evaluation  Whether a program was carried out as planned  Feasibility  Whether the program can be implemented across different types of settings PROCESS EVALUATION

 Impact evaluations seeks to assess changes in knowledge, attitudes, beliefs, values, skills, behaviors, and practices as a result of the intervention.  Impact evaluation should answer the question: Did the intervention [as applied at a specific location to a defined population] and only the intervention produce changes in behavior?  The immediate impact of the program is measured:  Individual level- in terms of the target’s population’s knowledge, beliefs, attitudes, and behaviors towards the issue  Organizational level- in terms of policies, programs, and resources  Government level- In terms of policies, plans, funding and legislatio IMPACT EVALUATION

 Outcome evaluation measures improvements in health or social factors as a result of the intervention.  Addresses changes in morbidity and mortality rates.  Outcome evaluation should answer the question: Did the intervention [as applied at a specific location to a defined population] and only the intervention produce changes in the health status of program participants (clients)? OUTCOME EVALUATION