University of Wisconsin - Extension, Cooperative Extension, Program Development and Evaluation Unit 2: Developing an evaluation plan.

Slides:



Advertisements
Similar presentations
Program Evaluation: What is it?
Advertisements

Program Evaluation Alternative Approaches and Practical Guidelines
Using the CDC Evaluation Fwork to Avoid Minefields on the Road to Good Evaluation Presented to: 2002 National Asthma Conference October 24, 2002 By: Thomas.
Focusing an Evaluation Ben Silliman, Youth Development Specialist NC 4-H Youth Development.
Good Evaluation. Good Evaluation Should … be simple be fair be purposeful be related to the curriculum assess skills & strategies set priorities use multiple.
Introduction to Monitoring and Evaluation
Developing and Implementing a Monitoring & Evaluation Plan
Johns Hopkins University School of Education Johns Hopkins University Evaluation Overview.
A Process of Quality Improvement: Informed Participation and Institutional Process SACHRP March 27, 2008 Nancy Neveloff Dubler Director Center for Ethics.
Elementary School Counselor
Measuring Value: Using Program Evaluation to Understand What’s Working -- Or Isn’t Juliana M. Blome, Ph.D. , MPH Office of Program Analysis and Evaluation.
What You Will Learn From These Sessions
Program Evaluation and Measurement Janet Myers. Objectives for today… To define and explain concepts and terms used in program evaluation. To understand.
Focusing Evaluation Getting ready. Focusing: Making Ready Stages of Evaluation Evaluability –Stakeholders –Standards Target Indicators –Outcome indicators.
 Systematic determination of the quality or value of something (Scriven, 1991)  What can we evaluate?  Projects, programs, or organizations  Personnel.
Testing a Strategic Evaluation Framework for Incrementally Building Evaluation Capacity in a Federal R&D Program 27 th Annual Conference of the American.
INVITATIONAL PRACTICUM IN METAEVALUATION Session 2 9/15/11 GAO & Joint Committee Standards DLS 9/13/11 1.
Decision-Making and Strategic Information Workshop on M&E of PHN Programs July 24-August 11, 2006 Addis Ababa.
Chapter 13 Selecting a Data Collection Method. DATA COLLECTION AND THE RESEARCH PROCESS Steps 1 and 2: Selecting a General Research Topic and Focusing.
Chapter 3 Preparing and Evaluating a Research Plan Gay and Airasian
A Healthy Place to Live, Learn, Work and Play:
Reality Check For Extension Programs Deborah J. Young Associate Director University of Arizona Cooperative Extension.
Evaluation. Practical Evaluation Michael Quinn Patton.
University of Wisconsin - Extension, Cooperative Extension, Program Development and Evaluation Unit 3: Engaging stakeholders.
Research Methods for the Social Sciences: Ethics Ryan J. Martin, Ph.D. Thomas N. Cummings Research Fellow March 9, 2010.
Working with 4-H Club Members and Officers. OBJECTIVE Identify 3 ways youth can develop life skills as a 4-H club member.
1 © 2009 University of Wisconsin-Extension, Cooperative Extension, Program Development and Evaluation Getting started with evaluation.
“Walking Through the Steps and Standards” Presented by: Tom Chapel Focus On…
1: Marketing Research for Decision Making. 1-2 Copyright © 2008 by the McGraw-Hill Companies, Inc. All rights reserved. Hair/Wolfinbarger/Ortinau/Bush,
Orienting Extension Faculty that are Volunteer Administrators.
United Advocates for Children of California 1401 El Camino Avenue, Suite 340 Sacramento, CA (916) direct  (866) toll free.
Chapter 13 Program Evaluation and Technology Integration Strategies.
1 Adopting and Implementing a Shared Core Practice Framework A Briefing/Discussion Objectives: Provide a brief overview and context for: Practice Models.
Assoc. Prof. Dr. Wongsa Laohasiriwong Faculty of Public Health, Khon Kaen University Planning for Measurement, Monitoring and Evaluation the Reform 1.
Too expensive Too complicated Too time consuming.
Program Evaluation EDL 832 Jeffrey Oescher, Instructor 6 June 2013.
Fundamentals of Evaluation for Public Health Programs ROBERT FOLEY, M.ED. NIHB TRIBAL PUBLIC HEALTH SUMMIT MARCH 31,
Mission The faculty and staff of Pittman Elementary School are committed to providing every student with adequate time, effective teaching, and a positive.
Making a Difference Through Program Evaluation Michael Quinn Patton September 21, 2010 Program Evaluation Quality Assurance Summit 1.
E. D. Bell.  Kapp & Anderson (2010) argue that the program evaluation process has eight steps that are fluid, dynamic, and interdependent, i.e., they.
Monitoring & Evaluation Presentation for Technical Assistance Unit, National Treasury 19 August 2004 Fia van Rensburg.
EVALUATION THEORY AND MODEL Theory and model should have symbiotic relationship with practice Theory and model should have symbiotic relationship with.
AES PROFESSIONAL LEARNING COMMITTEE DAVID EARLE MARGARET MACDONALD RITA PERKINS PAUL CHESTERTON RICK CUMMINGS Core Knowledge and Skills for Evaluators.
EXtension Evaluation Community of Practice Plan of Work.
The Major Steps of a Public Health Evaluation 1. Engage Stakeholders 2. Describe the program 3. Focus on the evaluation design 4. Gather credible evidence.
BUILDING A PROFESSIONAL LEARNING COMMUNITY Adapted from "Professional Learning Communities at Work"- Richard and Rebecca Dufour and Robert Eaker Delsea.
1 © 2009 University of Wisconsin-Extension, Cooperative Extension, Program Development and Evaluation Planning your evaluation This presentation provides.
Program Evaluation Planning Taylor-Powell, E., Steele, S., & Douglah, M. (1996). Planning a program evaluation. Retrieved from University of Wisconsin-Extension-Cooperative.
25 January 2016 MONITORING & EVALUATION OF HIV & AIDS PROGRAMS - FEBRUARY 2011 DEVELOPING M & E PLANS by DR DC TSHIBANGU.
Session VI Evaluation & Wrap Up. Evaluation Activities directed at collecting, analyzing, interpreting, and communicating information about the effectiveness.
S519: Evaluation of Information Systems Understanding Evaluation Ch1+2.
Midwest Child Welfare Implementation Center MCWIC Purpose Our purpose is to facilitate the implementation of systemic change to improve outcomes for children.
Data Driven Planning and Decision-making for Continuous School Improvement: Developing a Program Evaluation Plan Leadership for Innovative Omani Schools.
Erik Augustson, PhD, National Cancer Institute Susan Zbikowski, PhD, Alere Wellbeing Evaluation.
National Research and Development Centre for Welfare and Health Knowledge for welfare and healthKyiv March 22, Round Table on Discussion of the Project.
Step One: Research Problem, Question & Hypothesis.
ASK STANDARDS Assessment and Accountability CNS 610 Written & Narrated by: Kelcie Dixon Western Kentucky University.
.  Evaluators are not only faced with methodological challenges but also ethical challenges on a daily basis.
AES 2010 Kate McKegg, Nan Wehipeihana, Jane Davidson.
Facilitator: Angela Kapp Authentic Assessment Session 1 Session 1 Level 2 Minnesota Department of Human Services.
Evaluating the Quality and Impact of Community Benefit Programs
The Assessment Process: A Continuous Cycle
Towards child and family oriented and preventive services
MaryCatherine Jones, MPH, Public Health Consultant, CVH Team
Data is your friend: how to incorporate evaluation into your research
Public Health Interventions
EVALUATION THEORY AND MODEL
Business Retention and Expansion
Elements of evaluation quality: questions, answers, and resources
Evaluation Research Defined as the process of making judgments about the merits, value, or worth of any component of education. (e.g. best text books to.
Presentation transcript:

University of Wisconsin - Extension, Cooperative Extension, Program Development and Evaluation Unit 2: Developing an evaluation plan

University of Wisconsin - Extension, Cooperative Extension, Program Development and Evaluation An evaluation plan is your roadmap

University of Wisconsin - Extension, Cooperative Extension, Program Development and Evaluation Core steps in program evaluation

University of Wisconsin - Extension, Cooperative Extension, Program Development and Evaluation Planning… “The more attention you give to planning the evaluation, the more effective it will be.” −The Program Manager’s Guide to Evaluation, 2003 Source: Administration on Children, Youth and Families. (2003). What is program evaluation? In The program manager’s guide to evaluation (Chapter 2). Washington, D.C.: U.S. Department of Health and Human Services, Administration for Children and Families, Office of Planning, Research and Evaluation. Retrieved on October 15, 2007, from

University of Wisconsin - Extension, Cooperative Extension, Program Development and Evaluation Regardless of the particular format, evaluation planning includes the following key steps:

University of Wisconsin - Extension, Cooperative Extension, Program Development and Evaluation Step 1 Engaging stakeholders Who should be involved in helping to define and implement the evaluation?

University of Wisconsin - Extension, Cooperative Extension, Program Development and Evaluation Step 2 Focusing the evaluation What do you want to know? What is the purpose of your evaluation? Who will use the information? How will they use it? What questions will the evaluation seek to answer?

University of Wisconsin - Extension, Cooperative Extension, Program Development and Evaluation Step 3 Collecting information How will you collect the information? From whom Methods of data collection

University of Wisconsin - Extension, Cooperative Extension, Program Development and Evaluation Step 4 Analyzing and interpreting What sense do you make of the information collected?

University of Wisconsin - Extension, Cooperative Extension, Program Development and Evaluation Step 5 Using the information How will you report, use, and learn from the findings?

University of Wisconsin - Extension, Cooperative Extension, Program Development and Evaluation Management plan Human subjects protection Timeline Responsibilities Budget

University of Wisconsin - Extension, Cooperative Extension, Program Development and Evaluation Our plan for human subjects protection Actions we will take Who is responsible By when Resources needed

University of Wisconsin - Extension, Cooperative Extension, Program Development and Evaluation Culturally competent evaluation What does it mean to be culturally competent when evaluating outcomes? If you say that you are a culturally competent evaluator, what knowledge or skills should you possess? Why should you care about culture?

University of Wisconsin - Extension, Cooperative Extension, Program Development and Evaluation Evaluation standards Utility Serves information needs of intended users Feasibility Realistic, prudent, diplomatic, frugal Propriety Legal, ethical, due regard to welfare Accuracy Reveals and conveys technically accurate information

University of Wisconsin - Extension, Cooperative Extension, Program Development and Evaluation Guiding principles for evaluators Systematic inquiry Competence Integrity/honesty Respect for people Responsibilities for general and public welfare