CONTEXT Major International Evaluations Niels Dabelstein.

Slides:



Advertisements
Similar presentations
Using the CDC Evaluation Fwork to Avoid Minefields on the Road to Good Evaluation Presented to: 2002 National Asthma Conference October 24, 2002 By: Thomas.
Advertisements

Good Evaluation. Good Evaluation Should … be simple be fair be purposeful be related to the curriculum assess skills & strategies set priorities use multiple.
ENTITIES FOR A UN SYSTEM EVALUATION FRAMEWORK 17th MEETING OF SENIOR FELLOWSHIP OFFICERS OF THE UNITED NATIONS SYSTEM AND HOST COUNTRY AGENCIES BY DAVIDE.
Introduction to Monitoring and Evaluation
How to Engage Parliamentarians in Development Evaluation Training for VOPEs, Government Policy Makers and Evaluation Professionals Parliamentarians Forum.
Johns Hopkins University School of Education Johns Hopkins University Evaluation Overview.
METAEVALUATION An Overview (dls 8/30/11). Key Questions  1. What is the essence of metaevaluation?  2. Why is metaevaluation important?  3, What are.
Measuring Value: Using Program Evaluation to Understand What’s Working -- Or Isn’t Juliana M. Blome, Ph.D. , MPH Office of Program Analysis and Evaluation.
What You Will Learn From These Sessions
Core principles in the ASX CGC document. Which one do you think is the most important and least important? Presented by Casey Chan Ethics Governance &
What is Evaluation? David Dwayne Williams Brigham Young University
Program Evaluation and Measurement Janet Myers. Objectives for today… To define and explain concepts and terms used in program evaluation. To understand.
Program Evaluation Essentials. WHAT is Program Evaluation?
 Systematic determination of the quality or value of something (Scriven, 1991)  What can we evaluate?  Projects, programs, or organizations  Personnel.
Testing a Strategic Evaluation Framework for Incrementally Building Evaluation Capacity in a Federal R&D Program 27 th Annual Conference of the American.
INVITATIONAL PRACTICUM IN METAEVALUATION Session 6, 10/13/11 (Dan) 1.India’s Education Capacity Building Program & its evaluation 2.DLS metaevaluation.
INVITATIONAL PRACTICUM IN METAEVALUATION Session 2 9/15/11 GAO & Joint Committee Standards DLS 9/13/11 1.
Decision-Making and Strategic Information Workshop on M&E of PHN Programs July 24-August 11, 2006 Addis Ababa.
5-1 McGraw-Hill/Irwin ©2002 by The McGraw-Hill Companies, Inc. All rights reserved. Chapter 5 Audit Planning.
Objectives for Session Nine Observation Techniques Participatory Methods in Tanzania Hand back memos.
Designing Influential Evaluations Session 2 Topics & Timing Uganda Evaluation Week - Pre-Conference Workshop 19 th and 20 th May 2014.
Michael Quinn Patton MESI 2014
1 © 2009 University of Wisconsin-Extension, Cooperative Extension, Program Development and Evaluation Getting started with evaluation.
“Walking Through the Steps and Standards” Presented by: Tom Chapel Focus On…
University of Wisconsin - Extension, Cooperative Extension, Program Development and Evaluation Unit 2: Developing an evaluation plan.
Page 0 Agency Approaches to Managing for Development Results Why Results? What Results? Key Challenges, lessons learnt Core principles and draft action.
Program Evaluation EDL 832 Jeffrey Oescher, Instructor 6 June 2013.
Joint Committee on Standards for Educational Evaluation Evaluation Standards Joan Kruger Spring 2008.
SYNTHESIS PARTNERS GROUP. Opportunities / Strengths Solid relationship based on a long history (>10 years) Trust do exist (what’s its level?) Very successful.
Evaluation Collaboration: Opportunities and Challenges Michael Quinn Patton Utilization-Focused Evaluation 19 May, 2010 Evaluating the Haiti Response:
Making a Difference Through Program Evaluation Michael Quinn Patton September 21, 2010 Program Evaluation Quality Assurance Summit 1.
Monitoring & Evaluation Presentation for Technical Assistance Unit, National Treasury 19 August 2004 Fia van Rensburg.
EVALUATION THEORY AND MODEL Theory and model should have symbiotic relationship with practice Theory and model should have symbiotic relationship with.
Neal D. Kohatsu, MD, MPH Medical Director May 17, 2012 Evaluation and Quality Improvement.
Presented by CIDA on behalf of the Task Team on Multilateral Effectiveness.
PUBLIC EXPENDITURE AND FINANCIAL ACCOUNTABILITY (PEFA)-PERFORMANCE MEASUREMENT FRAMEWORK Module 4: The Assessment Process, Stakeholders Involvement & Quality.
IPDET 2015 WHAT IS EVALUATION? Robert Picciotto King’s College, London "There are no facts, only interpretations“ Friedrich Nietzsche 1.
Copyright © 2014 by The University of Kansas A Framework for Program Evaluation.
CES 20th Annual Conference Keun-bok Kang (CNU) & Chan-goo Yi (ETRI) ; Taejon, Korea A DESIGN OF THE METAEVALUATION MODEL A DESIGN OF THE METAEVALUATION.
© 2002, CARE USA. All rights reserved. Applying Quality Standards in Impact Evaluation: Case of CARE Program Quality Framework and Evaluation Policy Ahmed.
Program Evaluation Planning Taylor-Powell, E., Steele, S., & Douglah, M. (1996). Planning a program evaluation. Retrieved from University of Wisconsin-Extension-Cooperative.
Session VI Evaluation & Wrap Up. Evaluation Activities directed at collecting, analyzing, interpreting, and communicating information about the effectiveness.
1 Evaluation Utilization: the case of the Paris Evaluation (Phase 1) and its use in the Accra HLF3 process Paris Evaluation Phase 2 Planning Meeting, Feb.
S519: Evaluation of Information Systems Understanding Evaluation Ch1+2.
Making Evaluation Work for Effective Policy Reform and Revision Chris Nelson, Director, Quality and Performance Systems Branch Sophie Davies, Manager Evaluations.
Data Driven Planning and Decision-making for Continuous School Improvement: Developing a Program Evaluation Plan Leadership for Innovative Omani Schools.
.  Evaluators are not only faced with methodological challenges but also ethical challenges on a daily basis.
AES 2010 Kate McKegg, Nan Wehipeihana, Jane Davidson.
THE PARIS DECLARATION and DAC EVALUATION QUALITY STANDARDS Task Team on New Context for Development Evaluation DAC EQS Workshop, Auckland, 10 February.
1 Evaluation of the Paris Declaration Organising the Evaluation AEA 2011 Niels Dabelstein Head, PD Evaluation Secretariat.
New Directions in Community Strengthening LCSA Conference September 2011 Sue Leahy.
Country Level Programs
Module 1: Introducing Development Evaluation
Undervaluing Evaluation and Evaluators: The Case of the Federal 21st Century Community Learning Centers Program in Texas American Evaluation Association.
Essay Advice – Y12 American War for Independence
Undervaluing Evaluation and Evaluators: The Case of the Federal 21st Century Community Learning Centers Program in Texas American Evaluation Association.
Chapter- 5.
Country-led Development Evaluation The Donor Role in Supporting Partner Ownership and Capacity Mr. Hans Lundgren March 2009.
Walking talking mock Friday 17th November.
Complexity and Evaluation Report Out
Data is your friend: how to incorporate evaluation into your research
BTEC National HSC L3 Lesson 4.
EVALUATION THEORY AND MODEL
A Framework for Program Evaluation
Safeguarding development results – the role of independent evaluation
EVALUATIONS in the EU External Aid
Seven Utilization Lessons
how to do research in college: ENGL | Prof. Chelsea Whitton
Elements of evaluation quality: questions, answers, and resources
Evaluation Research Defined as the process of making judgments about the merits, value, or worth of any component of education. (e.g. best text books to.
Presentation transcript:

CONTEXT Major International Evaluations Niels Dabelstein

Aboutthis bookAboutthis book Preview this bookPreview this book Shake Hands with the Devil By Roméo DallaireShake Hands with the Devil By Roméo Dallaire This is a preview. The total pages displayed will be limited. LL Loading... Loading... Speaking Truth to Power Award

Joint Committee Evaluation Standards, 2010  Utility – ensure relevance & use  Feasibility – realistic, prudent, diplomatic & frugal  Propriety – ethical, legal, respectful  Accuracy – technically adequate to determine merit or worth  Accountability – Evaluating evaluations: Meta-evaluation 6

AUDIT STATEMENT in the FINAL REPORT

ILLUMINATIVE TENSIONS & IMPORTANT LESSONS

ILLUSTRATIVE EVALUATION TENSIONS 1. The classic tension between stakeholder involvement and evaluator independence. 2. The tension between strength of evidence and delivering the findings on time. 3. The tensions between country-level ownership and utility versus the need for an international synthesis.

Tension # 2 The tension between strength of evidence and delivering the findings on time.

A Balancing Act: Strength of Evidence vs. Timeliness 13 On Time RIGOR

Tension # 3 The tensions between country-level ownership and utility versus the need for an international synthesis.

ILLUSTRATIVE LESSONS 1.The implications of being driven by attention to use, in this case, at the 4th High Level Forum.

BEING UTILIZATION-FOCUSED

18 “ I can honestly say that not a day goes by when we don’t use those evaluations in one way or another.” Written by Mark M. Rogers and illustrated by Lawson Sworh

ILLUSTRATIVE LESSONS 2. The relevance of the DAC standards for guiding the PDE and for the meta- evaluation. 3. The impacts of being involved in the evaluation process for those countries, donors, and participants involved (process use).

Michael Quinn Patton July 1, 2011 IPDET