Improving Lives through Impact Evaluation Dr. Jyotsna (Jo) Puri Head of Evaluation Deputy Executive Director, 3ie Presentation at the IEO Inauguration.

Slides:



Advertisements
Similar presentations
ClimDev-Africa Program & African Climate Policy Center (ACPC)
Advertisements

Module 9 – The Contributions of Program Evaluation to Poverty Reduction.
Diseases without borders What must the Global Development Community Do? World Bank Seminar Series Tawhid Nawaz, Operations Advisor Human Development Network.
Elif İŞLEK Nurse,Health Management MSc. School of Public Health Turkish Ministry of Health STRATEGIC PLANNING ON HUMAN RESOURCES FOR HEALTH IN TURKEY ( )
1 Water and Health In Africa Dr. Narciso Matos, Executive Director, Foundation for Community Development, Mozambique Keynote address at the Third Annual.
Who is the subject in a CRT? Rachel Glennerster Executive Director, J-PAL Department of Economics, MIT PRIM&R November 8, 2013.
The impact of human resource management on health systems
Doris Duke Charitable Foundation African Health Initiative.
Incorporating considerations about equity in policy briefs What factors are likely to be associated with disadvantage? Are there plausible reasons for.
HEALTH services MMU & Health Camps. Evolution of new concepts MMU +MMU ++ ~ 2008 MMU Health Camps Transition Phase of MMU programme.
NATIONAL DISASTER RECOVERY FRAMEWORK INDIA ANNUAL CONFERENCE OF RELIEF COMISSIONERS VIGYAN BHAVAN, NEW DELHI 27 MAY 2014 MINISTRY OF HOME AFFAIRS, GOVERNMENT.
Logic Models for Obesity, Nutrition and Community Health February 2007.
Making Impact Evaluations Happen World Bank Operational Experience 6 th European Conference on Evaluation of Cohesion Policy 30 November 2009 Warsaw Joost.
HOUSEHOLD SURVEYS IN POVERTY MONITORING AND ANALYSIS, A CASE OF UGANDA By James W. Mubiru, Deputy Executive Director & Johnson L. Kagugube, Principal Statistician.
UNC-India Summit Partnership Models: Health and Medical Models Rohit Ramaswamy, PhD, MPH Gillings School of Global Public Health.
THE STATE OF INDIA’S PUBLIC SERVICES BENCHMARKS FOR THE NEW MILLENNIUM PAC April 17, 2002.
Moving towards the goal of Universal Health Coverage (UHC) in Bangladesh Md. Ashadul Islam Director General Health Economics Unit Ministry of Health and.
Dr Dirk Willem te Velde – Director SET and Head of International Economic Development Group, ODI 28 / 4 / 2015 THE ROLE OF SERVICES IN ECONOMIC TRANSFORMATION.
Importance of Health Information Systems Information explosion during 1990s  It is estimated that in the next 50 years, the amount of knowledge currently.
Presentation on Managing for Development Results in Zambia By A. Musunga Director M&E MOFNP - Zambia.
Moving Services to the Community: Shifting the PMTCT/MCH Integration Debate Laura A. Guay MD Elizabeth Glaser Pediatric AIDS Foundation George Washington.
Priority Setting for Health Research Adnan A. Hyder, MD MPH PhD Department of International Health Bloomberg School of Public Health Johns Hopkins University,
What do we know about improving health in Punjab? And some lessons from India Dr. Jeffrey Hammer Princeton University IGC – CDPR Seminar, Islamabad February.
Ariel Fiszbein, HD Chief Economist April 29, 2010 Measuring Governance: Actionable Governance Indicators in HD 1.
Country Plan of Action NEPAL Prof. Prakash S. Shrestha President Nepal Breastfeeding Promotion Forum (NEBPROF)
The impact of public involvement Sarah Buckland Director INVOLVE
FINANCIAL OPTIONS FOR TB CONTROL IN MONGOLIA
District Health in South Africa Appropriate response to current health issues: How do we measure? Dr Kebogile Mokwena Department of Social and Behavioural.
Health Care Sector in India: Some Key Issues VR Muraleedharan Dept of Humanities and Social Sciences Indian Institute of Technology Madras
Session 1 - Public Health; Past Present & Future.
Using Longitudinal Data for Evaluating Policy Changes and Other Interventions -Information system in Tamilnadu Medical Services Corporation.
1 Webinar: Challenges in Clinical Training Ben Wallace, Executive Director, Clinical Training Reform Health Workforce Australia.
Svetlana Spassova, MD Ministry of Health, Bulgaria Chisinau
Components of a national drug prevention system Ms. UNODC.
Rapid Evidence Assessments and Evidence Gap Maps
Towards monitoring health equity, based on routine data in Iran Ardeshir Khosravi PhD, Iranian MOH&ME.
Kitakyushu Initiative for a Clean Environment: Capacity Building for Urban Air Quality Management Mushtaq Ahmed Memon and Hidefumi IMURA 3 rd Thematic.
GENDER SPECIFICITY AND GENDER BUDGETING IN BULGARIA: SOCIO AND ECONOMIC ASPECTS GENDER SPECIFICITY AND GENDER BUDGETING IN BULGARIA: SOCIO AND ECONOMIC.
The National Water and Sanitation Coordination Committee KIRIBATI.
Health Education Specialists in Health Sector Evolution: A missed Role Mohsen Shams, MD, PhD Health Education Specialist Yasuj University of Medical Sciences.
Why Every American Should Care About the Future of Rural Water Challenges and Opportunities Agricultural Outlook Forum 2012 U.S. Department of Agriculture.
AmeriCorps Grantee Training Evaluation and Research September 11, 2014.
Copyright © 2009 Elsevier Canada, a division of Reed Elsevier Canada, Ltd. The Role of Research in Nursing Chapter 1.
NEGOTIATIONS ON SERVICES NEGOTIATIONS ON SERVICES Commercial Diplomacy Programme &TrainForTrade.
Africa Impact Evaluation Program on AIDS (AIM-AIDS) Cape Town, South Africa March 8 – 13, Steps in Implementing an Impact Evaluation Nandini Krishnan.
A Long Enough Lever*: Drivers for Change in the WASH System Louis Boorstin | Osprey Foundation * With apologies to Archimedes UNC Water and Health Conference.
Chapter V. RURAL DEVELOPMENT Ing. Barbora Milotová, PhD. Department of Regional Development
ELEMENTS OF STRATEGY FOR ACHIEVING SOCIAL PROTECTION FLOOR Global Network, Cape Town 7 December 2012 BY AFRICAN LABOUR RESEARCH NETWORK (ALRN)
Philip Davies What Are Systematic Reviews, And Why Do We Need Them? Philip Davies International Initiative for Impact Evaluation [3ie]
Medicines use in primary care in developing and transitional countries Results from studies reported between Kathleen Holloway, Verica Ivanovska,
Multimordibity: Setting a framework from practices Mieke Rijken NIVEL, NL Graziano Onder AIFA, IT 3 rd Stakeholders Forum JA-CHRODIS 4 th February 2016.
The EU Water Initiative and the EU ACP Facility New Instruments to promote sustainable development of water resources and affordable access Antonio Garcia-Fragio.
Global Scaling-Up Sanitation Project Water and Sanitation Program 5 th World Water Forum Istanbul Jae So Manager Water and Sanitation Program (WSP)
CONSTRAINTS TO PRIMARY HEALTH CARE DELIVERY THE GOVERNMENT OBJECTIVES FOR DELIVERING PHC SERVICES To increase accessibility to quality health care services.
SPECIAL SESSION COUNTDOWN TO 2015 IN ETHIOPIA SIX BUILDING BLOCKS OF THE HEALTH SYSTEM: PROGRESS TOWARDS THE INTEGRATION IN ETHIOPIA Dereje Mamo Tsegaye.
Medicines use in children under 5 years primary care in developing and transitional countries Results from studies reported between Kathleen.
Country Plan of Action Name of the Country: Nepal.
Improving maternal and newborn health in tribal communities in Jharkhand and Orissa, India An evaluation of the impact of participatory community groups.
"Learning and achievements of SWA Global platform and its relevance to achieving Hygiene and Sanitation Development in India" India WASH Summit 17 th February.
Developing coherence mechanisms (ERDF/EARDF) in Poland Andrzej Hałasiewicz, PhD Nicolaus Copernicus University in Torun Foundation of Assistance Programmes.
Delivering Global Goals in human settlements and city regions by 2030 with data partnerships #roadmap rd May 2016 WMO, Geneva Stephen Passmore Head.
An example of a partnership is the Commonwealth Health Professions Alliance of which the CNF is a founding member. The CHPA is an alliance of Commonwealth.
i2i turning development around
Sudan’s Health Sector Reform; addressing the SDGs
EVALUATION IN THE PUBLIC SECTOR
Presenter: Beverly Reynolds, DPM, Health Sector Development
Lecture 9: PHC As a Strategy For HP Dr J. Sitali
CARIAA Country Reviews: Methodology and outcomes
Vinod Thomas and Xubei Luo Independent Evaluation Group Paris
Teodora Brandmuller Head of Section – Regional and urban statistics
Presentation transcript:

Improving Lives through Impact Evaluation Dr. Jyotsna (Jo) Puri Head of Evaluation Deputy Executive Director, 3ie Presentation at the IEO Inauguration 26 th of February 2014

Outline State of evidence Quality of evidence What role for IEO?

STATE OF EVIDENCE

Global Evidence: Where are we?

Where are most IEs happening

In what sectors are IEs happening Large number of IEs: Health Education Social Protection Agriculture Missing sectors: Economic Policy Private Sector Development Water and sanitation Energy & Environment Transportation and Urban development

Sectoral distribution of 3ie funded studies in India Pattern of missing evidence is similar to the global database. Missing evidence: Governance and delivery (PDS!) Financial and rural development Environment

INFLUENCING POLICY

Statistical Meta-Analytical Reviews - An Example Source: David B. Wilson, 2006, A systematic review of drug court effects on recidivism Systematic reviews (& meta-analyses) can help understand build consolidate this evidence. Leapfrog learning!

Systematic Reviews

Regional distribution of 3ie funded studies in India Several states (Chhatisgarh, Punjab, Uttar Pradesh) North-east ignored completely. India-wide impact evaluations? Systematic reviews?

QUALITY OF EVIDENCE

Criteria for quality Internal validity – Process monitoring – Theory of change – Identification design – Power analysis – Spillovers – Findings based on research External validity – Heterogeneity (sub-group analysis) Humanitarian assistance Since $90 Billion spent. Only 39 impact evaluations Quality of impact evaluations: -29 HAD a theory of change. But -23 did not have any balance tests (bw comparison and treatment groups) -29 did not have any power analysis (for sample size) -All used experimental or quasi- experimental methods. -Only 5 discuss ethical concerns.

INGO and Govt. 11.2% RESEARCH ORGANIZATION (76%) NGO (14%) Evidence-based policy makers – where art thou?? Who demands evaluations?

WHAT CAN IEO DO?

1. Data India quite good Geographic information systems?

2. Process evaluations Implementation research and operational research…. What works! Use experimental methods to understand the science of delivery. Maldives Community health workers vs. Nurses vs. Doctors to achieve primary health care objectives. India: Business correspondents vs. electronic delivery

3. Standards for evidence Overall framework – how can we move from IEs being ad hoc to them being part of the system? Internal validity standards Overall no impact on maternal mortality of community based interventions (power) Significant impact of community based interventions on neo-natal mortality.

4. Cost effectiveness studies 5. Collating evidence Cost effectiveness Systematic reviews

Thank you. 20

Feedback: Privacy Policy Feedback
Do Not Sell My Personal Information
About project: SlidePlayer Terms of Service

© 2025 SlidePlayer.com. Inc. All rights reserved.