Coordinator, Ghana Monitoring and Evaluation Forum (GMEF)

Slides:



Advertisements
Similar presentations
Leveraging inter-sectoral action to address the social determinants of health: view from the health system Lucy Gilson University of Cape Town; London.
Advertisements

ENTITIES FOR A UN SYSTEM EVALUATION FRAMEWORK 17th MEETING OF SENIOR FELLOWSHIP OFFICERS OF THE UNITED NATIONS SYSTEM AND HOST COUNTRY AGENCIES BY DAVIDE.
Intelligence Step 5 - Capacity Analysis Capacity Analysis Without capacity, the most innovative and brilliant interventions will not be implemented, wont.
Improving how your organisation supports the use of research evidence to inform policymaking.
Monitoring and Evaluation in the CSO Sector in Ghana
Good Evaluation Planning – and why this matters Presentation by Elliot Stern to Evaluation Network Meeting January 16 th 2015.
Project Monitoring Evaluation and Assessment
National Evaluation and Results Management System– Sinergia – Two decades of lessons and experiences Directorate of Monitoring and Evaluation of Public.
Global Poverty Action Fund Community Partnership Window Funding Seminar January 2014 Global Poverty Action Fund Community Partnership Window Funding Seminar.
Dissemination pathways Science and policy
Australia’s Experience in Utilising Performance Information in Budget and Management Processes Mathew Fox Assistant Secretary, Budget Coordination Branch.
Health Systems and the Cycle of Health System Reform
Standards and Guidelines for Quality Assurance in the European
Critical Thinking: Using Reflection Friday, 21 st November 2008.
1 Hsin Chu, August 2012 Regulatory Impact Assessment Charles-Henri Montin, Senior Regulatory Expert, Ministry of economy and finance, Paris
Copyright 2010, The World Bank Group. All Rights Reserved. Planning and programming Planning and prioritizing Part 1 Strengthening Statistics Produced.
CRPD: Research Rosemary Kayess Social Policy Research Centre UNSW.
S7: Audit Planning. Session Objectives To explain the need for planning To explain the need for planning To outline the essential elements of planning.
Potential Roles for Health Technology Assessment Agencies: Opportunities and Challenges for an Effective Health Technology Assessment Practice at the Meso.
Sub-Regional Workshop for GEF Focal Points in West and Central Africa Accra, Ghana, 9-11 July 2009 Tracking National Portfolios and Assessing Results.
United States Department of Agriculture Food Safety and Inspection Service 1 National Advisory Committee on Meat and Poultry Inspection August 8-9, 2007.
Audit Planning. Session Objectives To explain the need for planning To outline the essential elements of planning process To finalise the audit approach.
8 TH -11 TH NOVEMBER, 2010 UN Complex, Nairobi, Kenya MEETING OUTCOMES David Smith, Manager PEI Africa.
Systematic reviews to support public policy: An overview Jeff Valentine University of Louisville AfrEA – NONIE – 3ie Cairo.
UKPopNet Workshop 1 Undertaking a Systematic Review Andrew S. Pullin Centre for Evidence-Based Conservation University of Birmingham, UK.
Graduate studies - Master of Pharmacy (MPharm) 1 st and 2 nd cycle integrated, 5 yrs, 10 semesters, 300 ECTS-credits 1 Integrated master's degrees qualifications.
Philip Davies What Is Evidence, and How Can It Improve Decision Making? Philip Davies International Initiative for Impact Evaluation.
Consultant Advance Research Team. Outline UNDERSTANDING M&E DATA NEEDS PEOPLE, PARTNERSHIP AND PLANNING 1.Organizational structures with HIV M&E functions.
Provincial M&E Forum 18 August 2011 The Presidency Department of Performance Monitoring and Evaluation Draft National Evaluation Policy Framework.
Kathy Corbiere Service Delivery and Performance Commission
ELEMENTS OF STRATEGY FOR ACHIEVING SOCIAL PROTECTION FLOOR Global Network, Cape Town 7 December 2012 BY AFRICAN LABOUR RESEARCH NETWORK (ALRN)
HIGHLIGHTS OF THE NATIONAL STRATEGIES FOR SUSTAINABLE DEVELOPMENT REPORT IN AFRICA A Presentation At the Workshop on Strengthening Planning and Implementation.
11/10/28. Role of Parliamentarians in Climate Change Climate change is a development issue: it causes poverty, affects food security and has a severe.
Implementation Science: Finding Common Ground and Perspectives Laura Reichenbach, Evidence Project, Population Council International Conference on Family.
By Dr. Talat AnwarAdvisor Centre for Policy Studies, CIIT, Islamabad Centre for Policy Studies, CIIT, Islamabad
Systematic Reviews of Evidence Introduction & Applications AEA 2014 Claire Morgan Senior Research Associate, WestEd.
Project: EaP countries cooperation for promoting quality assurance in higher education Maria Stratan European Institute for Political Studies of Moldova.
Renewing our focus on Impact Becky Murray Nairobi, 15 March 2016 Twitter: #impactafrica.
Monitoring and Evaluating Rural Advisory Services
Building evaluation in the Department of Immigration and Citizenship
Evaluation: For Whom and for What?
Monitoring and Evaluation Systems for NARS Organisations in Papua New Guinea Day 3. Session 9. Periodic data collection methods.
Public Policy Process Ghanashyam Bhattarai
Capacity building in the Maths4Stats project
Evidence-based Medicine
Ian Goldman Head: Evaluation and Research AEA, 17 October 2012
Clinical Studies Continuum
BUMP IT UP STRATEGY in NSW Public Schools
Technical assistance strategies to improve expenditure estimates and price deflators Joseph Mariasingham Economic Research and Regional Cooperation Department.
HEALTH IN POLICIES TRAINING
Programme Review Dhaya Naidoo Director: Quality Promotion
The Nature of Qualitative Research
“CareerGuide for Schools”
Developing culturally responsive and gender transformative evaluation curriculum: Reflections on South to South collaboration Madri Jansen van Rensburg,
Translating political objectives into sound policy proposals
Background to The Conference
Public Sector Modernisation How do governments learn?
A Focus on Outcomes and Impact
Assessment of Quality in Statistics GLOBAL ASSESSMENTS, PEER REVIEWS AND SECTOR REVIEWS IN THE ENLARGEMENT AND ENP COUNTRIES Mirela Kadic, Project Manager.
Public Policy Process Ghanashyam Bhattarai
Meeting Outcomes “Building International Partnership To Enhance Science Based Ecosystem Approaches In Support Of Regional Ocean Governance” November.
Standard for Teachers’ Professional Development July 2016
What are systematic reviews and why do we need them?
Strategic Research Advice Rationale
Department of Planning Monitoring and Evaluation
Internal and External Quality Assurance Systems for Cycle 3 (Doctoral) programmes "PROMOTING INTERNATIONALIZATION OF RESEARCH THROUGH ESTABLISHMENT AND.
Meta-analysis, systematic reviews and research syntheses
Integrating Gender into Rural Development M&E in Projects and Programs
The Contribution of Civil Society-generated Evidence to the Improvement of Sanitation Services in Ghana ICED Evidence to Action 2019 Conference Panel on.
Presentation transcript:

Coordinator, Ghana Monitoring and Evaluation Forum (GMEF) “Evidence-based Policy-making and Implementation” (EBPM&I Course) University Of Cape Town, Graduate School Of Development Policy And Practice Cape Town, South Africa, October 24 to 26, 2016 Presented by, Dede Bedu-Addo  Coordinator, Ghana Monitoring and Evaluation Forum (GMEF)

Background Executive course for strategic leaders and top managers in the public service. Designed to assist participants to use evidence to make well informed decisions about policies, programmes, projects and services and to improve government’s impact on society. GMEF and NDPC were sponsored by The Centre for Learning on Evaluation and Results (CLEAR) Anglophone Africa As part of the Twende Mbele project, a collaborative effort between the governments of Uganda, Benin, and South Africa to strengthen national evaluation systems through peer learning and collaboration.

Rationale Increasing pressure on policy makers to: develop more effective policies and direct and manage resources in more focused and efficient ways resulting in improved implementation and outcomes Recently, evidence-based policy-making is an increasingly prevalent approach. Better policies and better decision-making results are based on sound empirical evidence and solid rational analysis. Also critical to use evidence to improve implementation. Evidence-Based Policy-Making and Implementation (EBPM&I) focuses on establishing rigorously, objective evidence as a key informant of policy, but also for improving implementation of public services.

Course Objectives Participants gain: An understanding of the factors that influence policy and implementation processes and the difference between evidence and opinion An understanding of the reason for, and the method of constructing, a theory of change An understanding of how the use of evidence can improve the performance of leaders and departments as well as the implementation and impact of policies An opportunity to reflect on existing policy-making and management processes, their strengths and limitations An understanding of tools for evidence-based policy-making and implementation An understanding of the role of evidence in managing political and other influences on the policy and implementation process.

Definition of Evidence-based policy-making Evidence-based policy-making (EBPM) helps policy makers and providers of services make better decisions, and achieve better outcomes, by drawing upon the best available evidence from research, evaluations and other sources. “This approach stands in contrast to opinion-based policy, which relies heavily on either the selective use of evidence (e.g. on single studies irrespective of quality) or on the untested views of individuals or groups, often inspired by ideological standpoints, prejudices, or speculative conjecture.” (Segone 2004:27)

Evidence is Used to Understand A Problem (Its nature, size, dynamics) and to determine what works to address this - what interventions are effective? - what interventions work best to achieve specific outcomes? (and what interventions do not work?) - for which groups of people? - under what conditions? - with which modes of delivery/implementation? - over what time frame? - with what costs?

Opinion and evidence in policymaking and implementation

Evidence vrs Opinion Evidence: •Data that meet the standards of internal validity and external validity •Key qualities: independence, objective, verifiable Opinion: •Statements and claims that do not meet the standards of evidence •Key qualities: subjective, partial (selective), hard to verify

Policy is derived from …

How Do We Guard Against Inadequate Evidence? Evidence may not be complete or perfect—need a broad range of good quality evidence Evidence is often contested, so its important to understand the evidence and what its significance is Evidence may be limited e.g. it is context specific Its important to be able to distinguish between good and poor quality and to be able to weigh the balance of evidence

Different Types Of Evidence Expert knowledge Beneficiary consultations Published research Costings of policy options Other research Performance expenditure reviews Stakeholder consultations Economic and statistical modelling Policy and programme evaluations Research synthesis including systematic reviews Administrative data analysis

Quality of Evidence Internal Validity: Has the evidence scientific credibility? i.e. the extent to which the design and conduct of the study/report eliminates the possibility of bias Is the sample size adequate to detect the ‘true’ situation? If comparisons are being made, are the two groups truly comparable? Is there evidence of bias, e.g.: Selection bias? Attrition bias? Performance bias? Reporting bias?

Quality of Evidence External Validity: Does the study have relevance to the ‘real world in which you are working? Is the sample in the study/report similar to the population you are dealing with? Are the outcomes in the study/report the same outcomes that are of interest to your work? Are there any contextual factors mentioned in the study/report that would limit its relevance to your work?

The value of good evidence There is more and more good data and evidence production locally and internationally There is less and less justification for policy/decision making by intuition or whim Good evidence can depoliticise important and difficult decisions

CONTINUUM OF TYPES & SOURCES OF EVIDENCE CONTINUUM OF TYPES & SOURCES OF EVIDENCE USED None Opinion Informal Substantive Formal Research Scientific Research Review & assessment of available evidence No explicit basis for policy deci-sions Of the policy makers; or broadly accepted public opinion; lobby groups; others Anecdotal, stories, uncritical use of information to hand, partial & limited Careful truth seeking, developmental evaluation, data mining of survey & admin. data Empirical, appropriate design & methodology Statistical, comparative, causal Testing, analysing & synthesising available evidence. Rapid reviews; systematic enquiry; meta-analysis

Theory of Change seeks to Answer the Following Questions: 1) How is a policy/programme supposed to work? 2) What activities, mechanisms, and people have to be in place? 3) And in what sequence – what is the causal chain? 4) What resources are required – and are available? 5) What data is required – and is available? 6) Is the policy/programme achievable?

key highlights & Lessons It was very interesting to see how similar some of our M&E issues are across Africa, ie. availability and quality/reliability of data, low status of M&E, low M&E capacity, etc. The M&E system in South Africa is very comprehensive, well coordinated and impressive. A shift in focus from increased compliance to more cooperation among stakeholders in the M&E system is more effective. Most effective M&E systems prioritise and promote the active involvement of CSOs and grassroots organisations.

Nye tsu mi. - Krobo Akpe na mi. -Ewe Mi da mo ase. - Twi Nangode Nye tsu mi! - Krobo Akpe na mi! -Ewe Mi da mo ase! - Twi Nangode! - Hausa