Working Group Five Indicators and Measurement: demonstrating and improving impact After deliberating the definition of "success" for a transparency regime,

Slides:



Advertisements
Similar presentations
Linking regions and central governments: Indicators for performance-based regional development policy 6 th EUROPEAN CONFERENCE ON EVALUATION OF COHESION.
Advertisements

Introduction to Impact Assessment
Strengthening the Role of MCNs Hilary Davison Head of Standards Development Unit.
Monitoring and evaluation of carers’ services and projects Dr Andrea Wigfield - Associate Professor of Social Policy Centre for International Research.
Lecture 7 Evaluation. Purpose Assessment of the result Against requirements Qualitative Quantitative User trials Etc Assessment of and Reflection on process.
Program Assessment, WASC and Cal Poly Pomona Bob Hurt Faculty Associate for Program Assessment and Academic Program Review.
1 Monitoring and evaluation after 2013 – some first ideas, mainly for ERDF / CF Evaluation network DG REGIO 14 th October 2010.
Institutionalizing Sustainability Performance Metrics Smart & Sustainable Campuses Conference 2013 Presented by Keri Enright-Kato Yale Office of Sustainability.
ADD Perspectives on Accountability Where are We Now and What does the Future Hold? Jennifer G. Johnson, Ed.D.
Paris Project Meeting January 2012 Item – Statistics Objective 5 B. Proia With financial support from Criminal Justice Programme 2008 European Commission.
The Evaluation of Publicly Funded Research Berlin, 26/27 September 2005 Evaluation for a changing research base Paul Hubbard Head of Research Policy, HEFCE,
Demonstrating Effectiveness Background and Context.
RTI, MUMBAI / CH 101 CRITICAL ISSUES IN PERFORMANCE AUDITS DAY 10 SESSION NO. 3 (THEORY) BASED ON CHAPTER 10 PERFORMANCE AUDITING GUIDELINES.
United Nations Volunteers Measuring the contribution of volunteerism to community-based adaptation to climate change Ana Cristina Guimaraes Matos Evaluation.
Working Group Three Non-State and Multilateral Actors: examining roles and responsibilities This group gave full consideration to the various arguments.
The Access Initiative and the Partnership for Principle 10 World Resources Institute Nathalie Eddy.
Working Group Five Demand: identifying deficits and increasing the pool of users The group discussed the role of citizen demand for access to information.
Working Group Four Regional Norm-building: considering regional instruments and standards In light of the existing regional instruments, this group considered.
Institutionalizing IE in the MCC Franck Wiebe Chief Economist, MCC April 2, 2009.
Changes in Professional licensure Teacher evaluation system Training at Coastal Carolina University.
Auditing of Performance A conceptual discussion. Auditing of performance To demonstrate and discuss the differences between auditing of performance information.
Policy Course Session 25 Evaluation Case Study December 3, 2010.
1 Role of Evaluation Societies in Nurturing the M&E Systems Daniel Svoboda Czech Evaluation Society IDEAS Global Assembly October 2015.
SESSION 8: STRATEGIC PLANNING & GOALSSETTING District 3310 PETS 2010/11 Session 8: Strategic Planning and Goals Setting.
The Global Partnership Monitoring Framework Indicator on Use of Results Framework Seoul GP Annual Workshop Indicator Clinic 6 November 2014effectivecooperation.org.
Small Charities Challenge Fund (SCCF) Guidance Webinar
Periodic Reporting Reflection Experts Group (PRREG)
4th Assessment of Progress Against the GEOSS 2015 Strategic Targets
Sustainable Community Based Rehabilitation at local and national levels Presented by Professor Gwynnyth Llewellyn (University of Sydney) and Darryl Barrett.
Quality Control Plan: Introduction
Workshop on MDG Monitoring United Nations Statistics Division
Partnership for Practice
GUIDELINES Evaluation of National Rural Networks
Assessing a national PIC system
Implementing and reviewing additional admissions assessments
Policy Coherence & the 2030 Agenda
Key findings on comparability of language testing in Europe ECML Colloquium 7th December 2016 Dr Nick Saville.
Strategic Planning for Learning Organizations
GENDER STATISTICS IN INFORMATION AND COMMUNICATION
Turning Your Research Into Publications
Business Environment
Business Environment
Business Environment
Business Environment
National Benchmarking
Numeracy Ninjas Implementation Package
Accountability and Internal Controls – Best Practices
Eurostat D2 – Regional Indicators and Geographical Information
Multi-Sectoral Nutrition Action Planning Training Module
Texas Association of Community Colleges
FRAMEWORK FOR ASSESSING AND MONITORING FOREST GOVERNANCE
DEFINITION OF FAIR TRADE
Successful Bid Writing:
Museums, health and wellbeing: Methodologies for measuring impact
April 2011.
School of Dentistry Education Research Fund (SDERF)
school self-evaluation and improvement toolkit
ati.publishwhatyoufund.org.
ICCE WORKSHOPS.
Quality Control Plan: Introduction
Quality in Evaluation: the international development experience
Strategy
Response to Intervention in Illinois
Monitoring and Evaluating FGM/C abandonment programs
ESF monitoring and evaluation in Draft guidance
Understanding Impact Stephanie Seavers, Impact Manager.
Main recommendations & conclusions (1)
Workshop on MDG Monitoring
Comprehensive M&E Systems
CBC IntoSAINT Project Group
Presentation transcript:

Working Group Five Indicators and Measurement: demonstrating and improving impact After deliberating the definition of "success" for a transparency regime, this group discussed the need for indicators and measurement of the progress andi impact of the right of access to information.  Additionally, it focused on the potential audience of the indicator and the costs and benefits.

Main considerations or areas of discussion Objectives and development / governance goals of ATI Timing issue – When is it too soon to measure impact? How often should we measure? Should we focus on implementation or impact? Questions to ask about successful implementation Methods of measurement of impact Actors who should assess Whether success should be measured against international standards What should be done with the results of the measurement?

Consensus on the crux of the issue Based on premise that ATI is a human right, the core definition of success is increased ability to access, through proactive disclosure and requests, and to freely use information; however, “success” also encompasses different development and governance goals, which require different measurements to monitor and evaluate impact. The ATI community should try to measure success to see if ATI regimes are working and to improve impact.

Recommendations and action points Develop and refine tools to measure ATI implementation and impact; focus on implementation first, and on impact over long-term Share ideas about measurement and indicators within ATI community (establish dedicated website on the subject and hold follow-on conference) Governments should keep annual statistics on implementation but measurement should be bi-annual Assessment should be carried out by local experts (NGOs, academics, etc.); there should also be government self-assessment (peer review)

Recommendations and action points (continued) Measure at sub-national level as well as national level, and across sectors, as well as against international standards In terms of methodology: Use both quantitative and qualitative methods Do process assessments over time to identify trends Be transparent about methodology (!) Use caution in linking ATI to broader development and governance goals: be rigorous Encourage international donors/NGOs/governments to make multi-year funding commitment to measurement