Centers for Learning on Evaluation and Results A Multilateral Initiative Nidhi Khattri Independent Evaluation Group, World Bank November 13, 2010 April, 2010

Critical Gap in Measuring Effectiveness of Development Policies and Programs & Evaluation-Based Learning Countries’ Demand for Evidence, and Systems and Skills for Evidence-Based Decision Making is Patchy Demand, systems, skills needed to support: Policy and budget reforms in developing countries (and across the globe) Need for effective and efficient public management Demand from citizens for transparency, accountability, information relevant for decision-making Increasing civil society engagement in public agenda Social accountability Social monitoring NGO participation in public sphere Policy and budget reforms in OECD and partner countries have led to an increased focus in recent years on the measurement and evaluation of the results of public programs, and the use of the information generated for government accountability and decision making. The Paris Declaration sets out a series of ambitious commitments for reforming aid delivery and management, based on the key principles of “managing for results” and “mutual accountability.” Both in-country reforms and the implementation of the Paris Declaration require that partner countries have the capacity for results measurement and evaluation, as well as the ability to use this information for accountability and as feedback in the design of public programs and budgets. Many governments have not yet achieved these capacities, and the supply of appropriate services to build capacity to monitor and evaluate is still relatively limited.

Inadequate Supply of Relevant and Cost-effective Capacity Development Services Need and Demand for: In-service and applied programs tailored to specific needs Cost-effective options for diverse audiences parliaments, public sector agencies, civil society, program managers Range of knowledge-sharing modalities that include stoking demand Innovation in performance measurement and data-based decisionmaking Training of trainers Locally based capacity to build capacity

What is IEG doing to close that gap? CLEAR – a five-year partnership launched in January 2010 Objective: Strengthen existing regional institutions to provide capacity development services in monitoring and evaluation (M&E) and results-based management (RBM) through: Regional Program (large): Support competitively selected regional institutions to provide demand-driven, customized, and cost-effective M&E and RBM capacity building services Global Program (small): Develop strong technical curriculum materials with a focus on “how to”; and facilitate cross-regional learning and knowledge-sharing Governance Structure: Board (donors initially), Regional Advisory Committees, Secretariat (housed at IEG) to ensure broad participation Five-year partnership launched in January 2010, with SIDA, DfID, AfDB, ADB, and IEG World Bank The goal of the initiative is to contribute to strengthening the M&E capacity of partner countries for results-based management in order to achieve development outcomes. The approach comprises two parts: regional and global programs. Regional program, which will help strengthen the capacity of academic/training institutions located within partner countries with grants and technical support. The aim is to create a situation whereby countries can demand services from regional institutions, rather than relying on developed-country institutions. Centers provide demand-based capacity-building and knowledge services in M&E. The institutions in Africa, South Asia, and Latin America are being selected competitively, based on their assessment of demand for such services and their proposed response to that demand. Each center will develop its own work-program, responding to the regional demand and needs Training Knowledge Services (e.g., research, support to networks) Advisory Services (e.g., engagement in evaluations, technical assistance for government agencies and international organizations) Multi-regional activities organized by Centers themselves (e.g., exchange of experiences on SHIPDET) Coordination with other initiatives (e.g., 3IE, statistical capacity building) Global program will be implemented by the Secretariat. The global program will enable the centers, governments, and other stakeholders to exchange knowledge and learning across regions. It will develop courses and hold multiregional learning events. Governance Structure Board (Donors, Bank, Partner Country Reps.) Regional Advisory Committees (6-7 members; professional community, governments, donors) Advice to centers and the Board Secretariat (housed at World Bank) Day-to-day functioning of the program Preliminary selection of regional centers Implementation of multi-regional component

Latin America: Coming soon East Asia Center: AFDC, Shanghai, China - Supported by Chinese MoF, ADB, and IEG - Offers Introductory M&E course regularly - Just piloted first Performance Budgeting course developed by CLEAR’s global program Regional Program AFDC (Asia-pacific Finance and Development Center): CLEAR Center in Asia AFDC experience will build on existing cooperation among several partners (Ministry of Finance, ADB, and IEG) for three years (2007 thru 2009) Currently AFDC offers the Shanghai International Program for Development Evaluation Training (SHIPDET) Selection Process in Africa, South Asia, and Latin America Open call for applications Independent Selection Committee suggests short-list of institutions to the Board Board invites institutions to provide full proposals Secretariat conducts site visits Selection committee suggests one or two finalists to the Board Board selects host institution Selection Criteria Demonstration of demand for services from public sector agencies and civil society Articulation of a demand-based program of activities, with a five- year business plan Support from host government and regional public agencies Latin America: Coming soon South Asia Center: Competitive selection underway Africa Center: Competitive selection completed University of Witwatersrand, Johannesburg, South Africa

Africa Competitive Selection Process (March – October) 56 Applications Received from 17 countries 5 Institutions Shortlisted CLEAR Center awarded to: University of Witwatersrand, Johannesburg, South Africa Competitive process begun in late March and concluded in October. Country with institutions presenting applications Country with shortlisted institutions CLEAR Center in Africa

South Asia Competitive Selection Process (August – December) 24 applications received From 6 countries 3 Shortlisted Institutions Shortlisted: Institute for Applied Manpower Research (IAMR) - Delhi, India Jameel Poverty Action Lab (JPAL) at the Institute for Financial Management and Research (IFMR) - Chennai, India BRAC Development Institute (BDI) at BRAC University - Dhaka, Bangladesh Center ill be selected by December 2010 Competitive process begun in August and due to complete in mid-December Country with institutions presenting applications Country with shortlisted institutions

Looking Forward Regional Program – Begin Operations. AFDC (China) already operating. Competitively selected centers will begin operations in January 2011 Global Program First multi-regional learning and exchange event in April 2010 Focus on country M&E systems; technical courses focusing on “how to” of evaluations; forum for peer-exchanges; networking among centers and other stakeholders on development of M&E capacity development services Event open to larger community Courses Performance-based budgeting course piloted for policymakers. Technical course to be piloted at global event Rapid evaluations course finished by December “How to” Practical Impact Evaluation course being commissioned Center in Latin America Discussing partnership with Mexican Government Currently seeking additional funds for CLEAR program in the region

What have we learned from our efforts so far? Too early to tell, but: Huge demand for the concept of building evaluation capacity, but constituents (demand-side) often lack specific ideas about what they need Great capacity in some regions in terms of skills, but too disconnected from demand and policy process Applied focus is relatively rare The idea is do-able , with pilot-based interventions This initiative benefited from consultations with several partner countries, which validated the demand for evaluation capacity and endorsed the proposed initiative. The initiative has also been designed with multilateral and bilateral donors and World Bank units working in the four regions. China already hosts a center in Shanghai for SHIPDET, which will be folded into the initiative. The Ministry of Finance and AFDC are the partners in East Asia. Mexico, Colombia, South Africa, Uganda and Mauritius have also expressed specific interest in hosting the initiative for their respective regions.

Partners http://www.worldbank.org/ieg/clear/ Current partners: WB, SIDA, DfID, AfDB, ADB Pledged: IFAD, IDB   http://www.worldbank.org/ieg/clear/