2013 NEO Program Monitoring & Evaluation Framework.

Slides:



Advertisements
Similar presentations
Program Evaluation. Overview and Discussion of: Objectives of evaluation Process evaluation Outcome evaluation Indicators & Measures Small group discussions.
Advertisements

Results Based Monitoring (RBM)
Introduction to Monitoring and Evaluation
EFFECTIVE TECHNICAL ASSISTANCE (TA)
M & E for K to 12 BEP in Schools
High level expert meeting to develop the Near East Regional Action Plan to Implement the Global Strategy to improve Agricultural and Rural Statistics.
Decision Making Tools for Strategic Planning 2014 Nonprofit Capacity Conference Margo Bailey, PhD April 21, 2014 Clarify your strategic plan hierarchy.
Ray C. Rist The World Bank Washington, D.C.
Orientation to Performance and Quality Improvement Plan
PHAB's Approach to Internal and External Evaluation Jessica Kronstadt | Director of Research and Evaluation | November 18, 2014 APHA 2014 Annual Meeting.
Evaluation. Practical Evaluation Michael Quinn Patton.
Monitoring & Evaluation in World Bank Agriculture and Rural Development Operations SASAR Monitoring & Evaluation Workshop New Delhi; June 20, 2006.
Presentation on Managing for Development Results in Zambia By A. Musunga Director M&E MOFNP - Zambia.
United Nations Statistics Division
Organization Mission Organizations That Use Evaluative Thinking Will Develop mission statements specific enough to provide a basis for goals and.
Training of Process Facilitators Training of Process Facilitators.
Evaluation in the GEF and Training Module on Terminal Evaluations
Fundamentals of Evaluation for Public Health Programs ROBERT FOLEY, M.ED. NIHB TRIBAL PUBLIC HEALTH SUMMIT MARCH 31,
Appreciating the Enhanced BGPMS
Tracking of GEF Portfolio: Monitoring and Evaluation of Results Sub-regional Workshop for GEF Focal Points Aaron Zazueta March 2010 Hanoi, Vietnam.
Alaska Staff Development Network – Follow-Up Webinar Emerging Trends and issues in Teacher Evaluation: Implications for Alaska April 17, :45 – 5:15.
Sub-Regional Workshop for GEF Focal Points in West and Central Africa Accra, Ghana, 9-11 July 2009 Tracking National Portfolios and Assessing Results.
UNDAF M&E Systems Purpose Can explain the importance of functioning M&E system for the UNDAF Can support formulation and implementation of UNDAF M&E plans.
Tracking national portfolios and assessing results Sub-regional Workshop for GEF Focal Points Western and Central Africa Dakar, May 2007.
Workshop II Monitoring and Evaluation INTERACT ENPI Annual Conference December 2009 | Rome.
Omid Parhizkar, PhD Interim Results Management Coordinator Results Based Management at the GEF.
Aaron Zazueta Chief Evaluation Officer 2013 EVALUATION IN THE GEF.
The Multilateral Fund and its Management Structure UNFCCC Workshop on the Adaptation Fund 3-5 May 2006 Alberta, Canada Maria Nolan Chief Officer - Multilateral.
Portfolio Committee on Appropriations Audit of predetermined objectives 26 March 2013.
Tier 2/ Tier 3 Planning for Sustainability Rachel Saladis WI PBIS Network/Wi RtI Center Katrina Krych Sun Prairie Area School District.
Senior Evaluation Officer GEF Independent Evaluation Office Minsk, Belarus September 2015 Evaluation in the GEF and Training Module on Terminal Evaluations.
Office of Special Education Programs U.S. Department of Education GRANT PERFORMANCE REPORT FOR CONTINUATION FUNDING.
The N ewly E lected O fficials (NEO) Program. Issues to be Addressed LGUs should have a solid grasp of the national government agenda and its relationship.
Presented by: Jan Stanley, State Title I Director Office of Assessment and Accountability June 10, 2008 Monitoring For Results.
Project Management Learning Program 23 Mar – 3 Aprl 2009, Mekong Institute, Khon Kaen, Thailand Managing for Development Results Results-Oriented Monitoring.
Tracking national portfolios and assessing results Sub-regional Workshop for GEF Focal Points in West and Central Africa June 2008, Douala, Cameroon.
Module 8: Monitoring and Evaluation Gap Analysis and Intervention Plans.
Consultant Advance Research Team. Outline UNDERSTANDING M&E DATA NEEDS PEOPLE, PARTNERSHIP AND PLANNING 1.Organizational structures with HIV M&E functions.
Catholic Charities Performance and Quality Improvement (PQI)
Changing the way the New Zealand Aid Programme monitors and evaluates its Aid Ingrid van Aalst Principal Evaluation Manager Development Strategy & Effectiveness.
1 The project is financed from the European Union funds within the framework of Erasmus+, Key Action 2: Cooperation for innovation and the exchange of.
AUDIT COMMITTEES’ PERSPECTIVE ON PERFORMANCE MANAGEMENT AND INSIGHTS INTO THEIR OVERSIGHT ROLE.
To develop skills on Communication, monitoring & evaluation and project management, To develop skills on Communication, monitoring & evaluation and project.
The Newly Elected Officials Program “Maximizing Opportunities and Enhancing Resiliency as Platform for Global Competitiveness”
Introduction to the quality system in MOHE Prof. Hala Salah Consultant in NQAAP.
Session 2: Developing a Comprehensive M&E Work Plan.
1 Update on Teacher Effectiveness July 25, 2011 Dr. Rebecca Garland Chief Academic Officer.
CHB Conference 2007 Planning for and Promoting Healthy Communities Roles and Responsibilities of Community Health Boards Presented by Carla Anglehart Director,
MEASURE Evaluation Data Quality Assurance Workshop Session 3 Introduction to Routine Data Quality Assessment.
Developing a Monitoring & Evaluation Plan MEASURE Evaluation.
Reporting, Monitoring and Evaluation Giovanni Rum, Chao Xing GEO Secretariat GEO Work Programme Symposium Geneva, 2-4 May 2016.
Monitoring and Evaluation Systems for NARS organizations in Papua New Guinea Day 4. Session 11. Reporting.
Monitoring and Evaluation Systems for NARS organizations in Papua New Guinea Day 4. Session 10. Evaluation.
Reporting, Monitoring and Evaluation
Project monitoring and evaluation
Country Level Programs
GEF Familiarization Seminar
Monitoring and Evaluation
THE SELECT COMMITTEE ON LOCAL GOVERNMENT AND ADMINISTRATION
Monitoring and Evaluation Systems for NARS Organisations in Papua New Guinea Day 2. Session 6. Developing indicators.
Civil Society Network for Education Reforms (E-Net Philippines)
13th Governing Council of SIAP 4-5th December,2017 Chiba, Japan
2018/19 ANNUAL PERFORMANCE PLAN FOR MISA
Evaluation in the GEF and Training Module on Terminal Evaluations
Establish you aims from the outset
Presentation: Audit of Predetermined Objectives
Performance and Quality Improvement
Technical and Advisory Meeting
BARANGAY NEWLY ELECTED OFFICIALS (BNEO) PROGRAM 2010
Data for PRS Monitoring: Institutional and Technical Challenges
Presentation transcript:

2013 NEO Program Monitoring & Evaluation Framework

Presentation Outline Purpose of M&E Results Framework and Indicators Overall M & E Plan  Data collection and reporting system 2

Purpose of M&E Provide a framework for tracking progress of the program towards achieving its intended results; Provide a mechanism for stakeholders to promptly address implementation issues; Establish mechanism to ensure quality, reliability and accuracy of reported data; Define approach and framework for program review and evaluation Provide reliable and accurate data for evidence-based decision making and policy decisions. 3

Program Results Chain Immediate Outcome Intermediate Outcome Intermediate Outcome Ultimate Outcome Improved state of local governance in participating LGUs Client satisfaction on services delivered by the LGU Improved capacity of local officials to formulate a term-based plan

NEO 1: Transition report SLGR presentation Social Contract First 100 Days Agenda Leadership Development Agenda (to be discussed with the Leagues) ELA /CapDev Agenda NEO 1: Transition report SLGR presentation Social Contract First 100 Days Agenda Leadership Development Agenda (to be discussed with the Leagues) ELA /CapDev Agenda Outputs Program Results Chain NEO 2: Partnership Agreement Budget ordinance NEO 2: Partnership Agreement Budget ordinance NEO 3: Training programs for LGUs Re-entry Action Plan NEO 3: Training programs for LGUs Re-entry Action Plan NEO 4: LGU Awardees Service provider awardees NEO 4: LGU Awardees Service provider awardees

Activities/ Inputs Activities/ Inputs NEO 1. Reinventing Public Service: A Guide to Action Turnover 1.1 Organization of transition teams 1.2 Preparation and turn- over of documents 1.3 Presentation of SLGR Jumpstarting 1.4 Development of On-line Platform 1.5 Development of On-line Modules 1.6 Training of Administrators and Facilitators 1.7 Conduct of Webinar 1.8 Conduct of Executive Coaching Sessions 1.9 LGU coaching on ELA/Capdev Peer to peer learning 1.10 Strategic Management training 1.11 Dialogue with NGAs

Activities/ Inputs Activities/ Inputs NEO 2: Looking Forward to Better Governance 2.1 Coaching on Preparation of Budget Ordinance 2.2 Conduct of alliance building workshops (CapDev Expo) 2.3. Regional Orientation on the SEALS 2.4. Population of the CapDev Market NEO 3. Specialized Courses 3.1 Development of Online Capdev Market System 3.2 Conduct of training programs for newly elected and re- elected officials 3.3 Development of Capdev standards 3.4. Conduct of Benchmarking NEO 4. Performance Management 4.1 Development of awards system 4.2 Conduct of Audit 4.3Provision of Awards

Specifying Indicators A good performance indicator must be: Clear(Precise and unambiguous) Relevant(Appropriate and timely) Economic(Available at reasonable cost) Adequate(Must provide a sufficient basis to assess performance) Monitorable(Can be independently verified) The “CREAM” of Good Performance Salvatore-Schiavo-Campo 2000

NEO Program Indicators Presence of enabling instruments to implement the ELA Level of budget allocation for the implementation of the ELA Percentage of total LGUs with improved LGPMS-OPI Percentage of total LGUs receiving Seal awards from DILG Percentage of total LGUs achieving “Excellent” and “Good” rating in the ARTA survey

Number of LGUs with transition report Number of LGUs with SLGR Number of local officials with Social Contract Number of local officials with First 100 Days Agenda Number of LGUs with ELA/CapDev Number of LGUs with partnership agreements Number of LGUs that participated in the alliance building workshops Number of LGUs with budget ordinance Number of LGUs availed of the programs Number of LGUs with Re-entry Action Plan Number of LGUs with SEALS Number of service providers with awards

Number of administrators, moderators and facilitators trained Number of local officials enrolled in the webinar Number of local officials availing the modules Performance of the participants Effectiveness of moderators and facilitators Effectiveness of the modules Effectiveness of the online system Number of training programs designed and implemented that addressed the capacity development needs Effectiveness of training program Number of local officials trained Number of knowledge products developed Number of LGUs availing technical assistance from pool of service providers Number of systems developed Number of capdev standards developed Adequacy of funding support Effectiveness of resource persons Effectiveness of policies issued Number of policies formulated and disseminated

Overall M&E Plan

Monitoring Plan (Immediate Outcome & Outputs) Performance indicator Data source Method of data collection Frequency of data collection Responsibility Center CollectionAggregation Review/ Validation Analysis / Reporting Presence of enabling instruments to implement the ELA LGUData capture through NEO M&E forms QuarterlyDILG-FOsDILG-ROs DILG-LGA Level of budget allocation for the implementation of the ELA LGUData capture through NEO M&E forms QuarterlyDILG-FOsDILG-ROs DILG-LGA

Monitoring Plan (Immediate Outcome & Outputs) Performance indicator Data source Method of data collection Frequency of data collection Responsibility Center CollectionAggregation Review/ Validation Analysis / Reporting Number of LGUs with transition report DILG-FOData capture through NEO M&E forms QuarterlyDILG-FOsDILG-ROs DILG-BLGS Number of local officials with Social Contract DILG-FOData capture through NEO M&E forms QuarterlyDILG-FOsDILG-ROs DILG-LGA Number of local officials with First 100 Days Agenda DILG-FOData capture through NEO M&E forms QuarterlyDILG-FOsDILG-ROs DILG-LGA Number of LGUs with Leadership Development plan TO BE DONE BY THE LEAGUES

Monitoring Plan (Immediate Outcome & Outputs) Performance indicator Data source Method of data collection Frequency of data collection Responsibility Center CollectionAggregation Review/ Validation Analysis / Reporting Number of LGUs with ELA/CapDev DILG-FOData capture through NEO M&E forms QuarterlyDILG-FOsDILG-ROs DILG-LGA Number of LGUs with partnership agreements DILG-FOData capture through NEO M&E forms QuarterlyDILG-FOsDILG-ROs DILG-LGA Number of LGUs that participated in the collaboration workshops DILG-FOData capture through NEO M&E forms QuarterlyDILG-FOsDILG-ROs DILG-LGA

Monitoring Plan (Immediate Outcome & Outputs) Performance indicator Data source Method of data collection Frequency of data collection Responsibility Center CollectionAggregation Review/ Validation Analysis / Reporting Number of LGUs with budget ordinance DILG-FOData capture through NEO M&E forms QuarterlyDILG-FOsDILG-ROs DILG-LGA Number of LGUs availed of the programs DILG-FOData capture through NEO M&E forms QuarterlyDILG-FOsDILG-ROs DILG-LGA Number of LGUs with Re-entry Action Plan DILG-FOData capture through NEO M&E forms QuarterlyDILG-FOsDILG-ROs DILG-LGA Number of LGUs with SEALS DILG-FOData capture through NEO M&E forms AnnuallyDILG-FOsDILG-ROs DILG-LGA Number of service providers with awards LGAData capture through NEO M&E forms Annually

Data capture at the LGU level Data aggregation by DILG regional offices Data aggregation at national level by LGA Data review & validation (annual) Data analysis and reporting by LGA Data Collection and Reporting Regional Quarterly Progress Report National Quarterly Progress Report LGU Quarterly Progress Report Program Status Report (Semi-annual)

Role of Cluster/Provincial Offices Ensure completeness and accuracy of data collected at the LGU level; Consolidate LGU quarterly progress reports into Cluster/Provincial quarterly reports; Ensure timely submission of Provincial Quarterly Reports to the Regional Office; Participate in M&E-related activities such as capacity building, periodic program reviews Share M&E findings with LGUs and other program stakeholders. 18

Role of Regional Offices Coordinate M&E activities at the regional level; Consolidate LGU/cluster/provincial quarterly reports into Regional quarterly reports; Ensure timely submission of Regional Quarterly Reports to the LGA; Participate in M&E-related activities such as capacity building, periodic program reviews Share M&E findings with the regional program stakeholders. 19

Reporting & Use of M&E Findings Type of ReportSourceUse/PurposeFrequency LGU Quarterly Progress Report LGUProgress update on outputs & outcome/impact Quarterly Province/Regional Quarterly Progress Report Province/RegionProgress update on activities, outputs, outcome & impact; aggregates LGU progress reports Quarterly National Quarterly Progress Report / Program Status Report DILG-LGAProgress update on program results for use by top management Quarterly/Semi- annually

Evaluation Approach TypePurposeMethodologyFrequency Progress review and evaluation Assess progress towards targets; identify issues; draw early lessons Data collection thru/analysis of regular progress reports; data validation of sample LGUs Mid-term; as appropriate Final evaluationAssess results against objectives; evaluate impact and sustainability; draw lessons Interviews; focus groups; ‘Before and after’ analysis End-of-program

The Power of Measuring Results If you do not measure results, you can not tell success from failure If you can not see success, you can not reward it If you can not reward success, you are probably rewarding failure If you can not see success, you can not learn from it If you can not recognize failure, you can not correct it If you can demonstrate results, you can win public support Adapted from Osborne & Gaebler, 1992