Plan © Plan Using the Most Significant Change ( MSC) technique for actual program improvement (New way towards a downward accountability and collective.

Slides:



Advertisements
Similar presentations
Outcome mapping in child rights-based programming
Advertisements

Results Based Monitoring (RBM)
Continuing and Expanding Action Research Learning Cedar Rapids Community Schools February, 2005 Dr. Susan Leddick.
Intelligence Step 5 - Capacity Analysis Capacity Analysis Without capacity, the most innovative and brilliant interventions will not be implemented, wont.
© Grant Thornton UK LLP. All rights reserved. Review of Partnership Working: Follow Up Review Vale of Glamorgan Council Final Report- November 2009.
Lucila Beato UNMIL/HRPS
Working with the Teachers’ Standards in the context of ITE. Some key issues for ITE Partnerships to explore.
Ohio Improvement Process (OIP) August Core Principles of OIP  Use a collaborative, collegial process which initiates and institutes Leadership.
The Most Significant Change Technique (MSC) Dr Jessica Dart Clear Horizon.
Theory of Change, Impact Monitoring, and Most Significant Change EWB-UK Away Weekend – March 23, 2013.
Commonwealth Local Government Forum Freeport, Bahamas, May 13, 2009 Tim Kehoe Local Government and Aid Effectiveness.
In the Name of Allah, the Most In the Name of Allah, the Most Compassionate, the Most Merciful Compassionate, the Most Merciful.
Ohio Improvement Process (OIP) Facilitating District-wide Improvement in Instructional Practices and Student Performance.
Sierra Leone Consortium for Relief and Development (CORAD) CARE Int., AFRICARE, Catholic Relief Services, World Vision Int. Action Plan for Making Monitoring.
Getting SMARTer: The evolution of Project Management within Victoria Police Doug Witschi.
Plan © Plan Assessing programme effectiveness at the global level in a large and complex organisation Presentation delivered to the conference on Perspectives.
HIV/AIDS COORDINATION AND FAITH BASED ORGANISATIONS: EXPERIENCES FROM UGANDA JOHN RWOMUSHANA, MD, MSc Director, Research and Policy Development UGANDA.
Monitoring Evaluation Impact Assessment Objectives Be able to n explain basic monitoring and evaluation theory in relation to accountability n Identify.
Theme III Introducing Greater Impact Orientation at the Institutional Level Group 6.
Performance Measures AmeriCorps Project Director Training Saratoga, NY October 7 th – 9 th, 2013.
Do it pro bono. Strategic Scorecard Service Grant The Strategy Management Practice is presented by Wells Fargo. The design of the Strategic Scorecard Service.
Evaluation in the GEF and Training Module on Terminal Evaluations
1 RBM Background Development aid is often provided on a point to point basis with no consistency with countries priorities. Development efforts are often.
Monitoring and Evaluation in MCH Programs and Projects MCH in Developing Countries Feb 10, 2011.
Integrated Community Development (or CR) Management Systems (ICDMS) ICMM CD Toolkit # 15 CR TOOLKIT WORKSHOP Integrated Community Development (or CR) Management.
Toolkit for Mainstreaming HIV and AIDS in the Education Sector Guidelines for Development Cooperation Agencies.
Nelson Mandela Foundation Evaluating Community Dialogues How do we know we are making a difference?
Monitoring and Evaluation of Public- Private Dialogues Jesse Biddle Center for International Development State University of New York And Benjamin Herzberg.
MOST SIGNIFICANT CHANGE Youth Focused Monitoring and Evaluation System.
Communications Update J. Odhong’ Communication Specialist, Africa RISING ESA and WA projects Accra, Ghana, 24 – 25 March, 2015.
Monitoring & Evaluation: The concepts and meaning Day 9 Session 1.
MAINSTREAMING MONITORING AND EVALUATION IN EDUCATION Can education be effectively managed without an M & E system in place?
Monitoring and Evaluation of GeSCI’s Activities GeSCI Team Meeting 5-6 Dec 2007.
April_2010 Partnering initiatives at country level Proposed partnering process to build a national stop tuberculosis (TB) partnership.
UNDAF for Beginners. 2 2 Strategic programme framework Describes the collective response and support of the UN System to national development priorities.
Third Sector Evaluation: Challenges and Opportunities Presentation to the Public Legal Education in Canada National Conference on “Making an Impact” 26.
The Next Stage for Results in Africa. Context 2005 Paris Declaration on Aid Effectiveness 2006 Mutual Learning Events Uganda & Burkina Faso 2007 Hanoi.
Senior Evaluation Officer GEF Independent Evaluation Office Minsk, Belarus September 2015 Evaluation in the GEF and Training Module on Terminal Evaluations.
Communications Review 2009 Niamh Brannigan February 2010.
Monitoring and Evaluation in MCH Programs and Projects MCH in Developing Countries Feb 24, 2009.
Blueprints for RtI Implementation Coaches/Principals 10/8/09.
KZN Government connecting people to quality services Building blocks to better service delivery - Know your ward be street wise. I INTRODUCTION  The.
November 15, 2007 The “ABC” of Effective Field Monitoring & Supervision November 15, 2007.
Developing & Sustaining Community Schools to Build a Systemic Initiative April 8, 2010 Janice Chu-Zhu, Sr. Dir. Natl. Capacity Building Coalition Forum.
Consultant Advance Research Team. Outline UNDERSTANDING M&E DATA NEEDS PEOPLE, PARTNERSHIP AND PLANNING 1.Organizational structures with HIV M&E functions.
Developing a Framework In Support of a Community of Practice in ABI Jason Newberry, Research Director Tanya Darisi, Senior Researcher
Vito Cistulli - FAO -1 Damascus, 2 July 2008 FAO Assistance to Member Countries and the Changing Aid Environment.
Developing SEA Change’s Evaluation Plan
Ohio Improvement Process (OIP) Facilitating District-wide Improvement in Instructional Practices and Student Performance.
Brief Introduction Dr R Vincent: 1 Most Significant Change: using stories to assess impact.
Rafael Obregon Chief, C4D Section UNICEF NYHQ Bangladesh, May 2015
Monitoring and Evaluation in MCH Programs and Projects MCH in Developing Countries Feb 9, 2012.
Saving lives, changing minds. Gender and Diversity Accountability to beneficiaries and beneficiary communications Gender and Diversity Training.
Lead Agency Viability Assessment Consistent with OPPAGA Report 04-65, DCF contracted with FMHI to assist in the design and implementation of a centralized.
Exchange1 “Most Significant Changes”
27/04/2017 Strengthening of the Monitoring and Evaluation system for FTPP/FTTP in FAO /SEC December 2015 FTPP/FTFP Workshop, Bishkek, Kyrgyzstan.
Making Evaluation Work for Effective Policy Reform and Revision Chris Nelson, Director, Quality and Performance Systems Branch Sophie Davies, Manager Evaluations.
International Land Coalition Advancing the Monitoring of Land Governance for Ensuring Impact on Poverty Reduction Annalisa Mauro.
HUMANITARIAN RESPONSE MONITORING. HOW TO USE THIS PRESENTATION This presentation contains a complete overview of all aspects of Response Monitoring Presenting.
Presentation to the Ad-hoc Joint Sub-Committee on Parliamentary Oversight and Accountability Wednesday 20 March 2002 PUBLIC SERVICE MONITORING AND EVALUATION.
Session 2: Developing a Comprehensive M&E Work Plan.
Middle Managers Workshop 2: Measuring Progress. An opportunity for middle managers… Two linked workshops exploring what it means to implement the Act.
The Tipping Point Project’s Participatory Community Analyses : Successes and Lessons Learned April 01, 2015.
Albanian Qualifications Framework Ejvis Gishti, NAVETQ Kiev, March
Module 3: Ensuring Sustainability Session 1. Empowerment of the Community 1 CBDRR Framework Training - Myanmar Red Cross Society.
Developing a Monitoring & Evaluation Plan MEASURE Evaluation.
Participatory Monitoring and Evaluation of Community Projects – A Model Pretoria, South Africa 30 November – 3 December 2009.
Continuous Improvement through Accreditation AdvancED ESA Accreditation MAISA Conference January 27, 2016.
April 2011.
Evaluation in the GEF and Training Module on Terminal Evaluations
Presentation transcript:

Plan © Plan Using the Most Significant Change ( MSC) technique for actual program improvement (New way towards a downward accountability and collective learning) Presented By Awny Amer- Plan Egypt M&E advisor April1,09 :

© Plan Aligning the M&E system with the RBA Why ? ( moving from CPME to PALS)  The need to focus more on learning & accountability towards different stakeholders, donors and partners.  The need to re-engineer our programs from needs based towards the right-based approach.  The need to shift away from a service delivery approach to a more comprehensive approach that address the capacity to claim rights.  The need to re-engineer our programs to move on the outcomes monitoring instead of the outputs monitoring. * PALS( Program accountability and learning system)

© Plan Key areas that need to be strengthened-What? The application of RBA in the situation analysis An emphasis On learning The use of sec. data Greater involvement Of stakeholders at All stages of PME A consistent emphasis On cross-cutting principles Strategic planning At the PU level community PME As a core part of The CCD M&E of higher Level results (outcomes & Impact )

© Plan Key principles Best interest of The child Participation Partnership Balanced Power Accountability Improving program Quality Learning) Upward Downward

© Plan Annual Participatory Program Review (APPR) within RBA Key pillars/principles ( RBA Perspective) Quarterly Progress report /project. Annual PU Program review Country level Program Framework review MSCs are collected/ Selected at the Comm. & PU level ( Mid-year exercise ) Annual Program review at CO level- Plan Egypt ( this review includes the MTRs /final evaluation of the Prog ( Media, FGM, Street Children,etc/project) Ensure balanced Power relations Effective participation To identify areas to be Studied ( researches plan). Best interest of the child Improve program quality Learning Accountability ( upward & downward) To stakeholders, partners & donors Community Reflection process Most Significant Change Stories ( MSCT) To capture the outcomes from Community perspective using PRA tools: spider net, H Method, Mood meter. Recommendations for program Review and corrective actions Long term objective ( Program implementation Improvement) Mid-year CR process on different levels: comm., PU,stakeholders ) To capture the outcomes from Individual perspective FeedbackFeedback

© Plan Best interest of the child Improve Program Quality Accountability ( upward & downward) Effective Participation Community M&E team ( covering all the programs Implemented/PU/community). PU M&E team (PC+1FLS(2or 3/PU ) CO M&E team(1or 2) (national M&E coordinator) M & E teams in Plan Egypt within the new PALS ( RBA principles &perspective) M&E team ( community B M&E team ( community C M&E team ( community D M&E team ( community E M&E team ( community A M&E team ( community F Learning Ensure balanced Power relations

© Plan MSC in brief 1.Generating interest 2.Establishing domains of change 3.Defining reporting period 4.Collecting stories of change 5.Reviewing and selecting stories 6.Providing feedback to stakeholders 7.Verification 8.Quantification 9.Secondary analysis/meta evaluation 10.Revising the process

© Plan Most Significant Change (MSC) stories technique Selection at Country Office Second level selection at PU First level selection at community level Stories readout for selection of significant ones Collection of stories from story teller/people CBO/CDA members Community Staff of partner organization Plan staff working In that village Categorization By domains FeedbackFeedback Process of collecting MSC stories

© Plan Flow of stories Stories from story tellers (Community A) Stories from story tellers (Community B) Stories from story tellers (Community C) District (PU) level Country level

© Plan Why stories? People tell stories naturally – indigenous way of passing on knowledge or information. Stories can deal with complexity and context People remember stories Stories can carry hard messages /undiscussables But stories are not known for accuracy/truth – this could be affected by Who tells the story To whom it is told When they tell story Their motivation Even their mood Note that some people are naturally bad story tellers

© Plan Most Significant Change Creates space for stakeholders to reflect, to make sense of complex changes Provides dialogue to help make sense of each other people’s values Facilitates dynamic dialogue ie. “what do we really want to achieve and how will we produce more of it?” Excellent for participatory programs with diverse, complex outcomes, & multiple stakeholders. Promote the downward accountability, effective & authentic participation and project ownership.

© Plan The Core of MSC A question: “In your opinion what was the most significant change that took place in ….over the … months” [describe the change and explain why you think it is significant] Re-iteration of the same kind of question “Which of these SC stories do you think is the most significant of all?” [describe the change and explain why you think it is significant]

© Plan How it is used- Example ( FGM program)- ( Key recommendations resulted from the MSCT exercise) Mobilizing men against FGM is a very important intervention for the vital role that they may play in discouraging FGM. It is recommended to include the basic life skills intervention in the awareness component provided for all ages starting at 9 years. Using the negative models as result of the practice of the FGM played a vital role in saving others who are still at risk of the FGM. Support the role of the school, mosque, children clubs and church should be continued and enhanced and promoted on different levels in the project design.