Developing SEA Change’s Evaluation Plan Annual Members’ Meeting Track A November 10, 2011

Purpose of the Session To develop parts of an evaluation plan for the second year of SEA Change To provide participants with a participatory M&E planning experience

Agenda Review the stages of M&E and the steps for M&E planning Conduct a stakeholders’ analysis Define the purpose of the evaluation Develop key evaluation questions Identify data sources and collection methods Discuss next steps

Analyze & Interpret Information Stages of M&E Plan the Evaluation Engage Stakeholders Engage Stakeholders Report & Use the Results Collect Information Analyze & Interpret Information

Reasons for Participatory Evaluation Obtain better quality data Because the evaluation will be more relevant, more likely to have the results used Foster greater ownership Develop evaluation capacity

An evaluation plan is your roadmap Unit 2: Evaluating outcomes An evaluation plan is your roadmap (University of Wisconsin-Extension, Program Development & Evaluation) Outcome Evaluation for Community Organizations 6

Steps to M&E Planning Describe the project Identify major stakeholders and their information needs and uses Define the M&E purpose(s) Formulate M&E questions and indicators Identify sources of information and data collection methods Determine ways to analyze the M&E data Decide how to report and facilitate the use of the M&E results Time: 2:00 – 2:15, Energizer Explain slide, 15 minutes, 2:15 – 2:30

Step 2: Evaluation Stakeholder Analysis Major Stakeholder Groups What information do they need from the evaluation? How will they use the results of the evaluation?

Step 3: Define the Purpose(s) of the Evaluation  How will the information be used?

Unit 4: Focus the evaluation Underlying purpose = LEARNING Outcome Evaluation for community Organizations 10

Common Purposes for M&E To be accountable and report to: Donors Program participants and community members Government To improve program (re)design, planning and implementation To obtain additional resources To advocate for particular issues To acknowledge and celebrate our successes Other ???

Step 3: Define Our Evaluation Purposes In your work groups, write a purpose statement: “We are conducting an evaluation of SEA Change in order to obtain information that will be used to:

Steps to M&E Planning Describe the project Identify major stakeholders and their information needs and uses Define the M&E purpose(s) Formulate M&E questions and indicators Identify sources of information and data collection methods Determine ways to analyze the M&E data Decide how to report and facilitate the use of the M&E results Time: 2:00 – 2:15, Energizer Explain slide, 15 minutes, 2:15 – 2:30

Step 4: Formulate Evaluation Questions What are Evaluation questions? Information needs stated as questions State what aspects or topic of the project will be addressed in the evaluation Provide: Focus Clarity

Time to focus, focus, focus . . . Unit 4: Focus the evaluation Time to focus, focus, focus . . . The secret to good MERL is focus, focus, focus And one way we become very focused is by using MERL questions and indicators (University of Wisconsin-Extension, Program Development & Evaluation) Outcome Evaluation for community Organizations 15

Step 4: Formulate Evaluation Questions What are typical types of evaluation questions?  Use the Logic Model What project activities have been implemented? Have they been implemented as planned? If not, why not? To what extent have expected outcomes been achieved?

Step 4: Formulate Evaluation Questions Other types of evaluation questions: Efficient use of resources? Effective in achieving project objectives? Is the project relevant? Are the activities and/or outcomes sustainable? To what extent has the project achieved its expected impact?

Step 5: Decide Sources of Information and Data Collection Methods Where will the information come from to answer the evaluation questions? What methods will be used to collect that information?

Project Element or Topic Data Collection Plan Project Element or Topic Evaluation Question Data Source and Collection Method

Next Steps Sign up for the Evaluation Committee, if you’re interested How should be share this with the rest of the CoP? How should we share this with Track B?