Developing an Evaluation Plan

Slides:



Advertisements
Similar presentations
Project Monitoring Evaluation and Assessment
Advertisements

 Reading School Committee January 23,
Pestalozzi Children‘s Foundation emPower 2012 Monitoring & Evaluation Lecturers: Beatrice Schulter.
ISTEP: Technology Field Research in Developing Communities Instructor: M. Bernardine Dias CAs: Sarah Belousov and Ermine Teves Spring 2009.
Fundamentals of Evaluation for Public Health Programs ROBERT FOLEY, M.ED. NIHB TRIBAL PUBLIC HEALTH SUMMIT MARCH 31,
Assessment/Evaluation 1) Determine Desired Outcomes 2) Determine Activities to achieve outcome 3) Determine Indicators to measure whether you are making.
Copyright © 2014 by The University of Kansas Data Collection: Designing an Observational System.
Developing a Monitoring and Evaluation (M&E) Plan.
Dr. Kathleen Haynie Haynie Research and Evaluation November 12, 2010.
From Program Logic to Monitoring & Evaluation (M&E) Plan.
Measuring the Results of Your Volunteer Efforts With acknowledgement to Nikki Russell, United Good Neighbors of Jefferson County.
Strategic planning A Tool to Promote Organizational Effectiveness
EVALUATION An introduction: What is Audience Data and
Logic Models How to Integrate Data Collection into your Everyday Work.
PILOT SCHOOL PRINCIPAL EVALUATION
Evaluating the Quality and Impact of Community Benefit Programs
Project Management 6e..
Rebecca McQuaid Evaluation 101 …a focus on Programs Rebecca McQuaid
Assessment in student life
Avon Grove School District October 2009
Agcas Scotland Knowing your outcomes
An agency of the Office of the Secretary of Education and the Arts
Welcome to the Annual Meeting of Title I Parents
Functional Area Assessment
Data Collection Methods II
Classroom Skill Building
Right-sized Evaluation
Identify stakeholders:
Welcome to the Annual Meeting of Title I Parents
Superintendent Torlakson’s Advisory Task Force on Accountability and Continuous Improvement Meeting #4 2/22/2016.
Program Evaluation Essentials-- Part 2
Engineering Design Process
Documenting Success and Overcoming Failure
Evaluating CLE Community Legal Education Masterclass
Strategic Planning Setting Direction Retreat
Classroom Skill Building
Welcome to the Annual Meeting of Title I Parents
Classroom Skill Building
Gathering Information: Monitoring your Progress
Keeping cold things cold
Evaluate the effectiveness of the implementation of change plans
Evaluation Design Preliminary
Engineering Design Process
Transitional Interim Pastor
Collecting and Analyzing Data
A3 – Improving State Level Supports and Stakeholder Engagement through Effective Evaluation Kim Gulbrandson, Justyn Poulos – Wisconsin RtI Center Key.
Gathering Information: Monitoring your Progress
Developing an Evaluation Plan
Strategic Planning and Oversight: Students, Performance, and Finances
Module 8 ACTION PLANS.
Developing a Plan for Identifying Local Needs and Resources
Identify stakeholders:
Wednesday, December 1st Today’s Facilitators: Kim Glow & Cindy Dollman
The process of science.
Customer Satisfaction Survey: Volunteer Training Overview
2003 Annual NSDL PI Survey A Collaborative Formative Evaluation
Strategic Planning Final Plan Team Meeting
Assessment of Service Outcomes
Evaluation tools training
Key Building Blocks Evaluating Community Coalitions & Partnerships
Developing a Plan for Identifying Local Needs and Resources
Applied Software Project Management
Strategic Planning.
Data Collection: Designing an Observational System
Member Survey of Process: Ratings of Satisfaction
Project Management 6e..
Engineering Design Process
Project Management 6e..
Decision-Making Tree for Clusters/partners for using DTM Location Assessment to collect data This visual does not indicate that DTM coordinator should.
Integrating Gender into Rural Development M&E in Projects and Programs
Presentation transcript:

Developing an Evaluation Plan

Why should you have an evaluation plan? guides you through each step of the evaluation helps you decide what sort of information you and your stakeholders really need keeps you from gathering information that isn't needed helps you identify the best possible ways to get the needed information helps you come up with a reasonable and realistic timeline for evaluation helps you improve your initiative

When should you develop an evaluation plan? As soon as possible! The best time is before you implement the initiative. After that, you can do it anytime, but the earlier, the better.

What are the different types of stakeholders? Community groups Grantmakers and funders University-based researchers

Balancing costs and benefits: Ask the following questions: What do you need to know? What is required by the community? What is required by funding? Evaluation should take up about 10 - 15% of your total budget.

How do you develop an evaluation plan? Clarify program objectives and goals Develop evaluation questions Develop evaluation methods Set up a timeline for evaluation activities

Sample Evaluation Questions Who participates? How many hours? Why do participants enter and leave your programs? Are they satisfied? What services are given? Does it meet local needs? How has behavior changed? Is it beneficial?

Evaluation Methods Monitoring and feedback system Process & outcome measures, observations Member satisfaction survey Goal attainment scaling Behavioral surveys Interviews Community-level indicators

How do you set up a timeline for evaluation activities? Complete a table listing: Key evaluation questions Type of evaluation measures to be used to answer them Type of data collection Experimental design

How do you set up a timeline for evaluation activities? When do feedback and reports need to be provided? Whenever it's appropiate The end of the evaluation Periodically throughout the project o initiative

How do you set up a timeline for evaluation activities? When should evaluation end? After the project ends When the final report is due

What products should you get from the evaluation? A report includes: - Expected changes - Behavior changes - Community changes Specific tools Annual reports Quarterly/monthly reports Anything else agreed upon

What sort of standards should you follow? Fairness, accuracy, effectiveness The 1994 Joint Committee on Standards for Educational Evaluation standards Standards the committee outlined