Corry Bregendahl Leopold Center for Sustainable Agriculture Ames, Iowa.

Slides:



Advertisements
Similar presentations
1 Instruments and Data Collection New Mexico AmeriCorps April 20, 2006 Sue Hyatt, Project STAR Coach.
Advertisements

Using Logic Models in Program Planning and Grant Proposals The Covenant Foundation.
Using Data to Measure and Report Program Impact Anne Basham, MFA MEMconsultants.
How to Evaluate Your Health Literacy Project Jill Lucht, MS Project Director, Center for Health Policy
Empowerment Knowledge and Skills + Implementation Empowering People.
Local School Involvement Community Engagement Landscape Analysis Localization Skills Sense of Place Stewardship of Resources Quality of Life.
Getting on the same page… Creating a common language to use today.
Dennis McBride, Ph.D. The Washington Institute (253) Goal Driven Logic Models.
Logic modeling. “Would you tell me, please, which way I ought to go from here?” “That depends a good deal on where you want to get to.” said the Cat.
So you need to do an evaluation! Bob Hamblen, Colorado State University.
The Lumina Center Grantseeking Workshop Series Presents Outcomes & Evaluations April 20, 2006.
Title I Needs Assessment and Program Evaluation
Evaluation. Practical Evaluation Michael Quinn Patton.
Defining & Reporting Our Successes Outputs, Outcomes and Impacts.
Molly Chamberlin, Ph.D. Indiana Youth Institute
How to Develop a Project Evaluation Plan Pat Gonzalez Office of Special Education Programs
How to Focus and Measure Outcomes Katherine Webb-Martinez Central Coast and South Region All Staff Conference April 23, 2008.
1 Qualitative Evaluation Terms Coding/categorization The process of condensing qualitative data through the identification of common themes. Data Matrix.
Program Planning & Evaluation Begin with the End in Mind Dr. Dallas L. Holmes Specialist Institutional Research Utah State University Extension.
Program Evaluation & Research In Service-Learning Service-Learning Mini-Institute Lynn E. Pelco, Ph.D. Division of Community Engagement.
The Evaluation Plan.
Measuring the effectiveness of your volunteer program Meals On Wheels Association of America 2011 Annual Conference August 30, 2011 Stacey McKeever, MPH,
Logic Models Handout 1.
Program Evaluation and Logic Models
WRITING EFFECTIVE GRANT PROPOSALS With an Eye toward Performance and Evaluation Issues.
1 Introduction to Evaluating the Minnesota Demonstration Program Paint Product Stewardship Initiative September 19, 2007 Seattle, WA Matt Keene, Evaluation.
Fundamentals of Evaluation for Public Health Programs ROBERT FOLEY, M.ED. NIHB TRIBAL PUBLIC HEALTH SUMMIT MARCH 31,
Outcome Based Evaluation for Digital Library Projects and Services
Introduction to Evaluation January 26, Slide 2 Innovation Network, Inc. Who We Are: Innovation Network National nonprofit organization Committed.
Cathy Burack and Alan Melchior The Center for Youth and Communities The Heller School for Social Policy and Management, Brandeis University Your Program.
Interactive Power Point Evaluating Your Program. Evaluating your Program First – Review the Steps Step 1 ◦State overall objectives Step 2 ◦State desired.
Logic Models and Theory of Change Models: Defining and Telling Apart
Foundations of Assessment I Understanding the Assessment Process.
UNPACKING RESULTS BASED MANAGEMENT (RBM) Module 1: Overview: A Whole Systems Approach Mosaic Workshop - Ottawa July 14-18, 2008.
Juggling the Program Management Ball 1. One day thou art an extension educator… The next day thou art a county director or district extension director…how.
Purposes of Evaluation Why evaluate? Accountability: Justify trust of stakeholders (funders, parents, citizens) by showing program results (Summative)
Futuring the Key to NC Success Pat Sobrero NC Urban Extension Summit May 11, 2005.
Julie R. Morales Butler Institute for Families University of Denver.
Prepared by the North Dakota State Data Center July HNDECA and ECCS Evaluation Dr. Richard Rathge Professor and Director North Dakota State Data.
Center for Leadership Development Guarantee The Money: Making Your Case Through Program Evaluation.
African Centre for Statistics United Nations Economic Commission for Africa Data for managing development Identifying gaps and setting priorities African.
M&E of policy influence some guidance thoughts…. Elements of a monitoring frame.. Policy objective and theory of change Indicators Data collection tools.
The Major Steps of a Public Health Evaluation 1. Engage Stakeholders 2. Describe the program 3. Focus on the evaluation design 4. Gather credible evidence.
Mapping the logic behind your programming Primary Prevention Institute
Wilder Research Evaluation 101 Workshop With Nicole MartinRogers, Ph.D. Great Lakes Culture Keepers the Mille Lacs Indian Museum and Trading.
Using Logic Models in Program Planning and Grant Proposals The Covenant Foundation.
Community Planning 101 Disability Preparedness Summit Nebraska Volunteer Service Commission Laurie Barger Sutter November 5, 2007.
1 A QTS Web Training Writing Consumer Education & Referral Outcomes.
Cultured monitoring and evaluation – getting it right Steven Marwick Evaluation Support Scotland.
Documenting Completion of your PDP
Copyright © 2014 by The University of Kansas Data Collection: Designing an Observational System.
Evaluation: from Objectives to Outcomes Janet Myers, PhD MPH AIDS Education and Training Centers National Evaluation Center
Making it Count! Program Evaluation For Youth-Led Initiatives.
Using Logic Models to Create Effective Programs
Does Your HHW Education Program Work? Workshop on Program Evaluation – Evaluation Logic Model NAHMMA Conference September 22, 2006 Tacoma, WA Trudy C.
Basic Program Logic RESOURCES/INPUTS The ingredients you need to implement your program! YOUR PROGRAM What you do to achieve your departmental goals! RESULTS/IMPACT.
Logic modeling. “Would you tell me, please, which way I ought to go from here?” “That depends a good deal on where you want to get to.” said the Cat.
Iowa State University Extension and Outreach College of Agriculture and Life Sciences Portfolio Development: Extension John Lawrence College of Agriculture.
Are we there yet? Evaluating your graduation SiMR.
Developing a Program Logic. What is a Program Logic? A program logic is like a roadmap for a project that sets out how a project will achieve its desired.
Assessment/Evaluation Make evaluation a central part of planning – not an afterthought 1) Determine Needs 2) Determine Desired Outcomes 3) Determine Activities.
Planning for Research Uptake through a Research Communication Strategy (ResCom)
Logic Models Performance Framework for Evaluating Programs in Extension.
A Hierarchy for Targeting Outcomes and Evaluating Their Achievement S. Kay Rockwell Professor and Evaluation Specialist Agricultural.
Utilizing the LOGIC MODEL for Program Design and Evaluation
Program Evaluation Essentials-- Part 2
Short term Medium term Long term
Logic Models and Theory of Change Models: Defining and Telling Apart
Resources Activity Measures Outcomes
Presentation transcript:

Corry Bregendahl Leopold Center for Sustainable Agriculture Ames, Iowa

Emerging from social sciences Focus on collecting and analyzing information on Context Project activities Outputs (publications, websites, research results, etc.) Outcomes (knowledge and behavior change) Impacts (long-term outcomes or systems change)

 Accountability  Funders  Partners  Decision making  Making adjustments  Leveraging future support  Financial resources  Partners

 Document how your work and Leopold Center investments are making a difference on Iowa  Farmers  Communities  Landscapes

 Measure outcomes of your work  Outcomes are short/medium term changes ▪ Occur 1-3 years after project start  Short-term outcomes ▪ Changes in knowledge, skills, attitudes, and confidence ▪ Who is changing besides yourself? ▪ How do you know? ▪ What evidence do you have?

 Measure outcomes of your work (cont.)  Medium-term outcomes ▪ Changes in behaviors, customs, and practices ▪ Whose behaviors are changing besides your own? ▪ How do you know? ▪ What evidence do you have?

 Summary of questions to consider when measuring outcomes  Am I the only who is changing?  Are target groups changing?  Who else is changing? Are partners or other organizations, agencies, institutions, or groups changing as a result of the work you are doing?

 Measure long-term changes or impacts of your work  Usually not apparent until several years after work begins  Are biological systems changing?  Is the landscape changing beyond your experimental plot?  Are socioeconomic systems changing?  Are institutional, organizational, or public policies changing?  How do you know change is happening?

 Because people say they’ve changed  Survey results, focus group, learning circle, and interview results  Because you or others have observed change  Scientific studies of environmental, biological, or social change  Secondary data sources (census data, satellite imagery, business records, tax statements, etc.)

 Confusing outputs with outcomes  Outcomes are evidence of change  Outputs are products generated by your project ▪ Research results (presentations, abstracts, papers, and other publications) ▪ Website pages and hits ▪ Training curricula ▪ Number of people attending project events  Outputs are NOT evidence of change

A desired condition or state of being Vision/GoalOutcomes Long-term outcomes (Impacts) Changes in systems Medium-term outcomes Changes in behaviors Short-term outcomes Changes in awareness, knowledge, skills, attitudes Time Outputs Research results Data (secondary or primary) Publications Presentations Websites Tools Educational curricula Contact lists Attendance lists Proceedings Other products Activities Contacting and engaging partners Meetings Conferences Workshops Field days Demonstrations Conference calls Setting up record-keeping systems Inputs Labor Money Equipment Software Hardware Research

 Consider how you will evaluate your project from the start  Integrate evaluation data collection into project activities  Measure what you can realistically influence  Focus on a few key indicators  Collect data that is easy to access  Collect data that is useful  Report the data