Allison Nichols, Ed.D. Extension Specialist in Evaluation.

Slides:



Advertisements
Similar presentations
Overview M&E Capacity Strengthening Workshop, Maputo 19 and 20 September 2011.
Advertisements

Logic modeling.
How to Evaluate Your Health Literacy Project Jill Lucht, MS Project Director, Center for Health Policy
2005 North American Pesticide Applicator Certification and Safety Education Workshop 1 Evaluate Your Applicator Training Outcomes Heather H. Boyd, Ph.D.
Dennis McBride, Ph.D. The Washington Institute (253) Goal Driven Logic Models.
Extension Program Evaluation Michigan Planning and Reporting System (MI PRS) Winter 2011Training.
Logic modeling. “Would you tell me, please, which way I ought to go from here?” “That depends a good deal on where you want to get to.” said the Cat.
Volunteer Recognition Honoring and recognizing individuals for their unique contribution to educational program efforts Honoring and recognizing individuals.
Reality Check For Extension Programs Deborah J. Young Associate Director University of Arizona Cooperative Extension.
How to Focus and Measure Outcomes Katherine Webb-Martinez Central Coast and South Region All Staff Conference April 23, 2008.
Program Evaluation and Logic Models
Fundamentals of Evaluation for Public Health Programs ROBERT FOLEY, M.ED. NIHB TRIBAL PUBLIC HEALTH SUMMIT MARCH 31,
Evaluation Assists with allocating resources what is working how things can work better.
Model mod·el noun \mä-d ə l\ 1:Structural design. 2:A usually miniature representation of something; a pattern of something to be made. 3:An example for.
Introduction to Evaluation January 26, Slide 2 Innovation Network, Inc. Who We Are: Innovation Network National nonprofit organization Committed.
Logic Models and Theory of Change Models: Defining and Telling Apart
Juggling the Program Management Ball 1. One day thou art an extension educator… The next day thou art a county director or district extension director…how.
Purposes of Evaluation Why evaluate? Accountability: Justify trust of stakeholders (funders, parents, citizens) by showing program results (Summative)
LCES Advisory Leadership System… The role of advisory leadership councils in Extension’s programming process.
Futuring the Key to NC Success Pat Sobrero NC Urban Extension Summit May 11, 2005.
Prepared by the North Dakota State Data Center July HNDECA and ECCS Evaluation Dr. Richard Rathge Professor and Director North Dakota State Data.
1 © 2010 Regents of the University of Minnesota. All rights reserved. 11 Logic Models A ROADMAP TO SUCCESS.
Desired Outcomes / Impacts ActionsKnowledge Occurs when there is a behavior change based upon what participants have learned (medium term): Development.
Using Logic Models in Program Planning and Grant Proposals The Covenant Foundation.
Outcome-based Planning and Evaluation Gloria Latimer, Ed.S, Director of Community Programs Jason Vahling, M.P.H., Community Program Specialist.
Basic Program Logic RESOURCES/INPUTS The ingredients you need to implement your program! YOUR PROGRAM What you do to achieve your departmental goals! RESULTS/IMPACT.
Getting to Outcomes: How to do strategic planning with your CRP Theresa Costello National Resource Center for Child Protective Services May 25, 2007.
Logic modeling. “Would you tell me, please, which way I ought to go from here?” “That depends a good deal on where you want to get to.” said the Cat.
Tips for Writing Measurable Goals, Objectives, and Impact Statements for FADs Allison Nichols WVU Extension Service.
Logic Models Performance Framework for Evaluating Programs in Extension.
A Hierarchy for Targeting Outcomes and Evaluating Their Achievement S. Kay Rockwell Professor and Evaluation Specialist Agricultural.
ADRCs Do What? Using Logic Models to Document and Improve ADRC Outcomes Glenn M. Landers.
Program Design Global Health Fellowship St Luke’s/Roosevelt New York.
Performance Measurement and PM-OTOOL Presented at the Abandoned Infants Assistance Grantee Kick-Off Meeting Washington, DC December 4, 2008 icfi.com ©
Logic Models How to Integrate Data Collection into your Everyday Work.
Evaluating the Quality and Impact of Community Benefit Programs
for CIT Program Operation Resource Development Institute
LOGIC MODEL A visual depiction of what a project does and what changes it is expected to bring about. Learn more: Readings, template, examples:
Designing Effective Evaluation Strategies for Outreach Programs
Evaluation – Theory and Practice Regina McGoff, business development coordinator, Extension Center for Agriculture, Food and Natural Resources Description:
M&E Basics Miguel Aragon Lopez, MD, MPH
Evaluation Plan Akm Alamgir, PhD June 30, 2017.
Grant Champions Workshop Logic Model Development
Using Logic Models in Program Planning and Grant Proposals
BEST PRACTICES IN LIBRARY INSTRUCTION FORUM November 7, 2007
Utilizing the LOGIC MODEL for Program Design and Evaluation
Ross O. Love Oklahoma Cooperative Extension Service
Program Evaluation Essentials-- Part 2
Short term Medium term Long term
Logic Model Template Inputs Activities Outputs Short-Term Outcomes
New Agent Professional Development
Outcomes and Evidence Based Programming
Logic Models and Theory of Change Models: Defining and Telling Apart
Logic modeling.
SUCCESSFUL MEASURING JAMES HARDIN, DIRECTOR, HEALTH IMPACT
FRAMEWORK OF EVALUATION QUESTIONS
Logic modeling.
Project Title: (PEARS Action Plan-Step 1)
What is a Logic Model? A depiction of a program showing what the program will do and what it is to accomplish. A series of “if-then” relationships that.
Resources Activity Measures Outcomes
Proposal Development Support & Planning
Getting Started as a Extension Educator
Writing Instructional Objectives
Logic modeling.
Using Logic Models in Project Proposals
What is your impact pathway?
BOOTCAMP SOCIAL INNOVATION ACCELERATOR TO CREATE LASTING CHANGE
What is a Logic Model? A depiction of a program showing what the program will do and what it is to accomplish. A series of “if-then” relationships that.
Framing Grants for policy Research
Logic modeling.
Presentation transcript:

Allison Nichols, Ed.D. Extension Specialist in Evaluation

 Anyone who delivers an educational session or program for WVUES ◦ Specialist ◦ County Agent ◦ Program Instructor ◦ Program Assistant

 Evaluation includes all efforts to determine the impact of our programs. ◦ Process evaluations to determine if our method of program delivery works  Keeping track of people and events  Determining which educational methods work and don’t work  Finding out what people like or don’t like ◦ Outcome/impact evaluations to determine if we are having an impact on individuals, communities, state, region, or nation.  Learning changes  Behavior changes  Conditional changes

 At the planning stage ◦ Determine what you want to know ◦ Figure out how to get the information you need  At the implementation stage ◦ Collect baseline data in order to calculate change  In the middle of the program ◦ Determine how things are going  At the end of the program ◦ Collect end-of-session data to compare with baseline data ◦ Collect satisfaction data (see handout)  After the program is over ◦ Collect information on how participants are doing

 It’s your job  Inquiring minds want to know ◦ USDA ◦ Grant Funders ◦ WVU ◦ Other Stakeholders  Participants  Citizens  County commissions  WV legislators  Other educators and researchers

SITUATIONSITUATION INPUTS What we invest Staff Volunteers Time Money Materials Equipment Technology Partners OUTPUTS Activities Participation What we do Workshops Meetings Counseling Facilitation Assessments Product development Media work Recruitment Training Who we reach Participants Customers Citizens OUTCOMES Short Medium Long What the short-term results are LEARNING Awareness Knowledge Attitudes Skills Opinions Aspirations Motivations What the medium term results are ACTION Behavior Skills Policies Procedures Certifications What the ultimate impact(s) is CONDITIONS Social Economic Civic Environment OUTCOMESINDICATORS METHODS All outcomes stated aboveHow will you know that you were successful in achieving each outcome? Description (200 farmers) Action (who used pesticides) Result (increased their output by 50%) How we will collect data Surveys Observations Focus groups Content analysis Tests/assessments Logs LOGIC MODEL: Program Performance Framework*

 Call Allison Nichols  Ask your colleagues  Join a program team that is working on an evaluation  Find resources on the Internet  Just jump in. Some information is better than no information

 Based on your Faculty Assignment Document  Choose goals and objectives  List programs, initiatives, and activities  Report each time you do an activity  Describe location, audience characteristics, products  Indicate effort time  Assign it to teaching, research, and service  Describe evaluation results

 You will be able to generate many types of reports, including ◦ FAD ◦ Productivity Reports ◦ Narratives ◦ County Reports ◦ Program Reports ◦ Volunteer Reports