Knowledge without boundaries. Outcome evaluation of PLIP projects: what, why and how? Ugne Lipeikaite PLIP Impact Manager www.eifl.net.

Slides:



Advertisements
Similar presentations
A Systems Approach To Training
Advertisements

Knowledge without boundaries. Linking Impact Evaluation to Local and National Policies to Sustain Innovation Ramune Petuchovaite PLIP Manager
Public Library Innovation. Public libraries play a vital role in community development
Key Criteria/Principles in selecting indicators Follow-up consultation on TFI Recommendations on Communication for EPI/Polio Dakar - Senegal, 05 and 07.
Introduction to Impact Assessment
M & E for K to 12 BEP in Schools
PM&E Participatory Monitoring and Evaluation Prepared by BMCalub.
Evaluation What, How and Why Bother?.
Overview M&E Capacity Strengthening Workshop, Maputo 19 and 20 September 2011.
Prepared by BSP/PMR Results-Based Programming, Management and Monitoring Presentation to Geneva Group - Paris Hans d’Orville Director, Bureau of Strategic.
Improve your Club’s project design and implementation Presented by: Ulrike Neubert SIE PD Ann-Christine Soderlund SIE APD.
Grantee Program Plan. Components of the Program Plan Goals  Objectives  Activities  Techniques & Tools  Outcomes/Change.
Monitoring and evaluation of carers’ services and projects Dr Andrea Wigfield - Associate Professor of Social Policy Centre for International Research.
Corry Bregendahl Leopold Center for Sustainable Agriculture Ames, Iowa.
Developing a Logic Model
Getting on the same page… Creating a common language to use today.
The Lumina Center Grantseeking Workshop Series Presents Outcomes & Evaluations April 20, 2006.
Logic Modeling for Success Dr Kathryn Wehrmann Illinois State University.
Evaluation. Practical Evaluation Michael Quinn Patton.
+ Monitoring, Learning & Evaluation Questions or problems during the webinar?
Choosing Your Primary Research Method What do you need to find out that your literature did not provide?
Key Performance Indicators
Dr. G. Johnson, Program Evaluation and the Logic Model Research Methods for Public Administrators Dr. Gail Johnson.
Departmental Assessment Process.  The institution identifies expected outcomes, assesses the extent to which it achieves these outcomes, and provides.
SESSION ONE PERFORMANCE MANAGEMENT & APPRAISALS.
Impact Evaluation: Initiatives, Activities, & Coalitions Stephen Horan, PhD Community Health Solutions, Inc. September 12, 2004.
Knowledge without boundaries Everything counts: impact stories leading to success Ramune Petuchovaite Ugne Lipeikaite EIFL-PLIP.
Nine steps of a good project planning
Edward M. Haugh Jr. ESC Consultant. III. Recommendations for Applying Outcomes Planning to ESC  I. Introduction to Outcomes Planning II. A Sample ESC.
This project is funded by the EUAnd implemented by a consortium led by MWH Logical Framework and Indicators.
Impact assessment framework
The Evaluation Plan.
Measuring the effectiveness of your volunteer program Meals On Wheels Association of America 2011 Annual Conference August 30, 2011 Stacey McKeever, MPH,
December 13, 2007 Session: “Performance Measurements for Transportation Libraries” Hank Zaletel, MTKN/Iowa DOT Library/CTRE Maggie Sacco, Transportation.
Logic Models Handout 1.
Program Evaluation and Logic Models
1 Introduction to Evaluating the Minnesota Demonstration Program Paint Product Stewardship Initiative September 19, 2007 Seattle, WA Matt Keene, Evaluation.
If you don’t know where you’re going, any road will take you there.
Fundamentals of Evaluation for Public Health Programs ROBERT FOLEY, M.ED. NIHB TRIBAL PUBLIC HEALTH SUMMIT MARCH 31,
Outcome Based Evaluation for Digital Library Projects and Services
Introduction to Evaluation January 26, Slide 2 Innovation Network, Inc. Who We Are: Innovation Network National nonprofit organization Committed.
OBJECT ORIENTED SYSTEM ANALYSIS AND DESIGN. COURSE OUTLINE The world of the Information Systems Analyst Approaches to System Development The Analyst as.
Monitoring & Evaluation: The concepts and meaning Day 9 Session 1.
W HAT IS M&E  Day-to-day follow up of activities during implementation to measure progress and identify deviations  Monitoring is the routine and systematic.
Monitoring and Evaluation of GeSCI’s Activities GeSCI Team Meeting 5-6 Dec 2007.
Model Name Transition Project Learning Network Workshop 3 IYF Transition Project.
Center for Leadership Development Guarantee The Money: Making Your Case Through Program Evaluation.
Measuring and reporting outcomes for BTOP grants: the UW iSchool approach Samantha Becker Research Project Manager U.S. IMPACT Study 1UW iSchool evaluation.
EVALUATION OF HRD PROGRAMS Jayendra Rimal. The Purpose of HRD Evaluation HRD Evaluation – the systematic collection of descriptive and judgmental information.
M&E of policy influence some guidance thoughts…. Elements of a monitoring frame.. Policy objective and theory of change Indicators Data collection tools.
“A Truthful Evaluation Of Yourself Gives Feedback For Growth and Success” Brenda Johnson Padgett Brenda Johnson Padgett.
Innovation Network, Inc. Program Logic Model Program Planning Communication Evaluation.
Monitoring and Evaluation
Impact MSQ FOLIO course. What is impact? ‘ Impact’ is the difference that is made to individuals, organisations or communities by library services (1)
1 The project is financed from the European Union funds within the framework of Erasmus+, Key Action 2: Cooperation for innovation and the exchange of.
Basic Program Logic RESOURCES/INPUTS The ingredients you need to implement your program! YOUR PROGRAM What you do to achieve your departmental goals! RESULTS/IMPACT.
Monitoring and Evaluation in the GMS Learning Program 7 – 18 May 2012, Mekong Institute, Khon Kaen, Thailand Randy S. Balaoro, CE, MM, PMP Data Collection.
What is Impact Evaluation … and How Do We Use It? Deon Filmer Development Research Group, The World Bank Evidence-Based Decision-Making in Education Workshop.
Session 2: Developing a Comprehensive M&E Work Plan.
Childhood Neglect: Improving Outcomes for Children Presentation P21 Childhood Neglect: Improving Outcomes for Children Presentation Measuring outcomes.
Developing a Program Logic. What is a Program Logic? A program logic is like a roadmap for a project that sets out how a project will achieve its desired.
1 Outcomes: Outcomes: Libraries Change Lives — Libraries Change Lives — Oh yeah? Prove it. Oh yeah? Prove it. The Institute of Museum and Library Services.
Identifying Monitoring Questions from your Program Logic.
How to show your social value – reporting outcomes & impact
Gathering a credible evidence base
Monitoring and Evaluation
BEST PRACTICES IN LIBRARY INSTRUCTION FORUM November 7, 2007
بسم الله الرحمن الرحيم.
Troubleshooting Logic Models
Outcomes Based Evaluation
Presentation transcript:

Knowledge without boundaries

Outcome evaluation of PLIP projects: what, why and how? Ugne Lipeikaite PLIP Impact Manager

What is outcome evaluation? changesOutcomes are changes in attitude, behavior, skills, knowledge or situation of target audience brought be a project resultLibrary outcome - the eventual result of using library services, the influence the use had, and its significance to the user proveOutcome evaluation - if a program says it will change the lives of a certain population group, how does it prove it actually did?

Project Vehicle to get to the destination Outcomes Intended destinations Monitoring Whether we are on the right road Outcome evaluation Whether we have arrived at out destination

Why doing this? informsimproves confirmsEvaluation is the gathering of meaningful data that that informs, improves, or confirms. It is a tool for : Management decisions Accountability for your resources Library advocacy

What to measure? Inputs - something that is put in to achieve result e.g. number of staff, computers Inputs - something that is put in to achieve result e.g. number of staff, computers Activities – number of tasks which must be completed to achieve result e.g. training, events, services installed Activities – number of tasks which must be completed to achieve result e.g. training, events, services installed Outputs - immediate countable result of a activities e.g. number of sessions organized, number of people trained Outputs - immediate countable result of a activities e.g. number of sessions organized, number of people trained Outcomes – benefits and or changes resulting from performance of the activity e.g. increased income, improved employment prospects Outcomes – benefits and or changes resulting from performance of the activity e.g. increased income, improved employment prospects OUTCOME MAP

Example - Macedonia Inputs 13 laptops, printer, 43 books on of job search Inputs 13 laptops, printer, 43 books on of job search Activities – basic computer skills and interactive trainingsHow to find a job Activities – basic computer skills and interactive trainingsHow to find a job Outputs – 82 unemployed people trained Outcomes – Out of 82 trained people 39 (47,56%) have successfull y found jobs

How to measure? PredefinedoutcomesPredefined outcomes – what PLIP is aiming to achieve together with you? Individualized indicatorsIndividualized indicators - what will tell you that change is occurring/has occurred, and capture trends over time? Agreed data collection planAgreed data collection plan and tools

Sources of data Library statistics Surveys Interviews and focus groups Analysis of documents (reports, minutes of meetings, policy documents…) Case studies (groups and/or individuals)

Thank you!