Role of Program Theory in Building Program Evaluations Joe E. Heimlich, Ph.D. The Ohio State University, Columbus, Ohio, USA The Institute for Learning.

Slides:



Advertisements
Similar presentations
Definition: A program logic model is a systematic, visual way to present a program It is a picture of why and how you believe a program will work.
Advertisements

2014 AmeriCorps External Reviewer Training Assessing Need, Theory of Change, and Logic Model.
Corry Bregendahl Leopold Center for Sustainable Agriculture Ames, Iowa.
Intelligence Step 4 - Determinant Analysis Population nutrition problems can not efficiently be addressed without understanding their causes Most problems.
Theory of Change, Impact Monitoring, and Most Significant Change EWB-UK Away Weekend – March 23, 2013.
A Program Evaluation Strategy The Causal Pathway.
Session Four: M&E System for AfT bankable projects UNITED NATIONS Economic and Social Commission for Western Asia (ESCWA) Expert Group Meeting on Monitoring.
Applying for Funding: What you Need to Succeed Mario R. Gravelle Learning & Innovation Analyst.
Getting on the same page… Creating a common language to use today.
Aim of the Research Identify academic programmes and teaching and learning processes that promote internationalisation(1) of the University in general,
Programming Techniques and Skills for Advisory Leaders Ralph Prince and Roger Rennekamp, Ph.D. University of Kentucky Cooperative Extension Service.
HOW VOLUNTEERS MAKE A DIFFERENCE: Identifying and Measuring Volunteer Outcomes Montgomery County May 2015 Pam Saussy and Barry Seltser, Pro Bono Consultants.
Molly Chamberlin, Ph.D. Indiana Youth Institute
Impact Evaluation: Initiatives, Activities, & Coalitions Stephen Horan, PhD Community Health Solutions, Inc. September 12, 2004.
Program Evaluation & Research In Service-Learning Service-Learning Mini-Institute Lynn E. Pelco, Ph.D. Division of Community Engagement.
Types of evaluation examine different aspects of performance Resources (Inputs) ActivitiesOutputs Short-Term Outcomes Intermediate Outcomes (through customers)
THE NATURE AND PURPOSE OF STRATEGIC PLANNING
Workshop Planning Sustainable Innovation 11:00-12:30.
Preparing for the Main Event Using Logic Models as a Tool for Collaboratives Brenda M. Joly Leslie M. Beitsch August 6, 2008.
 2008 Johns Hopkins Bloomberg School of Public Health The Strategic Communication Planning Process Gary Saffitz Center for Communication Programs Johns.
Model mod·el noun \mä-d ə l\ 1:Structural design. 2:A usually miniature representation of something; a pattern of something to be made. 3:An example for.
The Logic Model An Introduction. Slide 2 Innovation Network, Inc. Who We Are National nonprofit organization Committed to evaluation as a tool for empowerment.
Logic Models and Theory of Change Models: Defining and Telling Apart
Purposes of Evaluation Why evaluate? Accountability: Justify trust of stakeholders (funders, parents, citizens) by showing program results (Summative)
DrugEpi 4-3 Chance Module 4 Overview Context Content Area: Interpretation of Epidemiological Evidence Essential Question (Generic): Is the association.
Boston Geneva San Francisco Seattle Beginning the Evaluation Journey with FSG KCIC Boot Camp March 24, 2010 Prepared for:
Beyond logical frameworks to program impact pathways CIIFAD M&E Workshop 5 November 2011  135 Emerson Hall Sunny S. Kim, MPH PhD candidate Division of.
Julie R. Morales Butler Institute for Families University of Denver.
Prepared by the North Dakota State Data Center July HNDECA and ECCS Evaluation Dr. Richard Rathge Professor and Director North Dakota State Data.
 2008 Johns Hopkins Bloomberg School of Public Health Evaluating Mass Media Anti-Smoking Campaigns Marc Boulay, PhD Center for Communication Programs.
Nancy L. Weaver, PhD, MPH Department of Community Health School of Public Health Saint Louis University 16 July 2010 LOGIC MODEL FUNDAMENTALS.
PPA 502 – Program Evaluation Lecture 2c – Process Evaluation.
Center for Leadership Development Guarantee The Money: Making Your Case Through Program Evaluation.
The Major Steps of a Public Health Evaluation 1. Engage Stakeholders 2. Describe the program 3. Focus on the evaluation design 4. Gather credible evidence.
Copyright © 2010 Pearson Education, Inc. Publishing as Prentice Hall 1-1 Organizational Theory, Design, and Change Sixth Edition Gareth R. Jones Chapter.
Context Evaluation knowing the setting Context Evaluation knowing the setting.
Community Planning 101 Disability Preparedness Summit Nebraska Volunteer Service Commission Laurie Barger Sutter November 5, 2007.
Measuring Effectiveness and Impact VCSE Employment and Skills Conference 21st May 2014 Matthew Hill, South West Forum.
JUVENILE DELINQUENCY SECTION 1: THE STUDY OF JUVENILE DELINQUENCY.
Background, Philosophical Basis and Principles of Behavior.
Adrienne DiTommaso, MPA, CNCS Office of Research and Evaluation
Workshop #6: Measuring Access to Justice: Why is it important and how are we going to do just that? Society of Ontario Adjudicators and Regulators Annual.
Planning Evaluation Setting the Course Source: Thompson & McClintock (1998) Demonstrating your program’s worth. Atlanta: CDC/National Center for Injury.
 2007 Johns Hopkins Bloomberg School of Public Health Section B Logic Models: The Pathway Model.
Basic Program Logic RESOURCES/INPUTS The ingredients you need to implement your program! YOUR PROGRAM What you do to achieve your departmental goals! RESULTS/IMPACT.
CHAPTER 4 Conceptualize Phase. Introduction What is Conceptualize Development? The specification of the key elements of the theory, with their relationships.
1 How to Become a Strategic Communicator. 2 Topics Communications: The Big Picture Building a Communications Strategy.
Jodi Drisko, MSPH Parametrix Group, LLC. Objectives Increase knowledge of how evaluation fits in with other agency priorities Increase understanding of.
Identifying Monitoring Questions from your Program Logic.
Logic Models Performance Framework for Evaluating Programs in Extension.
Developing a Monitoring & Evaluation Plan MEASURE Evaluation.
ADRCs Do What? Using Logic Models to Document and Improve ADRC Outcomes Glenn M. Landers.
Performance Measurement and PM-OTOOL Presented at the Abandoned Infants Assistance Grantee Kick-Off Meeting Washington, DC December 4, 2008 icfi.com ©
Strategy Development Processes. Learning Outcomes (1) Explain what is meant by intended and emergent strategy development Identify intended process strategy.
Theory of Change Jon Kolko Professor, Austin Center for Design.
SLOs: What Are They? Information in this presentation comes from the Fundamentals of Assessment conference led by Dr. Amy Driscoll and sponsored by.
Health Education THeories
Introduction to Program Evaluation
Alan Duncan NBDC Reflection Workshop Nov 2012
Short term Medium term Long term
Logic Models and Theory of Change Models: Defining and Telling Apart
Program Planning and Evaluation Essentials
Program Planning and Evaluation Methods
4.2 Identify intervention outputs
What is a Logic Model? A depiction of a program showing what the program will do and what it is to accomplish. A series of “if-then” relationships that.
Troubleshooting Logic Models
Using Logic Models in Project Proposals
What is a Logic Model? A depiction of a program showing what the program will do and what it is to accomplish. A series of “if-then” relationships that.
Framing Grants for policy Research
Presentation transcript:

Role of Program Theory in Building Program Evaluations Joe E. Heimlich, Ph.D. The Ohio State University, Columbus, Ohio, USA The Institute for Learning Innovation, Annapolis MD, USA

What is Program Theory? Program Theory links program strategies with the intended outcomes Program Theory suggests cause and effect relationships throughout a program Program Theory attempts to illustrate the theory of how a program is supposed to work

What is “logic modeling”? A logic model is a tool for examining a program so that we see how it “logically” fits together We use the logic model to apply “program logic” which says there is a way of measuring a program using causal linkages We use program logic based on “Program Theory” which explains these causal links

A logic model… Specifies cause and effect relationships. CONTEXT Resources Activities Outputs Audiences Outcome 1 Outcome 2 Outcome 3 Outcome 4

The model… Links the strategy with its intended outcomes. CONTEXT Resources Activities Outputs Audiences Outcome 1 Outcome 2 Outcome 3 Outcome 4 STRATEGYINTENDED OUTCOMES

A logic model…. Ties together the key theories supporting the logic of the program. CONTEXT Resources Activities Outputs Audiences Outcome 1 Outcome 2 Outcome 3 Outcome 4

A generic logic model The Strategy Short and Long Term Outcomes from employing the strategy It’s a diagram of the theory of how a program is supposed to work

In other words… Within a certain context Resources are used to create A set of activities/tactics Designed to produce outputs – products or services For predetermined audiences

Which leads to… These audiences react to the outputs. If positive, reactions are more likely to lead to an increase in knowledge, a positive attitude, new skills, and aspirations to change behavior. If these short-term outcomes occur, behavior is more likely to be sustained or changed.

And THIS leads us to… If numbers of people change behavior… And they encourage larger groups to change… Then there is a greater chance that conditions related to the long-term mission will also change (social, economic, environmental, political).