Program Theory and Logic Models (2) CHSC 433 Module 3/Chapter 5 Part 2 L. Michele Issel, PhD UIC School of Public Health.

Slides:



Advertisements
Similar presentations
Willing to spend the time! Self motivated! Self responsibility! (If you need something Ask For IT!!!!!) Ability to communicate! (Vocabulary) Write,
Advertisements

Research Strategies: Joining Deaf Educators Together Deaf Education Virtual Topical Seminars Donna M. Mertens Gallaudet University October 19, 2004.
INTEGRATING THEORY AND PRACTICE
CRITICAL THINKING The Discipline The Skill The Art.
Program Theory and Logic Models (1) CHSC 433 Module 2/Chapter 5 Part 1 L. Michele Issel, PhD UIC School of Public Health.
Basic Concepts of Strategic Management
Copyright © Allyn & Bacon (2007) Research is a Process of Inquiry Graziano and Raulin Research Methods: Chapter 2 This multimedia product and its contents.
2014 AmeriCorps External Reviewer Training Assessing Need, Theory of Change, and Logic Model.
Student Learning Outcomes Curriculum Change Request Academic Council Presentation Gary Howard Rosemary Hays-Thomas October 22, 2004.
Enhancing Data Quality of Distributive Trade Statistics Workshop for African countries on the Implementation of International Recommendations for Distributive.
Process Evaluation: Considerations and Strategies CHSC 433 Module 4/Chapter 8 L. Michele Issel UIC School of Public Health.
Overview of Community Assessment CHSC 433 Module 2/Chapter 4 UIC School of Public Health L. Michele Issel, PhD, RN.
Chapter 2: Accounting Theory & Research
PPA 502 – Program Evaluation
Fundamentals of Information Systems, Second Edition
PPA 502 – Program Evaluation
Chapter 15 Evaluation.
DED 101 Educational Psychology, Guidance And Counseling
2014 AmeriCorps State and National Symposium How to Develop a Program Logic Model.
Setting Goals and Objectives CHSC 433 Module 2/Chapter 6 L. Michele Issel, PhD UIC School of Public Health.
Introduction to Behavior Change Communication
Responsibilities and Resources. By the end of this training the attendee will: Identify at least three skills required to carry out the responsibilities.
Learning Outcomes from Report-Writing Unit
Health Program Effect Evaluation Questions and Data Collection Methods CHSC 433 Module 5/Chapter 9 L. Michele Issel, PhD UIC School of Public Health.
Incorporating Motivational Strategies Into Your Learning Plan Julia Bambach, MAT Education Services, DUHS.
How to Develop the Right Research Questions for Program Evaluation
Economic Evaluations, Briefly… CHSC 433 Module 6/Chapter 13 UIC School of Public Health L. Michele Issel, PhD, R N.
Developing an Effective Evaluation to Check for Understanding Susan E. Schultz, Ph.D. Evaluation Consultant PARK Teachers.
2014 AmeriCorps External Reviewer Training
Reporting and Using Evaluation Results Presented on 6/18/15.
McGraw-Hill © 2006 The McGraw-Hill Companies, Inc. All rights reserved. The Nature of Research Chapter One.
Instructional Design Diana Fisher. Instructional Design Instructional Design (ID) is a dynamic process with constant movement back and forth between steps.
Human Learning Aeman Alabuod. Learning Theory it is conceptual frameworks that describe how information is absorbed, processed, and retained during learning.
NORTH CAROLINA TEACHER EVALUATION INSTRUMENT and PROCESS North Carolina Department of Public Instruction Department of Public Instruction Standard V: Teacher.
Communication Degree Program Outcomes
The County Health Rankings & Roadmaps Take Action Cycle.
Health Program: Implementation CHSC 433 Module 4/Chapter 7 L. Michele Issel, PhD UIC School of Public Health.
Barry Williams1 Analyzing Learners & Context Dick & Carey, Chp. 5.
1 Introduction and Basic Elements of Advocacy. 2 What is advocacy? A systematic approach to changing policies and programs to reflect the needs of individuals.
Dimensions of Human Behavior: Person and Environment
Outcome Based Evaluation for Digital Library Projects and Services
Life Skills Development in the 4-H Youth Development Program San Luis Obispo County November 1, 2003 Richard P. Enfield, 4-H Youth Development Advisor.
Semester 2: Lecture 9 Analyzing Qualitative Data: Evaluation Research Prepared by: Dr. Lloyd Waller ©
Big Idea 1: The Practice of Science Description A: Scientific inquiry is a multifaceted activity; the processes of science include the formulation of scientifically.
Program Planning. Cycle of Planning Determine mission of organization Assess community Prioritize problems within resources Set goals and objectives Determine.
Organizing Your Information
KATHY CLARK PETERSEN, PH.D. STUDENT DEVELOPMENT, ASSISTANT TO THE VICE PRESIDENT MICHELLE CHEATEM ASSOCIATE DEAN OF STUDENTS JASPA SUMMER INSTITUTE JULY.
Logic Models and Theory of Change Models: Defining and Telling Apart
Purposes of Evaluation Why evaluate? Accountability: Justify trust of stakeholders (funders, parents, citizens) by showing program results (Summative)
Boston Geneva San Francisco Seattle Beginning the Evaluation Journey with FSG KCIC Boot Camp March 24, 2010 Prepared for:
Implementation and process evaluation: developing our approach Ann Lendrum University of Manchester Neil Humphrey University of Manchester Gemma Moss Institute.
When you judge ( evaluate ) a theory, you have to :- 1) differentiate between aspects of your personal preference & elements of flawed (not perfect.
ATL’s in the Personal Project
PPA 502 – Program Evaluation Lecture 2c – Process Evaluation.
CONDUCTING A PUBLIC OUTREACH CAMPAIGN IMPLEMENTING LEAPS IN CENTRAL AND EASTERN EUROPE: TRAINERS’ HANDBOOK Conducting a Public Outreach Campaign.
SOCIOLOGICAL INVESTIGATION
Why Do State and Federal Programs Require a Needs Assessment?
The Interactive Model Of Program Planning
Copyright © 2011 Wolters Kluwer Health | Lippincott Williams & Wilkins Chapter 5 Theory, Research, and Evidence-Based Practice.
Chapter 5 From Action to Impact. Opening Discussion Read the book case about Year Up and answer the following questions:  How important was it for Year.
Program Planning, Implementation & Evaluation Chapter 4, all pages Chapter 15, pp Chapter 17, all pages Chapter 18, all pages.
Developing a Framework In Support of a Community of Practice in ABI Jason Newberry, Research Director Tanya Darisi, Senior Researcher
Adrienne DiTommaso, MPA, CNCS Office of Research and Evaluation
Strategic Planning. What is Strategic Planning? Process to establish priorities on what you will accomplish in the future Forces you to make choices about.
A Professional Development Series from the CDC’s Division of Population Health School Health Branch Professional Development 101: The Basics – Part 1.
Risk Controls in IA Zachary Rensko COSC 481. Outline Definition Risk Control Strategies Risk Control Categories The Human Firewall Project OCTAVE.
Introduction Social ecological approach to behavior change
Chapter 7: Critical Thinking
Logic Models and Theory of Change Models: Defining and Telling Apart
Presentation transcript:

Program Theory and Logic Models (2) CHSC 433 Module 3/Chapter 5 Part 2 L. Michele Issel, PhD UIC School of Public Health

Theory (Part 1) & (Part 2) In Theory (Part 1), we cover: Model of the Health Problem as a starting point. What is the Program Theory What is the Effect Theory What is the Process Theory In Theory (Part 2), we cover: Good interventions The Pyramid Development of Program Theory Roots of program failure

Learning Objectives By the end of this module, you will be able to: 1. Define interventions and give examples of “good” interventions. 2. Outline the steps involved in developing a program theory. 3. Develop a program logic model. 4. Explain two ways in which a program can fail.

Program Theory The turquoise arrow on the far left signifies “first reflect, then do the details”.

It’s all about the intervention The Organizational Plan and the Service Utilization Plan (as the two main elements of the Process Theory) exist to enable the delivery of the intervention.

Elements of Effect Theory

Interventions l Are those actions done intentionally to have an effect on the program participants. l Are verbs. l Synonyms: medical treatments, pharmacological treatments, psychological therapy, public health regulation enforcement, policy formulation.

l Technologically feasible l Health gains must result l Be politically feasibility l Addresses societal priorities l Be manipulable l Have a reasonable cost Criteria of a Good Intervention

Interventions as Components l Is the intervention a single action or a series, group, package of actions? l Could each set of actions be delivered separately as a package? l Do the packages of actions have different effects? * If the intervention consists of packages, then the program has components!

Caveats to Components For each intervention, whether delivered singularly or as a program component, there needs to be: l A connection to the overall Effect Theory l An intervention theory l Supporting Organizational and Service Utilization Plans

Considering Community Increasing federal agency emphasis placed on changing health across entire communities, not just of individuals or groups of individuals.

Think Interventions and Program Theory Across the Pyramid

Examples of Interventions for Individuals and Community Individual Level Individual Level: Skills building Information giving Psychotherapy Emotional support Marital counseling Medications Medical or dental procedures Population Level: Population Level: Water fluoridation Media campaigns Immunization programs Policy formation Income supplements Insurance supplements Delivery system changes Air quality control Workplace safety

Approaches to Program Theory Development l Deductive ~ Systematically derive from empirical literature Systematically derive the theory for observations and data l Inductive ~ Articulate what is intuitively being to make a difference, infer from what is being done l User-focused ~ Ask the evaluation users how the program works

Deduce, Induce Deduction as common approach to generate Effect Theory. Induction as useful to identify the Espoused and Theory-in-Action ~ these are key to both Effect and Process Theories. Espoused=what claim to do Theory-in-Action=what is really done

Getting at Program Theory

Logic Models are... Graphic or tabular representation of how program processes are linked to outcomes Required of federal program grantees, and various foundation grantees. Revised and revised and revised as the planning evolves.

Limitations of Logic Models ! Do NOT explain how the intervention causes the effect ! Thus, the need for the Effect Theory based on the Model of the Health Problem.

The Logic of Logic Models Useful in:  Streamlining program and evaluation  Focusing on key, critical elements  Communicating complex ideas to variety of audiences  Checking that it all fits together

To Avoid Program Failures FIT l Choose empirically tested intervention based on a biological, psychological, behavioral, or social theory that FIT the health problem. FIT l Choose intervention that FIT the logics.  Program Theory is the reality check for those choices. It’s all about stacking the deck in your favor.

Causes of Program Failure l Non-Program No participants No program activities, no interventions l Wrong intervention Not appropriate, not effective for the problem l Unstandardized intervention Variations within program, across sites

Roots of Program Failure Adapted from Carol Weiss

Ending with An Example… The Model of the Health Problem for an example: Goal of Improving Birth Outcomes. ProcessEffect The Process and Effect components are shown.

Effect Theory Example Goal: Improve Newborn Health Status

Corresponding Logic Model Logic Model elements defined in yellow row. Very simplified! InputsProcessesOutputsOutcomes Resources, structures identified in the organizational plan Actions and Interventions explicated in the Services Utilization Plan Secondary products Changes in the target audience Health educators Program budget Location Supervision Organizational commitment Provide prenatal vitamins Provide nutritional education Handouts for participants Referrals to genetic testing No prenatal anemia No CNS defects Increased knowledge