Craig W. Bowen, slide 1 A Model for Program Evaluation: The Logic Model InputsProcessOutputsOutcomes Demand Staff Operating funds Facilities IT Training.

Slides:



Advertisements
Similar presentations
A Systems Approach To Training
Advertisements

Planning M&E to Tell Our ACSM Story. Objectives Discuss how ACSM activities can address barriers to help reach national TB control targets. Describe how.
Donald T. Simeon Caribbean Health Research Council
Managing Resources Responsibly Chapter 3. Factors Affecting Costs of Health Care.
Making a Difference: Measuring Your Outcomes Montgomery County Volunteer Center February 4, 2014 Pam Saussy and Barry Seltser, Consultants.
Engaging Students in the Quality of Learning and Teaching [Your name] [Your role]
Logic modeling. “Would you tell me, please, which way I ought to go from here?” “That depends a good deal on where you want to get to.” said the Cat.
The Lumina Center Grantseeking Workshop Series Presents Outcomes & Evaluations April 20, 2006.
IASCE Conference Athlone October 7 th & 8 th 2004 Responsive Evaluation. Working with Stakeholders: A review of the Open Training College Quality Assurance.
STRATEGIC MANAGEMENT & BUSINESS POLICY 12 TH EDITION THOMAS L. WHEELEN J. DAVID HUNGER.
Monitoring and Evaluation Frameworks   What is an M&E Framework?   Why do we use M&E Frameworks?   How do we develop M&E Frameworks? MEASURE Evaluation.
Logic Models. A logic model is your program ROAD MAP. Where are you trying to go? How are you trying to get there? What will tell you that you’ve arrived?
Validity of Selection. Objectives Define Validity Relation between Reliability and Validity Types of Validity Strategies.
Islamic Republic of Afghanistan Ministry of Education EMIS Directorate.
OUTCOME MEASUREMENT TRAINING Logic Models OBJECTIVES FOR TODAY: n Recognize and understand components of a logic model n Learn how to create a logic.
Comprehensive Assessment System Webinar #6 December 14, 2011.
TOOLS FOR POLICY DEVELOPMENT AND ANALYSIS Goals and Objectives.
1 Introduction to State Logic Models and Related Planning Stephanie Lampron, NDTAC.
This project is funded by the EUAnd implemented by a consortium led by MWH Logical Framework and Indicators.
Too expensive Too complicated Too time consuming.
Program Evaluation and Logic Models
HSA 171 CAR. 1436/ 7/4  The results of activities of an organization or investment over a given period of time.  Organizational Performance: ◦ A measure.
Unit 10. Monitoring and evaluation
EVALUATION RESEARCH. Evaluation Research  How do we begin?  What are the different types of evaluation research?  How do these different types fit.
Approaches to quality assurance TIPA’s perspectives Fatmir Demneri.
The Logic Model An Introduction. Slide 2 Innovation Network, Inc. Who We Are National nonprofit organization Committed to evaluation as a tool for empowerment.
ABE Orientation/Counseling A Special Population = A Special Set of Procedures.
Purpose of field research designs Types of field studies Planning a field study Sampling plan Questionnaire design Data analysis Special concerns in field.
Monitoring and Evaluation of Public- Private Dialogues Jesse Biddle Center for International Development State University of New York And Benjamin Herzberg.
 How do we begin?  What are the different types of evaluation research?  How do these different types fit together?  What purpose do they serve?
Validation of a Toolkit to Assess the Communication Climate in Health Care Organizations Matthew Wynia, MD, MPH, 1 Megan Johnson, MA, 1 Thomas P McCoy,
Indicators for ACSM.
Model Name Transition Project Learning Network Workshop 3 IYF Transition Project.
Impact Evaluation in Education Introduction to Monitoring and Evaluation Andrew Jenkins 23/03/14.
NORTH AMERICAN HEALTHCARE COMMITTEES. POLICY Facility shall have at least the following committees: Resident Care Infection Control Pharmaceutical Quality.
Engaging Students in the Quality of Learning and Teaching [Your name] [Your role]
Host: Don Pratt Monday, April 11, :30 – 10:30 AM EDT Monday, April 11, :30 – 10:30 AM EDT Performance Measures for PHCAST Demonstration Projects.
Regional Educational Laboratory at EDC relnei.org Logic Models to Support Program Design, Implementation and Evaluation Sheila Rodriguez Education Development.
1 Definitions  Input: organizational, intellectual, human, material and financial resources necessary for the implementation of an activity  Output:
Evaluating customer service delivery1 Summary Slide Evaluating Customer Service Delivery What is quality of service Benchmarking Using external quality.
1 Decision aiding in the Public Administration in Italy Interventions of MC decision aiding in different sectors of the Public Administration Logical classification.
Data Processing & Data Quality. A virtuous cycle The implicit assumptions underlying information systems are twofold: first, that good data, once available,
Reliability and Validity Themes in Psychology. Reliability Reliability of measurement instrument: the extent to which it gives consistent measurements.
Management Concepts. Definition of administration It is the process concerned with determining goals, objectives, policies and plans for which the organization.
ROOTS 1+2 Advocacy toolkit
Georgia Comprehensive Cancer Control Program 3/10/2015 Program Monitoring and Evaluation Activities Short-Term Outcomes Long-Term Outcomes Intermediate.
What IE is not and is not Male Circumcision Impact Evaluation Meeting Johannesburg, South Africa January 18-23, 2010 Nancy Padian UC Berkeley.
APR/SPP & SPDG The State Personnel… Performance Plan? …with the Improvement Activities of the SPP/APR Combining the goals and objectives of the SPDG…
Training on Safe Hospitals in Disasters Module 3: Action Planning for “Safe Hospitals”
Session 2: Developing a Comprehensive M&E Work Plan.
Developing a Program Logic. What is a Program Logic? A program logic is like a roadmap for a project that sets out how a project will achieve its desired.
Oversight “The NPPO of the exporting country has the responsibility for ensuring that systems for exports meet the requirements …”
© 2010 Jones and Bartlett Publishers, LLC. Chapter 12 Clinical Epidemiology.
What Does the Army Need to Accomplish Sustainability?
Identifying Monitoring Questions from your Program Logic.
Evaluation Planning Checklist (1 of 2) Planning Checklist Planning is a crucial part of the evaluation process. The following checklist (based on the original.
Integrated Planning Randy Lawson 411 Training April, 2016.
OUTCOME MEASUREMENT TRAINING
3.01 Understand Diagnostic and Therapeutic Services
Health Literacy: from concept to improving consumer outcomes
إستراتيجيات ونماذج التقويم
MANAGEMENT, STAFF, NATIONAL COALITION, FINANCIAL RESOURCES,
Introduction to M&E Frameworks
Health Literacy: from concept to improving consumer outcomes
ARIES: Why does it need to be included in the mai program?
NIH GCP Training Amy Jo Jenkins, Sr
Qualities of a good data gathering procedures
Arithmatic Logic Unit (ALU). ALU Input Data :  A0-A3  B0-B3 Output Data :  F0 – F3.
Presentation transcript:

Craig W. Bowen, slide 1 A Model for Program Evaluation: The Logic Model InputsProcessOutputsOutcomes Demand Staff Operating funds Facilities IT Training Policies Organization Project goals Short-term Long-term Procedures Approvals Workflow Work accomplished

Craig W. Bowen, slide 2 A Model for Program Evaluation: The Logic Model InputsProcessOutputsOutcomes Demand Staff Operating funds Facilities IT Training Policies Organization Project goals Short-term Long-term Procedures Approvals Workflow Work accomplished What they want

Craig W. Bowen, slide 3 A Model for Program Evaluation: The Logic Model InputsProcessOutputsOutcomes Demand Staff Operating funds Facilities IT Training Policies Organization Project goals Short-term Long-term Procedures Approvals Workflow Work accomplished What we do

Craig W. Bowen, slide 4 A Model for Program Evaluation: The Logic Model Inputs Initiative OutputsOutcomes Demand Staff Operating funds Facilities IT Training Policies Organization Project goals Short-term Long-term Procedures Approvals Workflow Work accomplished What if there is a gap between what they want and what they get? We try something—an initiative.

Craig W. Bowen, slide 5 A Model for Program Evaluation: The Logic Model InputsProcessOutputsOutcomes Performance monitoring Diagnostic monitoring

Craig W. Bowen, slide 6 A Model for Program Evaluation: The Logic Model InputsProcessOutputsOutcomes Performance monitoring Diagnostic monitoring Measures of Patient Care Improvement Measures of Participants’ Perceived Effectiveness of CME Experience

Craig W. Bowen, slide 7 A Model for Program Evaluation: The Logic Model InputsProcessOutputsOutcomes Performance monitoring Diagnostic monitoring Measures of Patient Care Improvement Measures of Participants’ Perceived Effectiveness of CME Experience Need measures of this. Then we can examine reliability and construct validity with just these data.

Craig W. Bowen, slide 8 A Model for Program Evaluation: The Logic Model InputsProcessOutputsOutcomes Performance monitoring Diagnostic monitoring Measures of Patient Care Improvement Measures of Participants’ Perceived Effectiveness of CME Experience Need measures of this that generate reliable and valid scores (that somebody else has already developed).

Craig W. Bowen, slide 9 A Model for Program Evaluation: The Logic Model InputsProcessOutputsOutcomes Performance monitoring Diagnostic monitoring Measures of Patient Care Improvement Measures of Participants’ Perceived Effectiveness of CME Experience Then we can examine predictive validity with the outputs data (i.e., what is the correlation?) r = ??