FAIMER 2007 1 Program Evaluation 1 Stewart Mennin Bill Burdick.

Slides:



Advertisements
Similar presentations
Reflection and Learning
Advertisements

Vitality Institute Commission Forum Commission Recommendations The Vitality Institute's mission is to advance knowledge about the evolving science and.
Introduction to Competency-Based Residency Education
Embedding Sustainability in the LTHE Programme Paula Jones and Fumiyo Kagawa Centre for Sustainable Futures 2008.
Training Kirkpatrick’s Four Levels of Evaluation Kelly Arthur Richard Gage-Little Dale Munson Evaluation Strategies for Instructional Designers.
What is a Program? An intentional effort to fulfill predetermined and important needs of people Single events or activities do not result in the types.
How to Use SBP Curricular Criteria for public health bachelor’s degrees in PHP and SPH Reviews March 2015 Arlington, VA.
Corry Bregendahl Leopold Center for Sustainable Agriculture Ames, Iowa.
“If you don’t know where you are going, how are you gonna’ know when you get there?” Yogi Berra Common Elements of Strong Program Evaluation THEORY OF.
Maine SIM Evaluation: Presentation to Steering Committee December 10, 2014.
Getting on the same page… Creating a common language to use today.
Logic modeling. “Would you tell me, please, which way I ought to go from here?” “That depends a good deal on where you want to get to.” said the Cat.
Faculty & Course Evaluation: was it worth all the effort ? Trevor Gibbs.
© 2011 Cengage Learning. All rights reserved. Chapter 1 Organizational Behavior and Opportunity 1.Define organizational behavior. 2.Identify four action.
Professional Development: Components for Technology Integration  Vision  Planning  Technology Skills Training  Evaluation & Assessment.
Analysing the Vision for the New Curriculum. Overall aims? Methods of delivery? How do students learn? How should they be assessed? How do you know that.
Role of Program Theory in Building Program Evaluations Joe E. Heimlich, Ph.D. The Ohio State University, Columbus, Ohio, USA The Institute for Learning.
Agenda: Block Watch outcome map Program Theory overview Evaluation theory overview Mentoring Evaluation Assignment 1 Evaluation Debrief.
ABET Accreditation Board for Engineering and Technology
Logic Model Workshop Community Interests Dawn Martz, Foellinger Foundation Mike Stone, Evaluation Consultant December 2013.
1 Qualitative Evaluation Terms Coding/categorization The process of condensing qualitative data through the identification of common themes. Data Matrix.
Step 2. Describe Program Logic Models & Outcome Measurement
HEFCE and Sustainable Development Joanna Simpson Policy Adviser.
Chapter 1 Organizational Behavior and Opportunity
Addictions Foundation of Manitoba Developing an evaluation of an accountability process in a provincial addiction agency David Patton, PhD. Addictions.
Health Career Recruitment and Retention Service-Based Learning.
Program evaluation 2: program theory Bill Burdick and Stewart Mennin.
School of Healthcare FACULTY OF MEDICINE AND HEALTH The design and delivery of an interdisciplinary MSc in Advanced Practice Professor Claire Hale.
Contribution Analysis: An introduction Anita Morrison Scottish Government.
Juggling the Program Management Ball 1. One day thou art an extension educator… The next day thou art a county director or district extension director…how.
 3:30 Simulation and curriculum integration Learning and competency assessment of students (Margaret Hindman)  4:15 Debriefing & simulation scenario.
Julie R. Morales Butler Institute for Families University of Denver.
SD60 Social Responsibility and Positive Behaviour Support Team Leader Training.
E-portfolios: Alternative Assessment for Allied Health Students Charles R. Drew University of Medicine and Science Dorothy Hendrix, M.Ed. Jaclyn Conner,
Program evaluation 1: outcomes Bill Burdick and Stewart Mennin.
Leading (and Assessing) a Learning Intervention IMPACT Lunch and Learn Session August 6, 2014 Facilitated By Ozgur Ekmekci, EdD Interim Chair, Department.
Dr. Shulagna Sarkar Assistant Professor , Jt. Coordinator – PGDM – HRM
The Major Steps of a Public Health Evaluation 1. Engage Stakeholders 2. Describe the program 3. Focus on the evaluation design 4. Gather credible evidence.
Working with Indigenous Simulated Patients in Extended Communication Skills Workshops Dr Eleanor Flynn Shaun Ewen Dr Jenny Schwarz Faculty of Medicine,
Scholarship in Medical Education Miguel Paniagua, MD, FACP American Geriatrics Society Meeting Orldando, FL May 2010.
Scaling Kirkpatrick's Pyramid: An Overview of Higher-level Evaluation Miguel Paniagua, MD, FACP American Geriatrics Society Meeting Orlando, FL Saturday,
Pragmatic Paradigm Dre Anthes, Amanda Baird, Dan Roberts, Becky Stone.
Program Evaluation DR. MAJED WADI. Objectives  Design necessary parameters used for program evaluation  Accept different views of program evaluation.
FAIMER Program Evaluation 3: How is it used? Evaluation as Research Stewart Mennin Bill Burdick.
Evaluation Plan Steven Clauser, PhD Chief, Outcomes Research Branch Applied Research Program Division of Cancer Control and Population Sciences NCCCP Launch.
Mathematics Performance Tasks Applying a Program Logic Model to a Professional Development Series California Educational Research Association December.
 2007 Johns Hopkins Bloomberg School of Public Health Section B Logic Models: The Pathway Model.
Artistic Performance short course consultation. Artistic Performance short course 100 hours of learning Taught over 1, 2 or 3 years Specified at a common.
Outcomes Focused planning NHS Health Scotland
Logic modeling. “Would you tell me, please, which way I ought to go from here?” “That depends a good deal on where you want to get to.” said the Cat.
Iowa State University Extension and Outreach College of Agriculture and Life Sciences Portfolio Development: Extension John Lawrence College of Agriculture.
Kaplan University Writing CenterSaturday, March 05, IX520 Needs Assessment and Evaluation in Education and Training Unit 7 Seminar September 13,
Interview Design Four Focal States Connecticut, Indiana, North Carolina, Massachusetts Additional States Arizona, Utah, Washington State Interview Protocol.
FAIMER Program Evaluation 2 Stewart Mennin Bill Burdick.
University of Utah Program Goals and Objectives Program Goals and Objectives Constituents U of U, COE, ASCE, IAB Constituents U of U, COE, ASCE, IAB Strategic.
Evaluating Training The Kirkpatrick Model.
Bruna Irene Grimberg, Ph.D. AEA 2013 Annual Conference Washington, D.C. PEER-TEACHER INSTRUCTIONAL COACHING IN K-6 RURAL SCHOOLS.
FAIMER Assessing Teaching Excellence John Norcini, Ph.D.
ASSESSING THE EFFECTIVENESS OF AN ENTREPRENEURIAL EDUCATION
Short term Medium term Long term
إستراتيجيات ونماذج التقويم
Logic modeling.
مدل زنجیره ای در برنامه های سلامت
Logic modeling.
Chapter 1 Organizational Behavior and Opportunity
Behavioral Sciences and Social Medicine
CCL Early Leadership Program Logic Model
Patient-Centered Clinical Method
Logic modeling.
Presentation transcript:

FAIMER Program Evaluation 1 Stewart Mennin Bill Burdick

FAIMER What is a Program? (Programme) Integration & curriculum change Faculty development Program evaluation Assessment of students Problem-based learning Information technology Community-based learning

FAIMER What is a Program? (Programme) Community health & education Clinical skills Certification Research in the sciences basic to medicine

FAIMER Overview What & why program evaluation Evaluation as research Rules & models Key components Design Challenges

FAIMER Why Program Curriculum Evaluatıon ? To understand changes Make informed decisions about resources Sustain quality of existing programs Document & better understand educational programs & events Educational research

FAIMER Valu E - Valu - ation What is valued? Need data  for short loop FB  for accreditation  to persuade  to continue changes

FAIMER Basic Rules Decision-linked research Evaluation to improve Multiple models & methods Co-evolution  program evaluation & curriculum

FAIMER Models Of Evaluation CIPP (Context, Input, Process, Product)  Stufflebeam Utilization-Focused  Patton Goal free Naturalistic Enquiry  Guba & Lincoln Kirkpatrick Logic Model To Improve ~ To Prove

FAIMER Kirkpatrick 4 Levels Evaluation of results (transfer or impact on society Evaluation of behavior (transfer of learning to workplace Evaluation of learning (knowledge or skills acquired Evaluation of reaction (satisfaction or happiness Long-term outcomes Intermediate outcomes Short-term outcomes

FAIMER Embedded Domains Societal Organizational Individual

FAIMER Composite Evaluation Model To improve User-oriented & continuous Decision-linked research Facilitate change Involve everyone Challenge program assumptions Keep change agenda alive Modified Logic Model

FAIMER Modified Logic Model OutcomesLong-termIntermediateShort-term