1. FAIMER 2007 1 Program Evaluation 1 Stewart Mennin Bill Burdick

2. FAIMER 2007 2 What is a Program? (Programme) Integration & curriculum change Faculty development Program evaluation Assessment of students Problem-based learning Information technology Community-based learning

3. FAIMER 2007 3 What is a Program? (Programme) Community health & education Clinical skills Certification Research in the sciences basic to medicine

4. FAIMER 2007 4 Overview What & why program evaluation Evaluation as research Rules & models Key components Design Challenges

5. FAIMER 2007 5 Why Program Curriculum Evaluatıon ? To understand changes Make informed decisions about resources Sustain quality of existing programs Document & better understand educational programs & events Educational research

6. FAIMER 2007 6 Valu E - Valu - ation What is valued? Need data  for short loop FB  for accreditation  to persuade  to continue changes

7. FAIMER 2007 7 Basic Rules Decision-linked research Evaluation to improve Multiple models & methods Co-evolution  program evaluation & curriculum

8. FAIMER 2007 8 Models Of Evaluation CIPP (Context, Input, Process, Product)  Stufflebeam Utilization-Focused  Patton Goal free Naturalistic Enquiry  Guba & Lincoln Kirkpatrick Logic Model To Improve ~ To Prove

9. FAIMER 2007 9 Kirkpatrick 4 Levels Evaluation of results (transfer or impact on society Evaluation of behavior (transfer of learning to workplace Evaluation of learning (knowledge or skills acquired Evaluation of reaction (satisfaction or happiness Long-term outcomes Intermediate outcomes Short-term outcomes

10. FAIMER 2007 10 Embedded Domains Societal Organizational Individual

11. FAIMER 2007 11 Composite Evaluation Model To improve User-oriented & continuous Decision-linked research Facilitate change Involve everyone Challenge program assumptions Keep change agenda alive Modified Logic Model

12. FAIMER 2007 12 Modified Logic Model OutcomesLong-termIntermediateShort-term