1. Copyright © 2008 Delmar. All rights reserved. Chapter 15 Program Development and Evaluation

2. Copyright © 2008 Delmar. All rights reserved. 2 Program Development Program development is the alignment of activities to meet an intended purpose

3. Copyright © 2008 Delmar. All rights reserved. 3 Program Development Program planning –Concept of program development –Requires Assessment and identification of a need Diagnosis of the need

4. Copyright © 2008 Delmar. All rights reserved. 4 Program Development Planning a strategic action plan –Implement the plan –Evaluate the plan

5. Copyright © 2008 Delmar. All rights reserved. 5 Program Development Frameworks in program development –Pollack (1994) pre-start up plan Mission statement clarification Stakeholder analysis Problem identification, strengths, weaknesses, opportunities, threats

6. Copyright © 2008 Delmar. All rights reserved. 6 Framework for Planning Process in Program Development Nutt (1984) identified planning steps –Formulating –Conceptualizing –Detailing –Evaluating –Implementing

7. Copyright © 2008 Delmar. All rights reserved. 7 Framework for Planning Process in Program Development Witkin and Altschuld (1995) developed a three phase plan for assessing –Pre-assessment –Main assessment –Post-assessment

8. Copyright © 2008 Delmar. All rights reserved. 8 Role of Economic Analysis Informs decision makers Does not tell decision maker if increased expenditure is worthwhile Not always available

9. Copyright © 2008 Delmar. All rights reserved. 9 Economic Analysis Five types of economic analysis: 1.Cost minimization analysis (CMA) 2.Cost consequence analysis (CCA) 3.Cost effectiveness analyses (CEA) 4.Cost utility analysis (CUA) 5.Cost benefit analysis (CBA)

10. Copyright © 2008 Delmar. All rights reserved. 10 Economic Analysis Three methods of valuation: 1.Discounting 2.Externalities 3.Intangibles

11. Copyright © 2008 Delmar. All rights reserved. 11 Program Evaluation Measures the implementation and outcomes of a program –Can be periodic assessment or on-going Program components –Program objectives –Program outputs –Program effects

12. Copyright © 2008 Delmar. All rights reserved. 12 Phases and Steps in Evaluation Identifying program objectives Selecting or creating measures of impacts Collecting data Interpreting data Disseminating the evaluation information

13. Copyright © 2008 Delmar. All rights reserved. 13 Evaluation and Program Manager Manager steps –Determine purpose of evaluation –Consider pros and cons Evaluator steps –Identify the purpose, objectives –Design rigorous evaluation

14. Copyright © 2008 Delmar. All rights reserved. 14 Planning/Implementing Practical Program Evaluation Six steps taken in any evaluation: 1.Engage stakeholders 2.Describe public health program 3.Focus evaluation design 4.Gather credible evidence 5.Justify program evaluation conclusions 6.Ensure use of evaluation and share lessons learned

15. Copyright © 2008 Delmar. All rights reserved. 15 Theoretical Foundations Program Theory –Model I Logic models Program processes –Formative evaluation –Summative evaluation

16. Copyright © 2008 Delmar. All rights reserved. 16 Model II Precede-Proceed Framework –P-predisposing –R-reinforcing –E-enabling –Constructs in –Education/environment –Diagnosis –Evaluation

17. Copyright © 2008 Delmar. All rights reserved. 17 Model II Proceed –P-policy –R-regulatory –O-organizational –Constructs in –Educational –Environmental –Development

18. Copyright © 2008 Delmar. All rights reserved. 18 Model II Precede-Proceed Model –Integrates evaluation, planning, and program planning

19. Copyright © 2008 Delmar. All rights reserved. 19 Model III Diffusion of innovations theory –Characteristics Takes an extended period of time People go through stages Some adopt innovations quickly, others may wait