Review of Selected Evaluation Approaches Daniel Kloepfer, MPP Margaret Hutzel, MPA

Selected Approaches Utilization–Focused Evaluation Developmental Evaluation Participatory Evaluation Empowerment Evaluation

Goals/Principles Utilization-Focused Enhance utility Developmental Program development and improvement Participatory Context specific-rooted in end users’ concerns Empowerment Explicit commitment to self-determination

Evaluator Role Utilization-Focused Direct engagement with intended users Developmental Facilitator Participatory Partnership with participants Empowerment Facilitator

Stakeholder Involvement Utilization-Focused Heavy—program implementers Developmental Heavy—program developers Participatory Heavy—program sponsors, managers and program beneficiaries Empowerment Heaviest—key program personnel and community stakeholders

Advantages Utilization-Focused Gives ownership to intended users Developmental Adaptive and flexible Participatory Improved understanding Build capacity Empowerment Build capacity Improved learning

Challenges Utilization Focused Time consuming, especially up-front Developmental Knowledge of the innovation Participatory Unclear purpose of participants. Requires more resources Empowerment Potentially viewed as less objective

Discussion What are some experiences using these approaches? What are your primary decision making factors when choosing an evaluation approach?

References Burke, B. (1998). Evaluating for a Change: Reflections on Participatory Methodology. New Directions for Evaluation, 43-56. Cousins, J., & Whitmore, E. (1998, winter). Framing Participatory Evaluation. New Directions for Evaluation no. 80, pp. 87-105. Fetterman, D. M., Kaftarian, S. J., & Wandersman, A. E. (1996). Empowerment Evaluation: Knowledge and tools for self-assessment and accountability. Thousand Oaks: Sage. Fetterman, D., & Wandersman, A. (2007, June). Empowerment Evaluation Yesterday, Today, and Tomorrow. American Journal of Evaluation, 179- 198. Flowers, A. B. (2010). Blazing an evaluation pathway: Lessons learned from applying utilization-focused evaluation to a conservation education program. Evaluation and Program Planning, pp. 165-171. Lam, C., & Shula, L. M. (2014). Insights on Using Developmental Evaluation for Innovating: A Case Study on the CoCreation of an Innovative Program. . American Journal of Evaluation, pp. 358-374.

References Mauricio Gaston Institute. (Retrieved from: http://www.hfrp.org/evaluation/the-evaluation -exchange/issue-archive/participatory-evaluation/, Retrieved on: 5/11/2017.) What Is Participatory Evaluation (PE)? What Are Its Roots? The Evaluation Exchange. Patton, M. (2011). Developmental Evaluation: applying complexity concepts to enhance innovation and use. New York: Guilford. Patton, M. Q. (1994). Developmental Evaluation. Evaluation Practice, 311-319. Patton, M. Q. (2012). Essentials of utilization-focused evaluation. Los Angeles: SAGE Publications. Patton, M. Q. (2016). What is Essential in Developmental Evaluation? On Integrity, Fidelity, Adultery, Abstinence, Impotence, Long-Term Commitment, Integrity, and Sensitivity in Implementing Evaluation Models. . American Journal of Evaluation, 250-265. Weiss, C. H. (1998). Evaluation Second Edition. Upper Sadle River: Prentice-Hall Inc. Zukoski, A. L. ( 2002, April). Participatory Evaluation: What is it? Why do it? What are the challenges? Policy and Practice(5).