1. Program Development and Evaluation Manager
Program Development and Evaluation – A Logical Match! Iowa Extension Council Association Conference March 10, 2018
Dr. Chad Higgins,
Senior Director
and
Keli Tallman,
Program Development and Evaluation Manager

2. Learning Objectives
After engaging in the breakout session, participants will be able to…
Define a research-based program
State a program’s learning objectives
Compare different methods for measuring program outcomes and impact

3. ISU Extension and Outreach’s Mission
ISU Extension and Outreach builds a strong Iowa by engaging all Iowans in research, education, and extension experiences to address current and emerging real-life challenges.

4. What is ISU Extension and Outreach’s Primary Product?
Research-Based Programs

5. What is a Research-Based Program?
A coordinated set of learning experiences based on relevant theories and research, designed to achieve anticipated/predetermined outcomes.

6. Key Phases of Program Development
Quality Program
Plan
Design
Implement
Measure & Report

7. Where Does Evaluation Fit?
At every phase of program development!
Quality Program
Needs and Assets
Assessment
Evaluability Assessment
Process Evaluation
Outcome and Impact Evaluation

8. Why is Evaluation Critical to Extension and Outreach Professionals?
Strengthens program development practices
Improves or further develops programming effectiveness
Informs current and future programming
Assists in decision making processes
Supports persuasive dialogue
Provides a systematic process for accurately sharing outcomes (private value) and impact (public value) with key stakeholders

9. Beginning with the End in Mind:
Developing Logic Models and Learning Objectives

10. What is a Logic Model?
Graphic representation that shows relationships among what is invested, what is done, and what results are accomplished.

11. What Questions Does a Logic Model Address?
What direction is the program headed?
What resources are needed for the program to be successful?
What anticipated difference(s) will the program make in the lives of individuals and the broader public?
How will we know if the program has reached its final destination?

12. Beginning with the End in Mind: Developing Learning Objectives
Critical initial step in assessing youth and adult learning.

13. Is There a Format for Writing Specific Learning Objectives?
The SMART Goal/Objective format is straight forward and useful!

14. 5 Elements of a Strong Learning Goal Objective
Specific M
Measurable A
Action-Oriented R
Realistic T
Timely

15. Let’s Analyze an Example Learning Objective! Is it SMART?
I want to achieve a better work-life balance.
Over the next 120 days, I want to achieve a better work-life balance.
Over the next 120 days, I want to achieve a better work-life balance by implementing two strategies for managing my work time.
Over the next 120 days, I will implement two strategies for managing my work time that will allow a 6:00 PM arrival home time three days per work week to achieve a better work-life balance.

16. Data Collection Methods
Data collection methods depend on program evaluation purpose and the questions requiring answers… methods follow purpose… goal to obtain trustworthy, authentic, and credible evidence

17. Common Data Collection Methods
Case Studies
Document Reviews (annual reports, census reports, diaries, letters, meeting minutes, newspaper archives, portfolios, photographs, videos, etc.)
Focus Groups
Interviews
Observations
Surveys
Tests

18. What Data Collection Method(s) is/are Appropriate for Your Selected Program?

19. Reflections and Questions
Please contact Keli Tallman, Program Development and Evaluation Manager, at

20. PowerPoint Sources
Correia, A.P., Cherrez, N.J., Chatterjee, R., & Saka, E. (2014). Effective Learning for Adults Handbook. Learning Design Solutions, Ames, IA: Iowa State University.
ISU Extension and Outreach. (2013). Curriculum review process definitions. Retrieved April 23, 2017 from the ISU Extension and Outreach MyExtension website:
ISU Extension and Outreach. (2017) Iowa state university extension and outreach annual report. Retrieved April 23, 2017 from the ISU Extension and Outreach website:
Knowles, M.S.(1970). The modern practice of adult education: From pedagogy to andragogy. New York, New York: The Association Press.
Marczak, M.S. & Troschinetz. A.M. (2013). A model of seamlessly integrating evaluation into the program life-cycle. St. Paul, MN: University of Minnesota Extension.

21. PowerPoint Sources (continued)
Purdue Extension Community Development. (2016). Logic models. Retrieved April 23, 2017 from the Purdue Extension Community Development website:
Smith, M. et al. (2017). Defining and developing curricula in the context of cooperative extension. Journal of Extension, 55(2), 1-8.
Taylor-Powell, E & Henert, E. (2008). Developing a logic model: Teaching and training guide. Madison, WI: UW-Extension, Program Development and Evaluation.
Teh, Ivan. (2016). Bloom’s Taxonomy – Cognitive. Retrieved on September 10, 2017 from
Texas A&M AGRILIFE Extension. (2014). Guidelines for documenting program excellence. College Station, TX: The Organizational Development Unit. Retrieved from