1. Program Planning and Evaluation EAD 877 - April 2

2. A G E N D A 4/2 l Formulating Evaluation Plans l Making Recom- mendations and Communicating Results l Evaluation Reports - Eun- Young & Jamie l Case Study - Ann l Systematic Program Evaluation l Internship Experience

3. Let’s review: T of Learning is Linked to 5 Components - l 1. CONTEXT l 2. NEEDS and IDEAS l 3. OBJECTIVES l 4. INSTRUCTIONAL PLANS l 5. EVALUATION

4. Evaluation of Programs l Formulating an Evaluation Plan - part of Cafarrella’s Interactive Model l “Introducing a Framework for Evaluation” - Mark’s book - the goal of evaluating programs and policies - for social betterment

5. According to Scriven (a well- known expert on evaluation, we evaluate: l Programs l Policies l Products Examples? l Personnel l Performance l Proposals Examples?

6. What is Program Evaluation? l A process used to determine whether DESIGN & DELIVERY of a program were effective and whether the proposed OUT- COMES were met. l Used for ACCOUNTABILITY and DECISION MAKING

7. Judging the Value and Worth of a Program is not easy because: l Difficult to demonstrate that outcomes are tied to what happened in the program l Difficult to develop clear criteria upon which judgments are made l Some Planners don’t want to know - purely political/personal

8. Planning Systematic Program Evaluation - (see handout) l How will you find out what you need to know? l What approach will you use to find out what you need to know? l What will you do with the data when you find out what you need to know?

9. Making Recommendations and Communicating Results l The case of Barbara - director for continuing education l Did she use all the components of systematic evaluation? l What did she want to accomplish in her evaluation?

10. Barbara wanted to: l Let participants know they were being listened to - and use their ideas l Make sure the results were delivered to “powers that be” l Present results that “grabbed” people’s attention

11. Communicating Results “Even when reports are lively and interesting, often no real thought is given to getting key decision-makers to review and use the info”

12. Questions to ask when communicating the results of your evaluation: l What constitutes program success? l What are some suggestions for making recommendations about current and future programs? l What factors do program planners need to consider when communicating results?

13. More questions??? l Who is your audience? l How do you time your reports? l Will you followup? Ask your key stakeholders if they need any clarification? l What is the dollar value of personnel time for this activity?

14. Success? Failure? l Go back to case of Barbara l Learn from our mistakes, according to Sork l What led to this success/failure? l Do you believe what you are doing is right? l Did you compare before and after?

15. Suggestions for current or future programs? l Do you have a framework? Are you going to Revise Eliminate or Plan new program l Focal points: l Content l Instructional design l Transfer l Outcomes or Impact

16. 5 factors to consider: l Function - how will the data be used? l Scope/Audience - how comprehensive? l Content - tailor results to issues and concerns l Structure/Style - short reports or long l Format - formal, short reports, product display, case study, brochure, e-mail

17. Who is your Audience? l Individuals and groups intimately involved in the program l Current participants, future participants, senior management, advisory group, the public, instructors, staff

18. How do you time your report? l WHEN to SEND? l Immediately after program; after a holiday; a year later; when new volunteers are needed? l Timing is everything…..

19. Do you follow-up? l Informal? Formal? l Hallway? Coffee breaks? l Planned session; planned lunch? l Make sure info is HEARD, READ, TALKED ABOUT, CLARIFIED

20. Internship Program l Next Steps……… l Room Reserved for April 30 Erickson Hall, Room 250 from 4 p.m. to 6 p.m.