1. Evaluation Overview Plus 50 Conference July 29 - 30, 2009 Washington, DC

2. Faces to Names and Voices: Your Evaluation Liaisons Kathleen Hentz Spokane Luzerne Richland Laura Bekes Central Florida Wake Tech Northern Virginia Samantha Chen Cape Cod Santa Fe Saint Louis Clark Western Dakota

3. Overview Why Evaluate? How Do You Evaluate the Plus 50 Initiative? How Do You Evaluate the Plus 50 Grantees?

4. Why Evaluate? DOCUMENT implementation CAPTURE lessons learned TRACK outcomes over time SHOW the effectiveness of a model

5. Overview Why Evaluate? How Do You Evaluate the Plus 50 Initiative? How Do You Evaluate the Plus 50 Grantees?

6. How Do You Evaluate the Plus 50 Initiative? Putting the evaluation puzzle pieces together: – Research Questions – Research Tools

7. Program Implementation: What progress have grantees made in implementing programs? Lessons Learned: What have grantees learned about what works and doesn’t work in program implementation? Participant Outcomes: Is program participation having the hoped-for results among the participants? Are they satisfied with the program? How Do You Evaluate the Plus 50 Initiative? Identifying Research Questions

8. Data Collection Worksheets Participant Surveys Key Informant Interviews How Do You Evaluate the Plus 50 Initiative? Identifying Appropriate Research Tools

9. How Do You Evaluate the Plus 50 Initiative? Implementation Assessment

10. What is the progress on workforce training and career development goals for each college? Data Collection Worksheets Key Informant Interviews How Do You Evaluate the Plus 50 Initiative? How is implementation progressing?

12. How Do You Evaluate the Plus 50 Initiative? Lessons Learned

13. "The fact that we have monthly enrollment is very helpful for the students. …People are laid off year-round not necessarily aligned with an academic calendar.” -Plus 50 College

14. "Short-term is very much in demand, as opposed to something long-term over many semesters. We’re looking at short-term programming that gets people out and on their way.” -Plus 50 College

15. "The registration process has a lot of steps. We do it for them – if they had to jump through all those hoops they might give up. The college has also allowed us to skip a few steps.” -Plus 50 College

16. How Do You Evaluate the Plus 50 Initiative? Participant Outcomes Evaluation

17. What outcomes do Plus 50 participants experience as a result of the their participation in training courses and career services? Participant Surveys

18. How Do You Evaluate the Plus 50 Initiative? Participant Outcomes Evaluation

20. “I will always remember you for caring and the important part you played in my success in securing a position with FedEx Express. …I received a call on Thursday to sign my offer letter on Friday at 10AM!!! ….There were times when I was almost running on empty. I wish many more success stories for the 50+ workforce people.” -Plus 50 Participant

21. How Do You Evaluate the Plus 50 Initiative? Participant Outcomes Evaluation “The classes made me more aware of where I wanted to be going in my career at this time in my life. Also reviewing my skills and abilities, personality traits and strengths, I was able direct my energies toward solid decisions.” -Plus 50 Participant

22. How Do You Evaluate the Plus 50 Initiative? Participant Outcomes Evaluation “Perhaps you could offer training in specifically targeted skills. For example, a one-hour [practical workshop] on Saturday morning – practice with e-mailing attachments, practice with storing folders, files, etc…..Practice time with a knowledgeable person would be good.” -Plus 50 Participant

23. How Do You Evaluate the Plus 50 Initiative? Additional Research Questions

24. How Do You Evaluate the Plus 50 Initiative? Other Things we Want to Know How is the Plus 50 Initiative raising public awareness about the issues of Plus 50 learners, and the model? What have we learned about what works well in mentorship relationships? How has the AACC staff supported grantees? Are the programs becoming sustainable, and what strategies work for sustainability?

25. Overview Why Evaluate? How Do You Evaluate the Plus 50 Initiative? How Do You Evaluate the Plus 50 Grantees?

26. How Do You Evaluate the Plus 50 Grantees? Looking at Individual Colleges

27. Are colleges making progress against the goals set out in the proposal? Are colleges appropriately responding to lessons learned by finding ways to stay true to the overarching program objectives while changing implementation tactics to adjust to circumstances? How Do You Evaluate the Plus 50 Grantees? What is Success for Individual Colleges?

28. Information that helps inform AACC on individual college Plus 50 implementation and development: Progress Reports Site Visits Conference Calls Data Collection Worksheets Participant Surveys How Do You Evaluate the Plus 50 Grantees? What is Success for Individual Colleges?

29. What’s working? What would work better in the coming year? Thoughts on the Year 1 Evaluation

30. Participant Surveys Data Collection Forms for Year 2 Key Informant Interviews Evaluation Next Year

31. Questions

32. Thank You!