1. Evaluating Title IIID Programs

2. November 8, 2012 1:00-2:00 PM Webinar conference line toll free number (888)895-4286 Code 234049 Login information https://www2.gotomeeting.com/join/712383586/106280687

3. How do you Evaluate Title IIID Programs Is the program an evidence-based program? Highest Tier Does not require evaluation if you follow the program.

4. Intermediate Criteria Published in a peer-reviewed journal Uses pre-post tests or case controls Has dissemination products for use by community organizations

5. Minimum Criteria Evaluated to be effective for improving health, wellbeing or reducing disease, disability and or injury among older adults. Uses an appropriately credentialed practitioner Is backed by a peer-reviewed journal article on the activity Is ready to be used in the community

6. Steps Engage Participants Describe the program Focus the evaluation design Gather credible evidence Draw conclusions Ensure use and share lessons learned

7. Center for Disease Control Standards Utility Feasibility Propriety Accuracy

8. Supporting Documentation Journal Article demonstrating the activity is effective for improving the health, well being or reducing disease or disability among older adults. Evaluation of the program’s effectiveness for your participants. Credentialed Practitioner determined by the AAA Program or a health intervention OR AND

9. Why Evaluate When no research is available To meet AoA requirements For data driven decisions

10. When do you evaluate? At the beginning of your efforts Determine what you will measure To determine participant change at the end of the program To provide tailored results in the middle of the program To provide feedback on specific questions

11. What results do you need? Avoid measure mayhem Interact with participants on specific outcomes Evaluate only what you can control Get information that will help you determine if your program is effective or if you need to change direction

12. How do you evaluate? Determine who will evaluate Plan simple steps that are maintainable by staff Make evaluating routine Establish a plan to manage data, document results and publish findings

13. Examples of Evaluations Anecdotal stories or testimonials Surveys Pre and post tests Observations Use variety of data

14. Draw Conclusions What is the ultimate impact? Was the desired change accomplished? Look at short term, medium and long term results. What could be improved? Share your results.

15. Discussion What results do you want to evaluate? What can you measure to find the answer? Who will be responsible for the information?

16. References Evaluation of Health Promotion Programs for Older Adults: An Introduction. http://www.ncoa.org/improve- health/center-for-healthy-aging/content- library/EvaluatingEBPrograms_Intro.pdf http://www.ncoa.org/improve- health/center-for-healthy-aging/content- library/EvaluatingEBPrograms_Intro.pdf Evaluation Workshop PowerPoint. http://tracs.unc.edu/docs/cec/Program- Evaluation-Workshop.pdf http://tracs.unc.edu/docs/cec/Program- Evaluation-Workshop.pdf

17. Resources Administration on Aging Resource List of evidence-based programs: http://www.aoa.gov/AoARoot/AoA_Programs/HPW/Title_IIID/ind ex.aspx http://www.aoa.gov/AoARoot/AoA_Programs/HPW/Title_IIID/ind ex.aspx The Center for Health Aging (The National Council on Aging). Learning modules. www.healthyagingprograms.org/content.asp?secionid=67 The California Department of Aging http://www.aging.ca.gov/ProgramsProviders/AAA/Disease_Preve ntion_and_Health_Promotion/ http://www.aging.ca.gov/ProgramsProviders/AAA/Disease_Preve ntion_and_Health_Promotion/

18. Resources Evaluation Management Checklists by Western Michigan University Retrieved from: http://www.wmich.edu/evalctr/checklists/evaluation- management/ http://www.wmich.edu/evalctr/checklists/evaluation- management/ http://www.wmich.edu/evalctr/archive_checklists/cippcheckli st_mar07.pdf http://www.wmich.edu/evalctr/archive_checklists/cippcheckli st_mar07.pdf Developing an Effective Evaluation Plan http://www.cdc.gov/obesity/downloads/CDC-Evaluation- Workbook-508.pdf http://www.cdc.gov/obesity/downloads/CDC-Evaluation- Workbook-508.pdf

19. Resources A Framework for Program Evaluation http://www.cdc.gov/eval/framework/index.htm http://www.cdc.gov/eval/framework/index.htm http://www.cdc.gov/eval/materials/framew orksummary.PDF http://www.cdc.gov/eval/materials/framew orksummary.PDF Introduction to Program Evaluation for Public Health Programs: A Self-Study Guide http://www.cdc.gov/eval/guide/CDCEval Manual.pdf http://www.cdc.gov/eval/guide/CDCEval Manual.pdf