1. Evaluation of EHDI Programs Terry Foust Karen Muñoz Kathleen Watts NCHAM Technical Assistance

2. Why Evaluate?

3. Acountability Demonstrate program improvement over time Demonstrate evidence based practice Demonstrate attainment of program goals (1.3.6) Required by grants, funding agencies

4. Regular and continuous evaluation Identifies areas to work on for improvement. Example – Utah, Montana

5. Identify Star Performers

6. Levels of Evaluation Screening Diagnostic Early Intervention State Program Financing the program

7. Screening Level Statistics Number of live births Number and percent screened Number and percent missed Number and percent referred

8. Information needed to identify possible solutions Equipment at each hospital Screening protocol Screeners Screener training Designated program coordinator Notification of parent/physician/state Tracking protocol

9. Diagnostic Level Statistics Number and percent obtaining outpatient testing Number and percent identified with a hearing loss Average time lag between screening and diagnostic testing Average age of identification Number and percent lost to follow-up

10. Information needed to identify possible solutions Number of pediatric test sites with appropriate equipment Location of test sites Audiologist compliance with reporting procedures Protocol for linkage with EI

11. Early Intervention Level Statistics Number and % enrolled in EI Number and percent lost to follow-up Average age enrolled in EI Average age fit with amplification Average time lag between diagnosis and intervention

12. Information needed to identify possible solutions Timeliness of referrals to EI following diagnosis Timeliness of intervention following enrollment Training/knowledge of EI case managers on issues related to hearing loss Reporting protocol from EI to State EHDI coordinator

13. State Program Level Support Parent-to-parent family support Dissemination of resources for families Availability of medical home for all newborns Performance feedback from state to hospitals

14. Tracking and Quality Assurance Program improvement over time Identification of expected number of infants with hearing loss Attainment of program goals (1.3.6) Existence of periodic and ongoing evaluation, action plan, and monitoring Identification & implementation of educational needs

15. Information needed to identify possible solutions Existence of financial support for diagnostic testing, and amplification Existence of a hearing aid loaner program Mechanism for: Informing families Informing practitioners Dissemination of materials

16. How to Evaluate Hospital surveys Physician surveys Parent surveys Patient focus groups Getting patients back for follow up Data Analysis Hospital site visits

18. Hospital Survey

19. Physician Survey

20. Parent Surveys

21. Parent Focus Groups

22. Getting Patients Back for Follow Up How are programs getting patients back for follow up? Audiologists are key

23. Data Analysis Importance of tracking software Is it flexible enough to generate a wide variety of program statistics? Is it compatible with a variety of programs and equipment? Examples

24. Hospital Site Visits

25. Evaluation Forms www.infanthearing.org/programevaluation/

26. Lessons Learned From Site Visits Level of commitment to program is evident Challenges are brought to life Importance of onsite problem solving Equipment and data management processes are clear Staff input reflects program health

27. Summary Evaluation takes time and effort Must be well planned

28. Go Ahead and Jump In!