Evaluation of EHDI Programs Terry Foust Karen Muñoz Kathleen Watts NCHAM Technical Assistance

Why Evaluate?

Acountability Demonstrate program improvement over time Demonstrate evidence based practice Demonstrate attainment of program goals (1.3.6) Required by grants, funding agencies

Regular and continuous evaluation Identifies areas to work on for improvement. Example – Utah, Montana

Identify Star Performers

Levels of Evaluation Screening Diagnostic Early Intervention State Program Financing the program

Screening Level Statistics Number of live births Number and percent screened Number and percent missed Number and percent referred

Information needed to identify possible solutions Equipment at each hospital Screening protocol Screeners Screener training Designated program coordinator Notification of parent/physician/state Tracking protocol

Diagnostic Level Statistics Number and percent obtaining outpatient testing Number and percent identified with a hearing loss Average time lag between screening and diagnostic testing Average age of identification Number and percent lost to follow-up

Information needed to identify possible solutions Number of pediatric test sites with appropriate equipment Location of test sites Audiologist compliance with reporting procedures Protocol for linkage with EI

Early Intervention Level Statistics Number and % enrolled in EI Number and percent lost to follow-up Average age enrolled in EI Average age fit with amplification Average time lag between diagnosis and intervention

Information needed to identify possible solutions Timeliness of referrals to EI following diagnosis Timeliness of intervention following enrollment Training/knowledge of EI case managers on issues related to hearing loss Reporting protocol from EI to State EHDI coordinator

State Program Level Support Parent-to-parent family support Dissemination of resources for families Availability of medical home for all newborns Performance feedback from state to hospitals

Tracking and Quality Assurance Program improvement over time Identification of expected number of infants with hearing loss Attainment of program goals (1.3.6) Existence of periodic and ongoing evaluation, action plan, and monitoring Identification & implementation of educational needs

Information needed to identify possible solutions Existence of financial support for diagnostic testing, and amplification Existence of a hearing aid loaner program Mechanism for: Informing families Informing practitioners Dissemination of materials

How to Evaluate Hospital surveys Physician surveys Parent surveys Patient focus groups Getting patients back for follow up Data Analysis Hospital site visits

Hospital Survey

Physician Survey

Parent Surveys

Parent Focus Groups

Getting Patients Back for Follow Up How are programs getting patients back for follow up? Audiologists are key

Data Analysis Importance of tracking software Is it flexible enough to generate a wide variety of program statistics? Is it compatible with a variety of programs and equipment? Examples

Hospital Site Visits

Evaluation Forms

Lessons Learned From Site Visits Level of commitment to program is evident Challenges are brought to life Importance of onsite problem solving Equipment and data management processes are clear Staff input reflects program health

Summary Evaluation takes time and effort Must be well planned

Go Ahead and Jump In!