Mental Health Program Evaluation Template MHPET ONLINE

Objectives Participant will be able to… Determine whether the on-line MHPET is an appropriate tool for your setting. Determine what needs to be in place in order to use the on-line MHPET Learn the steps for using the on-line Mental Health Planning and Evaluation Template.

MHPET Purpose Enhance the evaluation of mental health services in the SBHC and/or in any school setting Improve mental health practices in the SBHC and/or in any school setting Collect data for school mental health advocacy and technical assistance efforts at NASBHC

Need for Quality Improvement in Mental Health in SBHCs Increased recognition that objective measures are needed for SBHC quality of care, especially in mental health Such a measure needs to recognize: –Many disciplines involved in providing MH services –Wide range of interventions –Limited translational research around best practice in schools

Qualifiers and Caveats Quality Improvement for mental health services in schools is new and unfamiliar territory Consider where your program is developmentally This is not about judgment i.e. good or bad, right or wrong Should not be tied to staff performance appraisal or funding

MHPET Development In January 2004 NASBHC convened a workgroup to develop an evaluation tool Adapted the School Mental Health Quality Assessment Questionnaire (MH-QAQ) developed by Mark Weist et al. at the Center for School Mental Health –Broadened questions from clinician to program level –Expanded questions to be inclusive of school staff and non-mental health providers –Shortened, fewer dimensions and indicators

MHPET web-based tool MHPET web-based tool Beta testing ’07-’08 April ’08 went online –Set up to be completed by teams –Individuals complete tool independently –Computer generates average score for team. –Teams go back 3-6 months later to complete a second time –Computer generates second set scores with comparison to first set.

Using the Web-Based MHPET

Principles for SBHCs Principles for SBHCs Supports the school Responds to the community Focuses on the student Delivers comprehensive care Advances health promotion activities Implements effective systems Provides leadership in adolescent and child health NASBHC_Principles_and_Goals_for_SBHCs.htm

Laura Hurwitz

James A Davis Middle School 1224 Clarendon Ave. Bessamer, AL 2

3

Set Two Survey will be available after… 3 James A Davis Middle School 1224 Clarendon Ave. Bessamer, AL Set Two Survey will be available after July 25, 2008

3 0

Using Results for Quality Improvement Indicators with scores of 3 or less are automatically flagged as potential areas for improvement Place the MHPET results in the context of other data. Raters select targeted areas for improvement (dimensions and/or indicators with averages that are low relative to others)

Using MHPET to identify improvement targets Parallel to goal setting with a student/client: –What are the strengths? –What areas are in need of improvement? –Realistic? –Obtainable? Examine the lowest rated indicators first. –Which of these can you impact in the next 6 months? “Halo effect” –By focusing on 2-3 indicators is there potential to positively impact others?

Continuous Quality Improvement: PDSA Identify areas for improving quality and resources for improving target areas (PLAN) Develop and implement improvement plan (DO) Compare scores 3-6 months later and assess progress (STUDY) Revise plan (ACT)

3 3

MHPET Next Steps Develop compendium of quality improvement resources for each indicator MHPET will have on-line link to resource for each indicator Develop training module on quality improvement (School Mental Health Capacity Building Partnership) Collect and analyze national data from MHPET

NASBHC Resources for Quality Improvement: Paper version currently available 42FB-BC7A-CEE165C701D9}/MHPET.pdf General mental health resources /k.85AC/mental_health.htm

Resource for Quality Improvement: The School Mental Health Connection In association with University of Maryland Center for School Mental Health (CSMH) 40 indicators of quality in school mental health services PowerPoints provide background information, a menu of suggested activities, helpful hints, web resources, and references

Other Resources for Quality Improvement Center for Health & Health Care in Schools UCLA Center for Mental Health in Schools National Technical Assistance Center for Children's Mental Health at Georgetown University Center for Child and Human Development IDEA Partnership

Contact Information Laura Hurwitz, LCSW Director, School Mental Health Programs , x 205 Deirdre Taylor Administrative Manager , x 204