1. Mental Health Program Evaluation Template MHPET ONLINE

2. Objectives Participant will be able to… Determine whether the on-line MHPET is an appropriate tool for your setting. Determine what needs to be in place in order to use the on-line MHPET Learn the steps for using the on-line Mental Health Planning and Evaluation Template.

3. MHPET Purpose Enhance the evaluation of mental health services in the SBHC and/or in any school setting Improve mental health practices in the SBHC and/or in any school setting Collect data for school mental health advocacy and technical assistance efforts at NASBHC

4. Need for Quality Improvement in Mental Health in SBHCs Increased recognition that objective measures are needed for SBHC quality of care, especially in mental health Such a measure needs to recognize: –Many disciplines involved in providing MH services –Wide range of interventions –Limited translational research around best practice in schools

5. Qualifiers and Caveats Quality Improvement for mental health services in schools is new and unfamiliar territory Consider where your program is developmentally This is not about judgment i.e. good or bad, right or wrong Should not be tied to staff performance appraisal or funding

6. MHPET Development In January 2004 NASBHC convened a workgroup to develop an evaluation tool Adapted the School Mental Health Quality Assessment Questionnaire (MH-QAQ) developed by Mark Weist et al. at the Center for School Mental Health –Broadened questions from clinician to program level –Expanded questions to be inclusive of school staff and non-mental health providers –Shortened, fewer dimensions and indicators

7. MHPET web-based tool MHPET web-based tool www.nasbhc.org www.nasbhc.org Beta testing ’07-’08 April ’08 went online –Set up to be completed by teams –Individuals complete tool independently –Computer generates average score for team. –Teams go back 3-6 months later to complete a second time –Computer generates second set scores with comparison to first set.

8. Using the Web-Based MHPET

12. Principles for SBHCs Principles for SBHCs Supports the school Responds to the community Focuses on the student Delivers comprehensive care Advances health promotion activities Implements effective systems Provides leadership in adolescent and child health http://www.nasbhc.org/site/c.jsJPKWPFJrH/b.2743459/k.9519/ NASBHC_Principles_and_Goals_for_SBHCs.htm

15. Laura Hurwitz

41. James A Davis Middle School 1224 Clarendon Ave. Bessamer, AL 2

47. 3

48. Set Two Survey will be available after… 3 James A Davis Middle School 1224 Clarendon Ave. Bessamer, AL Set Two Survey will be available after July 25, 2008

50. 3 0

53. Using Results for Quality Improvement Indicators with scores of 3 or less are automatically flagged as potential areas for improvement Place the MHPET results in the context of other data. Raters select targeted areas for improvement (dimensions and/or indicators with averages that are low relative to others)

54. Using MHPET to identify improvement targets Parallel to goal setting with a student/client: –What are the strengths? –What areas are in need of improvement? –Realistic? –Obtainable? Examine the lowest rated indicators first. –Which of these can you impact in the next 6 months? “Halo effect” –By focusing on 2-3 indicators is there potential to positively impact others?

55. Continuous Quality Improvement: PDSA Identify areas for improving quality and resources for improving target areas (PLAN) Develop and implement improvement plan (DO) Compare scores 3-6 months later and assess progress (STUDY) Revise plan (ACT)

56. 3 3

59. MHPET Next Steps Develop compendium of quality improvement resources for each indicator MHPET will have on-line link to resource for each indicator Develop training module on quality improvement (School Mental Health Capacity Building Partnership) Collect and analyze national data from MHPET

60. NASBHC Resources for Quality Improvement: www.nasbhc.org Paper version currently available http://www.nasbhc.org/atf/cf/{CD9949F2-2761- 42FB-BC7A-CEE165C701D9}/MHPET.pdf General mental health resources http://www.nasbhc.org/site/c.jsJPKWPFJrH/b.2 642293/k.85AC/mental_health.htm

61. Resource for Quality Improvement: The School Mental Health Connection www.schoolmentalhealth.org In association with University of Maryland Center for School Mental Health (CSMH) www.csmh.umaryland.eduwww.csmh.umaryland.edu 40 indicators of quality in school mental health services PowerPoints provide background information, a menu of suggested activities, helpful hints, web resources, and references

62. Other Resources for Quality Improvement Center for Health & Health Care in Schools www.healthinschools.org www.healthinschools.org UCLA Center for Mental Health in Schools www.smhp.psych.ucla.edu www.smhp.psych.ucla.edu National Technical Assistance Center for Children's Mental Health at Georgetown University Center for Child and Human Development www.gucchd.georgetown.edu IDEA Partnership www.sharedwork.org

63. Contact Information Laura Hurwitz, LCSW Director, School Mental Health Programs lhurwitz@nasbhc.org 202-638-5872, x 205 Deirdre Taylor Administrative Manager dtaylor@nasbhc.org 202-638-5872, x 204