1. The fundamentals of caring for you, your family and your child with mental illness Paul Deal, Ph.D. Missouri State University

2. Pilot Program Evaluation Objectives –Evidence Based Practice designation –Outcomes associated with participation –Modifications to program Pilot –Three states (IL, SC, UT) –Six classes per state –Objective and subjective feedback

3. Pilot Program Evaluation Instruments –Knowledge-specific items (9) Question development Curriculum-based Program staff consensus –Respondent self-perception (9) Statement development Program objectives Rating scale

4. Pilot Program Evaluation Knowledge-specific sample item: –My child’s mental illness is due to: Biological and environmental factors Head injuries Poor parenting Substance abuse

5. Pilot Program Evaluation Respondent self-perception sample item: I understand the symptoms of childhood and adolescent mental illness 5 = completely describes me 4 = adequately describes me 3 = somewhat describes me 2 = hardly describes me 1 = does not describe me at all

6. Pilot Program Evaluation Demographic questionnaire –Age –Gender –Marital status –Race –Education –Relationship to ill relative –Ill relative’s diagnosis (length of treatment?)

7. Pilot Program Evaluation Methodology –First class Evaluation process and purpose explained Informed consent Data collection (demographic, pre-test) Last 4 digits of phone # –Last class Data collection (post-test) Packets mailed

8. Pilot Program Evaluation Results –19 classes (IL, SC = 6; UT = 7) –221 total cases 176 completed pre-tests 135 completed post-tests 93 matched pairs –Missing data

9. Pilot Program Evaluation Demographic data –44.7 years old average age (sd=10) –Female = 143 (81%) –Married = 116 (66%) –Caucasian = 144 (83%) –Some college hours = 135 (78%)

10. Pilot Program Evaluation Demographic data –Child / relative information Diagnosis(es) –Two or more = 111 (63%) –ADHD = 91 (52%) –Mood Disorder = 94 (54%) –Anxiety Disorder = 46 (26%) –Oppositional Defiant Disorder = 27 (15%) Age of first diagnosis = 8 years (sd=5) Length of treatment = 5 years (sd=10)

11. Pilot Program Evaluation Total sample –Knowledge-specific instrument Pre-test mean score = 6.3 (sd=1.7) Post-test mean score = 7.1 (sd=1.5) –Respondent self-perception Pre-test mean score = 31.6 (sd=6.8) Post-test mean score = 37.7 (sd=4.3)

12. Pilot Program Evaluation Matched sample –Knowledge-specific instrument Pre-test mean score = 6.4 (sd=1.7) Post-test mean score = 7.1 (sd=1.3) T(92) = -4.0, p<.001 –Respondent self-perception Pre-test mean score = 31.4 (sd=6.7) Post-test mean score = 38.0 (sd=3.8) T(85) = -10.0, p <.001

13. Pilot Program Evaluation Matched sample –Knowledge-specific instrument Items 1, 2, 3, 7 significant changes Catastrophic event, causes of mental illness, family reaction to mental illness, most effective treatment for SED in child –Respondent self-perception ALL items

14. Pilot Program Evaluation Matched sample vs. pre-test only –Age, gender, marital status no difference –Race: Caucasian (59%), non-Caucasian (27%) –Knowledge-specific instrument no difference –Respondent self-perception no difference Caveat re. completer and non-completer

15. Pilot Program Evaluation Discussion –Conclusions drawn from data MUST be tempered with caution –Attrition and non-completion of post-tests –Matched sample likely different than individuals who did not complete –Pragmatic concerns

16. Pilot Program Evaluation Discussion –Changes in knowledge –Changes in respondent self-perception –Trends consistent across Future directions –Enhanced data collection –Randomized experiment –Incorporate suggested changes

17. Pilot Program Evaluation Thanks to all teachers and participants who assisted with data collection QUESTIONS OR COMMENTS?