Washington State Department of Social & Health Services – Division of Behavioral Health and Recovery - PRI One Department Vision Mission Core set of Values DSHS/Division of Behavioral Health and Recovery Needs Assessment Clinic Module II Using your data (Data Book)

Washington State Department of Social & Health Services – Division of Behavioral Health and Recovery - PRI One Department Vision Mission Core set of Values Note to Facilitator: This presentation is designed for use by community coordinators with a data workgroup. If additional assistance is needed beyond this presentation, please request assistance from DBHR by ing

Washington State Department of Social & Health Services – Division of Behavioral Health and Recovery - PRI One Department Vision Mission Core set of Values Training Objectives  Participants will be able to describe the difference between quantitative and qualitative data.  Participants will be able to explain the Prevention Redesign Initiative logic model.  Participants will understand what are common sources for data in Washington state  Participants will be able understand the how to gather information from the Data Book and to identify differences in the data.

Washington State Department of Social & Health Services – Division of Behavioral Health and Recovery - PRI One Department Vision Mission Core set of Values A Quick review… Definition of Assessment  A community assessment is a sequence of activities in which community members with varying skills and interests use data to determine the severity of problems in their community and the factors or conditions that either make the problems worse or better.

Washington State Department of Social & Health Services – Division of Behavioral Health and Recovery - PRI One Department Vision Mission Core set of Values …in other words  …assessment is a process for reviewing and prioritizing community information to determine the best way to move forward with prevention efforts.

Washington State Department of Social & Health Services – Division of Behavioral Health and Recovery - PRI One Department Vision Mission Core set of Values Why does this matter? One of the reasons it matters is that Tenino 8 th graders use alcohol more than that rest of the state. And our prevention efforts need to reduce that consumption.

Washington State Department of Social & Health Services – Division of Behavioral Health and Recovery - PRI One Department Vision Mission Core set of Values Why does this matter? We know that youth involvement with alcohol negatively impacts standardized test scores and grades.  Early use of alcohol and cigarettes = lower standardized test scores  More disruptive/aggressive behavior = lower standardized test scores  More alcohol and drug use = less likelihood of passing standardized tests  Higher bonding to school = higher standardized test scores and better grades  Better social skills = higher standardized test scores and better grades

Washington State Department of Social & Health Services – Division of Behavioral Health and Recovery - PRI One Department Vision Mission Core set of Values Prevention Redesign Initiative Process Model

Washington State Department of Social & Health Services – Division of Behavioral Health and Recovery - PRI One Department Vision Mission Core set of Values Needs assessment process supported by this training 1.Coalition receives overview of needs assessment 2.Coalition forms data work group 3.Data work group reviews Data Book, including Healthy Youth Survey and social indicator data, and local data as needed

Washington State Department of Social & Health Services – Division of Behavioral Health and Recovery - PRI One Department Vision Mission Core set of Values Needs assessment process supported by this training 4.Data work group recommends intervening variables to be prioritized by community coalition 5.Coalition acts on data work group recommendations 6.Coalition identifies local contributing factors that apply to prioritized intervening variables

Washington State Department of Social & Health Services – Division of Behavioral Health and Recovery - PRI One Department Vision Mission Core set of Values Types of Data We Use in Assessing Communities  Quantitative Data – are expressed in numerical terms, counted, or compared on a scale. These data help to answer the question “how many” and can give your coalition perspective about the breadth of an issue, e.g., how many people are affected.

Washington State Department of Social & Health Services – Division of Behavioral Health and Recovery - PRI One Department Vision Mission Core set of Values Types of Data We Use in Assessing Communities  Qualitative Data – are non-numerical data rich in detail and description. These data are usually presented in narrative form, such as information obtained from focus groups, key informant interviews, and/or observational data collection. These data can help address the question, “What does it mean?”

Washington State Department of Social & Health Services – Division of Behavioral Health and Recovery - PRI One Department Vision Mission Core set of Values Fundamentals for understanding data  Validity and reliability  Generalizability  Confidence intervals  Comparing state and local results  Comparing data over time

Washington State Department of Social & Health Services – Division of Behavioral Health and Recovery - PRI One Department Vision Mission Core set of Values Reliability  Reliability: Does the survey consistently produce the same results under the same conditions?  How we assure reliability: – Standardized administration procedures

Washington State Department of Social & Health Services – Division of Behavioral Health and Recovery - PRI One Department Vision Mission Core set of Values Validity  Validity: Does the item measure what it is intended to measure?  How we assure validity:  Items from established instruments, validity checks

Washington State Department of Social & Health Services – Division of Behavioral Health and Recovery - PRI One Department Vision Mission Core set of Values Generalizability  What is generalizability?  Why 70% participation is important  Challenges to generalizability  School level  ESD, County, or District level  How do these challenges affect data interpretation?

Washington State Department of Social & Health Services – Division of Behavioral Health and Recovery - PRI One Department Vision Mission Core set of Values Do I have to generalize?  Yes, if you want to apply the results to a larger population. – 8 th graders in our district said….  Yes, if you want to compare to others or results over time  No, if you want to just describe the students surveyed, in that moment, without confidence intervals: – Students at our school who took the survey said….

Washington State Department of Social & Health Services – Division of Behavioral Health and Recovery - PRI One Department Vision Mission Core set of Values What is a confidence interval?  The reported value is unlikely to be exactly the same as the “true” value for all your students  We are “95% confident” that the “true” value is within the +/- range, called the “confidence interval”

Washington State Department of Social & Health Services – Division of Behavioral Health and Recovery - PRI One Department Vision Mission Core set of Values Sources of Data We Use in Assessing Communities Data Assessment Local data Healthy Youth Survey Social Indicator data

Washington State Department of Social & Health Services – Division of Behavioral Health and Recovery - PRI One Department Vision Mission Core set of Values Healthy Youth Survey data

Washington State Department of Social & Health Services – Division of Behavioral Health and Recovery - PRI One Department Vision Mission Core set of Values Healthy Youth Survey (HYS)  What is this information good for?  How does it help us with assessment?

Washington State Department of Social & Health Services – Division of Behavioral Health and Recovery - PRI One Department Vision Mission Core set of Values Pages State Tenino Rate per 1,000 – how often something happens in a given population size What do you think this means? Social indicator data

Washington State Department of Social & Health Services – Division of Behavioral Health and Recovery - PRI One Department Vision Mission Core set of Values This is another way of showing the information from the previous slide. Trend information helps to understand what is going on in the community. This is another way of showing the information from the previous slide. Trend information helps to understand what is going on in the community. Social indicator data

Washington State Department of Social & Health Services – Division of Behavioral Health and Recovery - PRI One Department Vision Mission Core set of Values Social indicator data  What is this information good for?  How does it help us with assessment?  Is this data quantitative or qualitative data?

Washington State Department of Social & Health Services – Division of Behavioral Health and Recovery - PRI One Department Vision Mission Core set of Values Local Data Examples:  Hospital emergency room data  Interviews with key individuals in your community about their feelings about substance abuse. Why would this information be interesting to look at?

Washington State Department of Social & Health Services – Division of Behavioral Health and Recovery - PRI One Department Vision Mission Core set of Values Tenino High School Parkside Elementary Tenino High School Parkside Elementary Tenino Middle School Example - Alcohol Outlets in Tenino, WA using Google Maps

Washington State Department of Social & Health Services – Division of Behavioral Health and Recovery - PRI One Department Vision Mission Core set of Values Local Data  What other local data can you think of that would be helpful to help us understand substance abuse problems in the community?

Washington State Department of Social & Health Services – Division of Behavioral Health and Recovery - PRI One Department Vision Mission Core set of Values Local Data  What is this information good for?  How does it help us with assessment?  Is this data quantitative or qualitative data?

Washington State Department of Social & Health Services – Division of Behavioral Health and Recovery - PRI One Department Vision Mission Core set of Values Look at the Data Book

Washington State Department of Social & Health Services – Division of Behavioral Health and Recovery - PRI One Department Vision Mission Core set of Values Looking at the Data Book Table of Contents

Washington State Department of Social & Health Services – Division of Behavioral Health and Recovery - PRI One Department Vision Mission Core set of Values

Washington State Department of Social & Health Services – Division of Behavioral Health and Recovery - PRI One Department Vision Mission Core set of Values School Performance HYS Measures of School Performance

Washington State Department of Social & Health Services – Division of Behavioral Health and Recovery - PRI One Department Vision Mission Core set of Values Confidence Intervals Significant differences: numerically  Smoked cigarettes in the state: 14.9% (± 1.4%) Between 13.5% and 16.3% 2.2  Smoked cigarettes at my school: 20.0% (± 2.2%) Between 17.8% to 22.2% Theree is a gap between the upper range of the state percentage (16.3%) and the lower range of the “my school” percentage (17.8%), so there is a significant difference

Washington State Department of Social & Health Services – Division of Behavioral Health and Recovery - PRI One Department Vision Mission Core set of Values Confidence Intervals Significant differences: graphically Conclusion: Difference IS statistically significant (confidence intervals do not overlap)

Washington State Department of Social & Health Services – Division of Behavioral Health and Recovery - PRI One Department Vision Mission Core set of Values Confidence Intervals Significant difference?

Washington State Department of Social & Health Services – Division of Behavioral Health and Recovery - PRI One Department Vision Mission Core set of Values Why are confidence intervals different sizes?  Number of students  Inherent variability  Level of confidence (All 95% for HYS)  Sampling design

Washington State Department of Social & Health Services – Division of Behavioral Health and Recovery - PRI One Department Vision Mission Core set of Values What if my school has large confidence intervals?  Having a confidence interval protects you (and your program) from appearing to be ineffective when just a few students can make big changes  Consider the input of teachers and staff from small-school environments when interpreting data – the data should be used to complement what they already know about their kids

Washington State Department of Social & Health Services – Division of Behavioral Health and Recovery - PRI One Department Vision Mission Core set of Values School Performance

Washington State Department of Social & Health Services – Division of Behavioral Health and Recovery - PRI One Department Vision Mission Core set of Values CORE GIS Social Indicators

Washington State Department of Social & Health Services – Division of Behavioral Health and Recovery - PRI One Department Vision Mission Core set of Values Consumption

Washington State Department of Social & Health Services – Division of Behavioral Health and Recovery - PRI One Department Vision Mission Core set of Values Youth Substance Use

Washington State Department of Social & Health Services – Division of Behavioral Health and Recovery - PRI One Department Vision Mission Core set of Values Youth Substance Use

Washington State Department of Social & Health Services – Division of Behavioral Health and Recovery - PRI One Department Vision Mission Core set of Values Intervening Variables

Washington State Department of Social & Health Services – Division of Behavioral Health and Recovery - PRI One Department Vision Mission Core set of Values Alcohol Availability

Washington State Department of Social & Health Services – Division of Behavioral Health and Recovery - PRI One Department Vision Mission Core set of Values Norms

Washington State Department of Social & Health Services – Division of Behavioral Health and Recovery - PRI One Department Vision Mission Core set of Values Risk/Protective Factors Most Strongly Associated with Alcohol Use  Parental attitudes favorable towards drug use.  Early initiation of drugs.  Intentions to use drugs.  Friends’ use of drugs.  Social skills (Protective factor).  Data on all of the risk and protective factors are available at the end of the data book.

Washington State Department of Social & Health Services – Division of Behavioral Health and Recovery - PRI One Department Vision Mission Core set of Values Risk/Protective Factors Most Strongly Associated with Alcohol Use

Washington State Department of Social & Health Services – Division of Behavioral Health and Recovery - PRI One Department Vision Mission Core set of Values Risk/Protective Factors Most Strongly Associated with Alcohol Use

Washington State Department of Social & Health Services – Division of Behavioral Health and Recovery - PRI One Department Vision Mission Core set of Values Additional HYS Data

Washington State Department of Social & Health Services – Division of Behavioral Health and Recovery - PRI One Department Vision Mission Core set of Values Additional HYS Data

Washington State Department of Social & Health Services – Division of Behavioral Health and Recovery - PRI One Department Vision Mission Core set of Values Risk and Protective Factors

Washington State Department of Social & Health Services – Division of Behavioral Health and Recovery - PRI One Department Vision Mission Core set of Values Additional CORE Data

Washington State Department of Social & Health Services – Division of Behavioral Health and Recovery - PRI One Department Vision Mission Core set of Values Reviewing the Data 1.Make two columns on a piece of paper. At the top of the left column write 8 th grade. At the top of the right column write 10 th grade. 2.Write down the indicators in the chart that are higher for your community than the state.

Washington State Department of Social & Health Services – Division of Behavioral Health and Recovery - PRI One Department Vision Mission Core set of Values Reviewing the Data 3.Now, underline any of the items on your list that appear in the following list of risk and protective factors strongly associated with alcohol use for both 8 th and 10 th grade.  Parental attitudes favorable towards drug use  Early initiation of drug use  Intentions to use drugs  Friends’ use of drugs  Social Skills (Protective)

Washington State Department of Social & Health Services – Division of Behavioral Health and Recovery - PRI One Department Vision Mission Core set of Values Reviewing the Data 4.How many total intervening variables do you have written down for 8th grade? For 10th grade? 5.How many of the factors most strongly associated with youth alcohol use do you have written down? 6.Keep that list because that is where we will start the next work session

Washington State Department of Social & Health Services – Division of Behavioral Health and Recovery - PRI One Department Vision Mission Core set of Values Wrap-up Today we covered…  …the theory and logic behind the Prevention Redesign Initiative  …the types of data involved in conducting a needs assessment  …and, what information is in the Data Book and how to use it

Washington State Department of Social & Health Services – Division of Behavioral Health and Recovery - PRI One Department Vision Mission Core set of Values Wrap-up In the next meeting(s)…  …decide how we will make the prioritization decisions  …we will start the process of deciding what the data says we should focus our prevention efforts on  …decide how to present our recommended priorities to the full coalition

Washington State Department of Social & Health Services – Division of Behavioral Health and Recovery - PRI One Department Vision Mission Core set of Values Next meeting  Date:  Time:  Location:

Washington State Department of Social & Health Services – Division of Behavioral Health and Recovery - PRI One Department Vision Mission Core set of Values Note to Facilitator: If you have questions or need additional assistance beyond this presentation, please request assistance from DBHR by ing