RPC Staff Learning Event Pre-Session: Purpose: Review the Reliability and Validity of the KCTC Survey Provide an overview of KCTC website navigation

Survey Data Quality Validity - does the survey measure what it is intended to measure? Reliability - is the survey consistent over time?

Types of Validity Concurrent Validity – Results are consistent with other well-designed surveys measuring the same domains Construct validity – results of the survey make sense – Risk and protective factor scales are correlated with problem behaviors in the expected direction

Reliability Statistical methods were applied to assess the internal consistency of each scale by grade and gender Longitudinal data show consistent responding among youth

Checks for Reliability and Validity Individual student surveys are identified and eliminated from the database if: Evidence of false reporting Improbable Use/Unrealistically frequent reports of use Reported use of a fictitious drug

Double Take Approximately what percentage of surveys are thrown out each year after checks for validity have been applied? a) % b) % c) 7% - 9% d) 3% - 5%

Double Take What is the website to obtain CTC data? a) www. b) c) d) e) f)

Double Take What data requires a password to access? a) State b) County c) District

Double Take What is the requested registration deadline? a) November 1 st b) November 30 th c) December 1 st d) January 5 th

Double Take What is the ‘window’ for survey administration? a) November 1 st – February 28th b) December 1 st – January 31 st c) March 1 st – May 31 st d) April 1 st – May 31 st

Double Take2 Which of the following is NOT a strategy for getting district registered? a) Identifying a supporter in the district b) Offer to assist with registration c) Wait until the Superintendent calls you with questions d) CTC presentations to local groups to increase awareness

Double Take What districts/schools are eligible to take the CTC survey? a) Only those who have taken it in the past b) Only those with really cool RPC Directors c) All districts in the state d) Only public schools e) Only those that Joyce and Kathy approve

Double Take What is the financial cost to the district to participate in the CTC survey? a) $1,000 b) $1,500 c) It depends on the budget for the year d) Nothing

Double Take How long before survey administration should parents be notified? a) A month b) Three weeks c) Two weeks d) One week e) Two days before

Double Take After districts have taken the survey, what month does Greenbush make the CTC data available? a) March b) April c) May d) June

Double Take When are all surveys due? a) January 31 st b) February 1 st c) February 15 th d) March 5 th e) April 1st

Double Take To whom is the password given? a) Superintendent b) Principal c) Teacher d) a. & b. e) Janitor

Double Take How do you determine if a district has registered to take the survey? a) Use the ladder of inference b) Go to the RPC registration page c) Ask your ‘Magic 8 Ball’ d) Call Shari e) b. & d.

Double Take2 Is recognition of districts who have consistently high participation rates is a good idea? a) No, it only makes other districts look bad b) Yes, it rewards them and will encourage continued participation c) Don’t know/Not sure