Examining Data for the 1% Waiver Kentucky Department of Education’s Use of Data to Monitor Appropriate Use of Alternate State Assessments Kentucky Department of Education (KDE) Office of Special Education and Early Learning (OSEEL)

2019 OSEP Leadership Conference OSEP Disclaimer 2019 OSEP Leadership Conference DISCLAIMER: The contents of this presentation were developed by the presenters for the 2019 OSEP Leadership Conference. However, these contents do not necessarily represent the policy of the Department of Education, and you should not assume endorsement by the Federal Government. (Authority: 20 U.S.C. 1221e-3 and 3474)

Tools Kentucky Statewide Student Information System – Infinite Campus Includes Special Education Module Alternate Assessment based on Alternate Academic Achievement Standards (AA-AAAS) Eligibility Learner Characteristics Inventory (LCI) Justification Survey Data – required for all districts with more than 1% of students participating in the alternate assessment Training Participation Data – participation in online training modules

Additional Tools EDFacts data (C175, C178, C179, C185, C188, C189)/Other Assessment Data Participation Rate for State Participation Rate for LEAs Significant Disproportionality Data for State by Student Group Significant Disproportionality Data for each LEA Scale – up plan for categories Economically Disadvantaged in 2017-2018 Economically Disadvantaged, Pacific Islanders, English Learners, and Males in 2018-2019 Achievement Rate

What tools are your state using?

Timeline Spring/Summer – begin planning for waiver application Summer - seek and respond to public comment for 1% waiver Early August – submit waiver application End of October - receive preliminary data from KDE/OSAA Mid-December – EDFacts files available Mid-December - pull numbers of students by district and by disability who are eligible for alternate assessment according to their IEPs January – submit addendum with final data

Timeline (continued) January/February - districts are notified that they have a greater than 1% participation rate in AA-AAAS in any subject area February/March – districts analyze data and provide justification for exceeding 1% Spring – monitoring of student files for those participating in alternate assessment participation Training modules ongoing Alternate Assessment and Diploma Advisory Group meets throughout

Data For the Waiver

Initial Waiver Request (2017-2018) Use previous year’s data (2016-2017) for initial waiver request Participation rate for state Calculated based on EDFacts data for mathematics, reading/language arts, and science Data for social studies and writing obtained directly from Kentucky Department of Education (KDE)/Office of Standards, Assessment and Accountability (OSAA) Calculated by number of students participating in AA-AAAS divided by all students participating (EDFacts data/OSAA) 170 out of 175 districts had more than 1% of students participating in the alternate assessment

Monitoring Monitor a sample of districts based on data Districts over 1% Districts under 1% Specific student characteristics LCI Specific disabilities Achievement scores Districts with highest disproportionality Analysis of justification responses Training Data Other – based on extraneous information

District Data for Students Eligible to Participate Pulled from the Kentucky Statewide Student Information System Infinite Campus (IC) Special Education Module (IEP) Alternate assessment eligibility Provide data to districts by disability for districts to analyze District reviews student files for “red flags” Student achievement Disability eligibility LCI data Disproportionality Other factors

District Rate of Participation in AA-AAAS Using EDFacts files and additional data obtained by KDE/OSAA Sample: District Math AA Math All % Math Reading AA Reading All % Reading Sci AA Sci All % Sci D1 9 1402 0.64% 11 1404 0.78% 616 1.46% D2 27 1602 1.69% 29 1604 1.81% 7 693 1.01% D3 1 254 0.39% 84 1.19% Also calculated for Social Studies and Writing for each district

Students Eligible for AA-AAAS Data based on eligibility data in student IEPs

Learner Characteristics Inventory (LCI) Designed to identify levels of communication and other complex characteristics of students participating in alternate assessment Embedded in IEP Districts review Desk reviews at state level Developed by the National Center and State Collaborative LCI included in Kentucky’s Alternate Assessment Participation Guidelines

How do you monitor participation?

Disproportionality Kentucky uses 2.0 and above as the threshold Do not eliminate any district based on n-size or cell-size, but it is considered Highest rate of disproportionality in 2016-2017 was in the content areas of reading and math among those students who are Economically Disadvantaged This data was considered in decisions regarding monitoring Scale up plan was developed for future years

Calculation – Risk Ratio A risk ratio is the comparison of two different risks: The risk for a specific student group to participate in alternate assessment Compared To The risk for all students NOT in that student group to participate in alternate assessment

Categories for Risk Ratio Calculation Subjects Student Groups Reading (Elementary/Middle) Math (Elementary/Middle) Writing (Elementary/Middle/High) Science (Elementary/Middle) Social Studies (Elementary/Middle) English II (High) Algebra II (High) US History (High) Race Gender Free/Reduced Lunch Eligible English Learners Migrant Homeless

Example White students taking alternate assessment: 2 All white students assessed in the district: 250 Non-white students taking alternate assessment: 4 Non-white students assessed in the district: 2000 Risk of white students taking alt. assessment: 2/250 = 0.008 = 0.8% Risk of non- white students taking alt. assessment: 4/2000 = 0.002 = 0.2% Risk ratio = 0.8/0.2 = 4.00 White students are 4.00 times more likely than non-white students to take the alternate assessment

Questions? Is your state using a different method?

Justification Survey Required for Directors of Special Education in LEAs over 1% KY Justification Survey KY Alternate Assessment Participation Waiver

What choices do you provide for justification What choices do you provide for justification? How did you determine them?

Training and Guidance Extensive statewide training, coaching, and support plan, known as the Participation for Alternate Assessment (P4AA) Project Online training modules Regional cooperative ARC (IEP team meeting) simulations Regional cooperative coaching (in-person and by teleconferencing) Guidance documents Record review document

Online Training Modules Housed at Human Development Institute at the University of Kentucky Developed by KDE advisory group KDE and district monitors completion Required survey for each module to provide feedback (data) Module 5 focuses on data

2017-2018 Waiver

Comparison of SY 2016-17 and SY 2017-18 Alternate Assessment Participation by Subject

Overall Statewide Participation

Overall Statewide Percentage of Students Eligible to Participate in the AA-AAAS

Districts Assessing More than 1% of Students in the Alternate Assessment

2019 OSEP Leadership Conference OSEP Disclaimer1 2019 OSEP Leadership Conference DISCLAIMER: The contents of this presentation were developed by the presenters for the 2019 OSEP Leadership Conference. However, these contents do not necessarily represent the policy of the Department of Education, and you should not assume endorsement by the Federal Government. (Authority: 20 U.S.C. 1221e-3 and 3474)