1. Examining Data for the 1% Waiver
Kentucky Department of Education’s Use of Data to Monitor Appropriate Use of Alternate State Assessments
Kentucky Department of Education (KDE)
Office of Special Education and Early Learning (OSEEL)

2. 2019 OSEP Leadership Conference
OSEP Disclaimer
2019 OSEP Leadership Conference
DISCLAIMER:
The contents of this presentation were developed by the presenters for the 2019 OSEP Leadership Conference. However, these contents do not necessarily represent the policy of the Department of Education, and you should not assume endorsement by the Federal Government.
(Authority: 20 U.S.C. 1221e-3 and 3474)

3. Tools Kentucky Statewide Student Information System – Infinite Campus
Includes Special Education Module
Alternate Assessment based on Alternate Academic Achievement Standards (AA-AAAS) Eligibility
Learner Characteristics Inventory (LCI)
Justification Survey Data – required for all districts with more than 1% of students participating in the alternate assessment
Training Participation Data – participation in online training modules

4. Additional Tools
EDFacts data (C175, C178, C179, C185, C188, C189)/Other Assessment Data
Participation Rate for State
Participation Rate for LEAs
Significant Disproportionality Data for State by Student Group
Significant Disproportionality Data for each LEA
Scale – up plan for categories
Economically Disadvantaged in
Economically Disadvantaged, Pacific Islanders, English Learners, and Males in
Achievement Rate

5. What tools are your state using?

6. Timeline Spring/Summer – begin planning for waiver application
Summer - seek and respond to public comment for 1% waiver
Early August – submit waiver application
End of October - receive preliminary data from KDE/OSAA
Mid-December – EDFacts files available
Mid-December - pull numbers of students by district and by disability who are eligible for alternate assessment according to their IEPs
January – submit addendum with final data

7. Timeline (continued)
January/February - districts are notified that they have a greater than 1% participation rate in AA-AAAS in any subject area
February/March – districts analyze data and provide justification for exceeding 1%
Spring – monitoring of student files for those participating in alternate assessment participation
Training modules ongoing
Alternate Assessment and Diploma Advisory Group meets throughout

8. Data For the Waiver

9. Initial Waiver Request (2017-2018)
Use previous year’s data ( ) for initial waiver request
Participation rate for state
Calculated based on EDFacts data for mathematics, reading/language arts, and science
Data for social studies and writing obtained directly from Kentucky Department of Education (KDE)/Office of Standards, Assessment and Accountability (OSAA)
Calculated by number of students participating in AA-AAAS divided by all students participating (EDFacts data/OSAA)
170 out of 175 districts had more than 1% of students participating in the alternate assessment

10. Monitoring Monitor a sample of districts based on data
Districts over 1%
Districts under 1%
Specific student characteristics
LCI
Specific disabilities
Achievement scores
Districts with highest disproportionality
Analysis of justification responses
Training Data
Other – based on extraneous information

11. District Data for Students Eligible to Participate
Pulled from the Kentucky Statewide Student Information System
Infinite Campus (IC)
Special Education Module (IEP)
Alternate assessment eligibility
Provide data to districts by disability for districts to analyze
District reviews student files for “red flags”
Student achievement
Disability eligibility
LCI data
Disproportionality
Other factors

12. District Rate of Participation in AA-AAAS
Using EDFacts files and additional data obtained by KDE/OSAA
Sample:
District
Math AA
Math
All
% Math
Reading AA
Reading All
% Reading
Sci AA
Sci All
% Sci D1 9
1402
0.64% 11
1404
0.78%
616
1.46% D2 27
1602
1.69% 29
1604
1.81% 7
693
1.01% D3 1
254
0.39% 84
1.19%
Also calculated for Social Studies and Writing for each district

13. Students Eligible for AA-AAAS
Data based on eligibility data in student IEPs

14. Learner Characteristics Inventory (LCI)
Designed to identify levels of communication and other complex characteristics of students participating in alternate assessment
Embedded in IEP
Districts review
Desk reviews at state level
Developed by the National Center and State Collaborative
LCI included in Kentucky’s Alternate Assessment Participation Guidelines

15. How do you monitor participation?

16. Disproportionality Kentucky uses 2.0 and above as the threshold
Do not eliminate any district based on n-size or cell-size, but it is considered
Highest rate of disproportionality in was in the content areas of reading and math among those students who are Economically Disadvantaged
This data was considered in decisions regarding monitoring
Scale up plan was developed for future years

17. Calculation – Risk Ratio
A risk ratio is the comparison of two different risks:
The risk for a specific student group to participate in alternate assessment
Compared To
The risk for all students NOT in that student group to participate in alternate assessment

18. Categories for Risk Ratio Calculation
Subjects
Student Groups
Reading (Elementary/Middle)
Math (Elementary/Middle)
Writing (Elementary/Middle/High)
Science (Elementary/Middle)
Social Studies (Elementary/Middle)
English II (High)
Algebra II (High)
US History (High)
Race
Gender
Free/Reduced Lunch Eligible
English Learners
Migrant
Homeless

19. Example White students taking alternate assessment: 2
All white students assessed in the district: 250
Non-white students taking alternate assessment: 4
Non-white students assessed in the district: 2000
Risk of white students taking alt. assessment: 2/250 = = 0.8%
Risk of non- white students taking alt. assessment: 4/2000 = = 0.2%
Risk ratio = 0.8/0.2 = 4.00
White students are 4.00 times more likely than non-white students to take the alternate assessment

20. Questions? Is your state using a different method?

21. Justification Survey
Required for Directors of Special Education in LEAs over 1%
KY Justification Survey
KY Alternate Assessment Participation Waiver

22. What choices do you provide for justification
What choices do you provide for justification? How did you determine them?

23. Training and Guidance
Extensive statewide training, coaching, and support plan, known as the Participation for Alternate Assessment (P4AA) Project
Online training modules
Regional cooperative ARC (IEP team meeting) simulations
Regional cooperative coaching (in-person and by teleconferencing)
Guidance documents
Record review document

24. Online Training Modules
Housed at Human Development Institute at the University of Kentucky
Developed by KDE advisory group
KDE and district monitors completion
Required survey for each module to provide feedback (data)
Module 5 focuses on data

25. Waiver

26. Comparison of SY 2016-17 and SY 2017-18 Alternate Assessment Participation by Subject

27. Overall Statewide Participation

28. Overall Statewide Percentage of Students Eligible to Participate in the AA-AAAS

29. Districts Assessing More than 1% of Students in the Alternate Assessment

30. 2019 OSEP Leadership Conference
OSEP Disclaimer1
2019 OSEP Leadership Conference
DISCLAIMER:
The contents of this presentation were developed by the presenters for the 2019 OSEP Leadership Conference. However, these contents do not necessarily represent the policy of the Department of Education, and you should not assume endorsement by the Federal Government.
(Authority: 20 U.S.C. 1221e-3 and 3474)