Ohio’s Experience with AYP April 12, 2004 Ohio’s Experience with AYP Presentation to the American Educational Research Association Mitchell D. Chester April 12, 2004 Mitchell D. Chester
Pre-Implementation Concerns Over-identification Accountability for students with disabilities Volatility of results
Presentation Outline Ohio’s accountability system 2002-03 AYP results Measures employed to increase validity and reliability Conclusions
Ohio’s Accountability System School and district rating criteria 2002-03 results
Ohio's Experience with AYP April 12, 2004 Ohio Rating Criteria Mitchell D. Chester
Ohio's Experience with AYP April 12, 2004 Ohio Rating Criteria Mitchell D. Chester
Ohio's Experience with AYP April 12, 2004 Ohio Rating Criteria Mitchell D. Chester
Ohio's Experience with AYP April 12, 2004 Ohio Rating Criteria Mitchell D. Chester
Ohio's Experience with AYP April 12, 2004 Ohio Rating Criteria Mitchell D. Chester
District Designations
School Designations
2002-03 AYP Results AYP within rating categories School Improvement within rating categories Disentangling the AYP categories
AYP within Ohio’s Rating Categories
AYP within Ohio’s Rating Categories
AYP within Ohio’s Rating Categories
AYP within Ohio’s Rating Categories
AYP within Ohio’s Rating Categories
School Improvement within Ohio’s Rating Categories
AYP Categories
AYP Categories
AYP Categories
AYP Categories
AYP & Students with Disabilities Total Missing AYP Missed Solely Because of SWD Schools 808 42 / 5.2% Districts 317 180 / 56.8%
AYP & Limited English Proficient Students Total Missing AYP Missed Solely Because of LEP Schools 808 1 / 0.1% Districts 317 2 / 0.6%
Measures Employed to Increase Validity and Reliability Safe Harbor Averaging Other
AYP: Impact of Safe Harbor Total Meeting AYP Met Because of Safe Harbor Schools 2,407 52 / 2.2% Districts 292 19 / 6.5%
AYP: Impact of Averaging Total Meeting AYP Met Because of Averaging Schools 2,407 116 / 4.8% Districts 292 16 / 5.5%
Other Measures Tests of statistical significance Confidence intervals Minimum N
Conclusions 2002-03 AYP impact was lowest of pre-implementation estimates Participation was not an issue Need better understanding of false positives / false negatives
Conclusions (continued) Volatility of results needs careful attention Consequential validity is the “main event”