Update on the Online Conversion Process for AEPSi: Implications for OSEP Reporting
Rationale States using 7-point online conversions noted a larger than expected proportion of typically developing children. Expert practitioners (Nebraska) chart review demonstrated that some of the children who were rated a 6 or 7 were performing below what would be considers typical development for their age. Discussions with Brookes to review the analyses for the cut-scores for the 7 point scale.
Conversion Process: Partnership with Brookes and ECO Reviewed the original conversion process Developed a set of methods to revise and validate a new process
Details of the Analysis Process Assessment data from children with and without disabilities were used in the sample (from original research) Age expected performance was used to benchmark the 7 points along a range of typical development for each age band
Analysis Process: Continued A sample of children with disabilities performance was compared to the benchmarks Validation of the new cut scores were based on previous research and federally reported state data
Early Childhood Outcomes Center Running OSEP Reports Current online reports do not yet reflect these revised cut scores but will soon. Brookes has programming into the online system underway. Reports based on the revised cut scores may be requested from Brookes and are quickly available Early Childhood Outcomes Center
What changed? Children need to have higher scores to be rated as performing similar to same age peers
How to explain the changes in APR and to Stakeholders Stress the importance of having numbers that are a more accurate representation of the status of the children Changes in the summary statements may not reflect a change in performance but a change in the measurement This could be a rationale for modifying your state’s targets for 2011-2012.
How does this impact the OSEP Child Outcomes Reports OSEP reports will have smaller proportions of children in the D and E categories Size of the effect will depend on the: % of children that being assessed with AEPSi in your state Ability level of the children in your population