1. The Results are In! Child Outcomes for OSEP EI and ECSE Programs Donna Spiker Early Childhood Outcomes Center at SRI International October 13, 2011 (CCSSO-SCASS Meeting) San Francisco, CA

2. What we will cover Quick review of the reporting requirement and state approaches Share the national data Describe how the national data were computed Discuss the quality of the national data Discuss next steps for states Framework and self-assessment (briefly. …) 2Early Childhood Outcomes Center

3. OSEP Reporting Requirements: Child Outcomes Positive social emotional skills (including positive social relationships) Acquisition and use of knowledge and skills (including early language/ communication [and early literacy]) Use of appropriate behaviors to meet their needs 3Early Childhood Outcomes Center

4. OSEP Reporting Categories Percentage of children who: a.Did not improve functioning b.Improved functioning, but not sufficient to move nearer to functioning comparable to same-aged peers c.Improved functioning to a level nearer to same-aged peers but did not reach it d.Improved functioning to reach a level comparable to same-aged peers e.Maintained functioning at a level comparable to same- aged peers 4Early Childhood Outcomes Center 3 outcomes x 5 “measures” = 15 numbers

6. The Summary Statements 1.Of those children who entered the program below age expectations in each outcome, the percent who substantially increased their rate of growth by the time they turned 3 years of age or exited the program. 2.The percent of children who were functioning within age expectations in each outcome by the time they turned 3 years of age or exited the program. 6Early Childhood Outcomes Center

7. State Approaches to Outcomes Data Approach Part C (56 states/jurisdictions) Preschool (59 states/jurisdictions) COS 7 pt. scale 41/56 (73%)37/59 (63%) One tool statewide 7/56 (13%)9/59 (15%) Publishers’ online analysis 3/56 (5%)6/59 (10%) Other5/56 (9%)7/59 (12%)

8. Early Childhood Outcomes Center8 Note: Based on 29 States with highest quality data

9. Early Childhood Outcomes Center9 Note: Based on 29 States with highest quality data

10. Early Childhood Outcomes Center10 Note: Based on 33 States with highest quality data

11. 11Early Childhood Outcomes Center Note : Based on 33 States with highest quality data

12. Criteria for States with Quality Data 1.Low percentage of missing data 2.No odd patterns in “a” or “e” categories 3.Did not use questionable data collection methods 12Early Childhood Outcomes Center

13. Problem with Missing Data We don’t know how well the data the state has represent the entire state. If the data are representative, the percentages for the a to e Progress Categories and the Summary Statements won’t change as data are added on more children. 13Early Childhood Outcomes Center

14. Can we trust these data? 14Early Childhood Outcomes Center

15. Pattern checking for validity Checking across years –How do the 2009-10 compare to the data for 2008-09? Checking across methods –How do the data for all states compare to states with highest quality data? 15Early Childhood Outcomes Center

16. Part C, Outcome A: Social Relationships

17. Part C, Outcome B: Knowledge and Skills

18. Part C, Outcome C: Meets Needs

19. Part B Preschool: Social Relationships

20. Part B Preschool: Knowledge and Skills

21. Part B Preschool: Meets Needs

22. What do these data tell us? Nationally, a high proportion of children who receive Part C and ECSE services are showing greater than expected progress. Nationally, many (over half) are exiting the program functioning like same age peers in at least one of the outcomes. 22Early Childhood Outcomes Center

23. Using data at state level…… Never intended to compare states OSEP wants states to begin by comparing own data to past data States set targets to compare yearly performance to those targets States implement program improvement activities OSEP looking at data in monitoring visits 23 Early Childhood Outcomes Center

24. Linkages to other state EC efforts…… Some states are beginning to develop linkages between these OSEP data and other assessment in their states, for example: – Colorado’s Results Matter – Results Matter in Nebraska – Kentucky Early Childhood Data System (KEDS) 24Early Childhood Outcomes Center

25. Colorado’s Results Matter Colorado’s Results Matter 25Early Childhood Outcomes Center

26. Supporting States in Building a Child Outcomes Measurement System (just briefly………)

27. Framework and Self-Assessment F RAMEWORK –Set of components and quality elements –Provides the structure for the self-assessment S ELF - ASSESSMENT –Scale that provides criteria for levels of implementation within each quality element –Rating assigned based on level of implementation within each element 27 Early Childhood Outcomes Center

28. 28

29. Additional Information & Questions Additional information: www.the-eco- center.org 29Early Childhood Outcomes Center Questions