Target Setting for Child Outcomes Conference Call October 30,
Today we will discuss Baseline data trends Data analysis to help set targets Involving stakeholders Target data trends Improvement planning 2
The Summary Statements Of those children who entered or exited the program below age expectations in each Outcome, the percent who substantially increased their rate of growth by the time they exited the program. The percent of children who were functioning within age expectations in each Outcome by the time they exited the program. 3
What is due in February, 2010? In Feb, 2010 SPP/APR report, states: Establish baseline for C3/B7 Calculate 2 summary statements based on your a-e progress categories Baseline must (and can only) include all children who exited between 7/1/08 and 6/30/09 Set targets for FFY 2009 and FFY 2010 Targets for FFY 2009 can be lower than baseline Targets for FFY 2010 must be higher than baseline 4
APR Reporting Feb, 2011 Report actual data Compare actual data to FFY 2009 targets and discuss progress or slippage HAVE THE OPTION to revise baseline using actual data reported in 2011 if the state believes the original baseline was inaccurate If you revise baseline, you MUST provide rationale for revising If you revise baseline, you may also revise targets for FFY 2010 based on new baseline 5
Baseline and Targets: Typical Timelines 6
OR Baseline and Target can be Revised in Feb,
Reasons for Expected State Variation States have different eligibility criteria Some states may not yet have representative data (phasing in outcomes data collection) Some states are still working on improving data quality 8
Looking at data by local program e.g. “e” category and SS2
Looking at data by local program e.g. “b” category and SS1
Comparing by Eligibility Category
Early Childhood Outcomes Center 27
Summarize across local programs
Early Childhood Outcomes Center 29 Local ID (N) A low A high B low B high C low C high A SS1 lo A SS1 hi A SS2 lo A SS2 hi B SS1 lo B SS1 hi B SS2 lo B SS2 hi C SS1 lo C SS1 hi C SS2 lo C SS2 hi 1 (152) 2 (61)xx 3 (52)xx 4 (37) x x x x x 5 (50) 6 (76)x 7 (47) 8 (33)x 9 (30)x x x x 10 (45)x 11 (127) 12 (69) 13 (42) x x x x x 14 (152) 15 (74)xxx Summary of Outliers in Local System Data
Possible Reasons for Outliers “bad data”-Not using data collection tools appropriately “good data”- serving different population of children “good data”- related to different program practices 30
ECO/NECTAC Resources re: target setting Summary statement calculator National Conference calls –Conference Call on Summary Statements - June 9, 2009 –Conference Call on Target Setting - June 16, 2009 –Conference Call on Updating SPP/APR Indicators – August 13, 2009 Suggested format for Feb 2010 SPP/APR: ndicators ndicators 31
ECO/NECTAC Resources re: target setting Individualized TA with states: –Supporting states in preparing for stakeholder discussions on target setting –Supporting states in looking at their data in various ways Resources: Looking at State data: Playing with data: PLAY.xls PLAY.xls 32
Resources for Stakeholder Groups Overview PPT titled “Opening”: includes overview to why report outcomes data, the 3 outcome areas, the 5 progress categories, target setting PPT titled “Summary Statements”: summarystatements-settingtargets.ppt summarystatements-settingtargets.ppt PPT titled “EIA”: interpreting data and planning improvement activities 33
Baseline and Targets: Typical Timelines 34
OR Baseline and Target can be Revised in Feb,
Comments? Reactions? Questions? 36