Partnering with Local Programs to Interpret and Use Outcomes Data Delaware’s Part B 619 Program September 20, 2011 Verna Thompson & Tony Ruggiero Delaware.

Slides:



Advertisements
Similar presentations
Data, Now What? Skills for Analyzing and Interpreting Data
Advertisements

Building a national system to measure child and family outcomes from early intervention Early Childhood Outcomes Center International Society on Early.
Researchers as Partners with State Part C and Preschool Special Education Agencies in Collecting Data on Child Outcomes Kathy Hebbeler, ECO at SRI International.
Indicator 7 Child Outcomes MAKING SENSE OF THE DATA June
Refresher: Background on Federal and State Requirements.
Update on Child Outcomes for Early Childhood Special Education Lynne Kahn ECO at UNC The Early Childhood Outcomes (ECO) Center The National Association.
2011 OSEP Leadership Mega Conference Collaboration to Achieve Success from Cradle to Career 2.0 The Results are In: Using Early Childhood Outcome Data.
Early Childhood Outcomes Center Orientation for New Outcomes Conference Participants Lynne Kahn Christina Kasprzak Kathy Hebbeler The Early Childhood Outcomes.
Early Childhood Outcomes ECO Institute Kathy Hebbeler, ECO at SRI Robin Rooney ECO at FPG Prepared for the Office of Early Learning and School Readiness.
1 Measuring Child Outcomes: State of the Nation. 2 Learning objective: To gain new information about the national picture regarding measuring child outcomes.
Highs and Lows on the Road to High Quality Data American Evaluation Association Anaheim, CA November, 2011 Kathy Hebbeler and Lynne Kahn ECO at SRI International.
CHILD OUTCOMES BASELINE AND TARGETS FOR INDICATOR 7 ON THE STATE PERFORMANCE PLAN State Advisory Panel for Exceptional Children November 12, 2009 January.
The Results are In! Child Outcomes for OSEP EI and ECSE Programs Donna Spiker Early Childhood Outcomes Center at SRI International October 13, 2011 (CCSSO-SCASS.
Update on Part C Child Outcomes Lynne Kahn ECO at UNC The Early Childhood Outcomes (ECO) Center June 2011 Kathy Hebbeler ECO at SRI International.
The Results are In: Using Early Childhood Outcome Data Kathy Hebbeler Early Childhood Outcomes Center at SRI International August, 2011.
Presented at Division for Early Childhood National Harbor, Maryland November, Child Outcomes: What We Are Learning from National, State, and Local.
Updates on APR Reporting for Early Childhood Outcomes (Indicators C-3 and B-7) Western Regional Resource Center APR Clinic 2010 November 1-3, 2010 San.
Child Outcomes Data July 1, 2008 – June 30, 2009.
Early Childhood Outcomes Center Using the Child Outcomes Summary Form February 2007.
The Current Status of States' Early Childhood Outcome Measurement Systems Kathy Hebbeler, SRI International Lynne Kahn, FPG Child Dev Inst October 17,
Target Setting For Indicator #7 Child Outcomes WDPI Stakeholder Group December 16, 2009 Ruth Chvojicek Statewide Child Outcomes Coordinator 1 OSEP Child.
Erin Arango-Escalante & Sandra Parker. EC Indicators At-a-Glance.
1 Early Childhood and Accountability OSEP’s Project Director’s Meeting August 2006.
SPP Indicators B-7 and B-8: Overview and Results to Date for the Florida Prekindergarten Program for Children with Disabilities PreK Coordinators Meeting.
1 Using a Statewide Evaluation Tool for Child Outcomes & Program Improvement Terry Harrison, Part C Coordinator Susan Evans, Autism Project Specialist.
Preparing the Next Generation of Professionals to Use Child Outcomes Data to Improve Early Intervention and Preschool Special Education Lynne Kahn Kathy.
UNDERSTANDING THE THREE CHILD OUTCOMES 1 Maryland State Department of Education - Division of Special Education/Early Intervention Services.
Child Outcomes: Understanding the Requirements in order to Set Targets Presentation to the Virginia Interagency Coordination Council Infant &
Looking for Patterns in Child Outcome Data – Examples from NYS New York State Department of Health Bureau of Early Intervention.
1 Quality Assurance: The COS Ratings and the OSEP Reporting Categories Presented by The Early Childhood Outcomes Center Revised January 2013.
Overview to Measuring Early Childhood Outcomes Ruth Littlefield, NH Department of Education Lynne Kahn, FPG Child Dev Inst November 16,
1 Measuring Child Outcomes: State of the Nation. 2 Learning objective: To gain new information about the national picture regarding measuring child outcomes.
2012 OSEP Leadership Conference Leading Together to Achieve Success from Cradle to Career Child Outcomes for Early Intervention and Preschool Special Education:
JANUARY 6, 2014 VERNA THOMPSON Delaware 619 Meeting.
Delaware Child Outcomes Part C and 619 Collaboration Measuring Child and Family Outcomes July 30, 2010 Arlington, Virginia.
Understanding and Using Early Childhood Outcome (ECO) Data for Program Improvement Kansas Division for Early Childhood Annual Conference Feb. 23rd 2012.
Early Childhood Outcomes Center Orientation to Measuring Child and Family Outcomes for New People Kathy Hebbeler, ECO at SRI Lynne Kahn, ECO at FPG/UNC.
Understanding and Using Early Childhood Outcome (ECO) Data for Program Improvement TASN – KITS Fall 2012 Webinar August 31 st, 2012 Tiffany Smith Phoebe.
1 Indicator 7 Child Outcomes: Changes & Updates June 2011 Indicator 7 Child Outcomes: Changes & Updates June 2011.
Presented at ECEA-SCASS Meeting Savannah, Georgia October, 2010 OSEP Initiatives on Early Childhood Outcomes Kathy Hebbeler Early Childhood Outcomes Center.
Summary Statements. The problem... Progress data included –5 progress categories –For each of 3 outcomes –Total of 15 numbers reported each year Too many.
Why Collect Outcome Data? Early Childhood Outcomes Center.
Building State Systems to Produce Quality Data on Child Outcomes Jim J. Lesko Director, Early Development and Learning Resources Delaware Department of.
Measuring EC Outcomes DEC Conference Presentation 2010 Cornelia Taylor, ECO Christina Kasprzak, ECO/NECTAC Lisa Backer, MN DOE 1.
Child Outcomes Measurement Tools & Process A story of 3 conversions.
Child Outcomes Summary Process April 26, 2017
OSEP Project Directors Meeting
New Orleans, LA September 9, 2014
Kathy Hebbeler, ECO at SRI International AUCD Meeting Washington, DC
Review of Summary Statements for Target Setting on Indicators C3 and B7 Lynne Kahn and Christina Kasprzak ECO/NECTAC June 9,
Early Childhood Outcomes Data (Indicator C3 and B7)
Integrating Outcomes Learning Community Call February 8, 2012
OSEP Initiatives on Early Childhood Outcomes
Christina Kasprzak, ECTA/ECO/DaSy September 16, 2013
Building State Systems to Produce Quality Data on Child Outcomes
Lynne Kahn Kathy Hebbeler The Early Childhood Outcomes (ECO) Center
Why Collect Outcome Data?
Building Capacity to Use Child Outcomes Data to Improve Systems and Practices 2018 DEC Conference.
Early Childhood and Family Outcomes
Researchers as Partners with State Part C and Preschool Special Education Agencies in Collecting Data on Child Outcomes Kathy Hebbeler, ECO at SRI International.
ECO Suggestions on Indicators C3 and B7 Kathy Hebbeler, ECO
ECO Suggestions on Indicators C3 and B7 Kathy Hebbeler, ECO
Review of Summary Statements for Target Setting on Indicators C3 and B7 Lynne Kahn and Christina Kasprzak ECO/NECTAC June 9,
Measuring EC Outcomes DEC Conference Presentation 2010
Measuring Part C and Early Childhood Special Education Child Outcomes
Refresher: Background on Federal and State Requirements
Child Outcomes Data July 1, 2008 – June 30, 2009
Measuring Child and Family Outcomes Conference August 2008
Early Childhood Outcomes Data (Indicator C3 and B7)
Presentation transcript:

Partnering with Local Programs to Interpret and Use Outcomes Data Delaware’s Part B 619 Program September 20, 2011 Verna Thompson & Tony Ruggiero Delaware Department of Education Early Development and Learning Resources

Agenda Delaware Information –Demographics –State COSF Data 2011 Part B 619 Local Program Visits –Purpose of visits –Information shared –What we learned Data Analysis Process –Distribution by disability type and year –Possible explanations for unusual data Improving Child Outcome Data –Plans for improving data quality 2

Delaware Demographics Geography – square miles –Three Counties –19 school districts Population –897,934 people (2010 US Census) Children –17% of young children 0-5 live in poverty (Center for Applied Demography and Survey Research, University of Delaware) –1,551 children with disabilities (3-5 years old) in Part B 619 (Delaware Department of Education) 3

The First State - Delaware 4

Delaware Young Children in 619 Child Outcomes System Children 3-5 years of age with IEP Children receiving at least 6 months of services 6 months between the first and final assessment Children who temporarily withdraw from services are included if they return within 30 days of the date they withdrew Children with more than 30 day break in service are considered dropped from the program. If the child re- enrolls the 60 day assessment process must be initiated again. 5

Procedures for COSF Process Child Outcomes procedures are available in Building BLOCKS Manual Multidisciplinary teams complete COSF with parent input COSF information is entered on state data system COSF data is downloaded by Delaware DOE EDLR 6

Outcome 1 – Statewide (2010) 7

Outcome 2 – Statewide (2010) 8

Outcome 3 – Statewide 9

10 Average Entry and Exit Outcome Scores Group Social- Emotional Knowledge and Skills Action to Meet Needs Delaware Entry Exit

Entry Exit Total Review Total Outcome 1: Positive Social Relationships (DE 2010, Social and Emotional) 11

Entry Exit Total Review Total Outcome 2: Use Knowledge and Skills (DE 2010, Knowledge and Skills) 12

Entry Exit Total Review Total Outcome 3: Appropriate Action (DE 2010, Behavior Meets Needs) 13

Part B 619 Site Visits Purpose of visits –Develop relationships with 619 coordinators –Gather information about 619 programs –Share Child Outcomes information –Discuss COSF process in the district –Begin the data analysis process with district –Determine strengths and needs for support 14

Part B 619 Site Visits Procedure for Site Visits –District shared information Early Childhood program and children Child Outcomes procedures –DOE shared information Delaware Child Outcomes data State Child Outcomes targets School district Child Outcomes data –Analyzed data together Compared state and local data Explored possible local trends, patterns Discussed next steps 15

Samples of Local Child Outcomes Data 16

17 Delaware and District A Average Entry Scores on Outcomes Group Social- Emotional Knowledge and Skills Behavior Meets Needs Delaware District A

18 Delaware and District A Average Exit Scores on Outcomes Group Social- Emotional Knowledge and Skills Behavior Meets Needs Delaware District A

Entry Exit Total Review Total Outcome 1: Positive Social Relationships (District A 2010, Social and Emotional) 19

Part B 619 Site Visits What we learned – successes and challenges –Some children were not being included in Child Outcomes System –School districts had unique rating patterns –School districts assigned different staff to enter COSF ratings on data system –Progress question was not answered in consistent manner – Many special services directors had limited understanding of COSF process 20

After Completing Site Visits…… School Districts –Requested training for EC staff –Discussed COSF process during staff meetings –Called DOE often to discuss unusual data –Special Services shared COSF data with administrators DOE EDLR –Participated in updating Child Outcomes manual –Continued analysis process 21

Child Outcomes Data Analysis Process Activity: –Analyze entry and exit Child Outcomes data from 3 school districts –Do you notice any differences between the districts and the state Child Outcomes data? 22

23 Average Entry Outcome Scores, 2010 Group Social- Emotional Knowledge and Skills Action to Meet Needs Delaware District A District B District C

24 Average Exit Outcome Scores, 2010 Group Social- Emotional Knowledge and Skills Action to Meet Needs Delaware District A District B District C

Comments……. 25

Delaware and District Data Explanations for differences –Programs serve different populations of children –Small numbers issues exist in some districts –Population shift of students who are assessed –Scores differ by special education type –Different levels of EC staff experience using COSF 26

Population of Young Children With Disabilities Delaware

Population of Young Children With Disabilities Delaware & Selected Districts

29 Entry Scores Differ by Special Education Type Group Social- Emotional Knowledge and Skills Behavior Meets Needs Autism Developmental Delay Preschool Speech Delay

30 Exit Scores Differ by Special Education Type Group Social- Emotional Knowledge and Skills Behavior Meets Needs Autism Developmental Delay Preschool Speech Delay

OSEP APR Indicator 7 a Percent of preschool children who did not improve functioning b Percent of preschool children who improved functioning but not sufficient to move nearer to functioning comparable to same-aged peers c Percent of preschool children who improved functioning to a level nearer to same-aged peers d Percent of preschool children who improved functioning to reach a level comparable to same-aged peers e Percent of preschool children who maintained functioning at a level comparable to same-aged peers 31

2011 OSEP Indicator 7 Data 32 Category Social- Emotional Knowledge and Skills Behavior Meets Needs a b c d d

OSEP APR Indicator 7 Summary Statement Data 1. Of those children who entered or exited the program below age expectations the percent who substantially increased their rate of growth by the time they exited the program. 2, The percent of children who were functioning within age expectations by the time they exited the program. 33 StatementsS&E Targets K&S Targets BMN Targets

What are we planning to improve Child Outcome data? New process for working with school districts to review Child Outcomes data Revised Child Outcomes manual Identify missing children who are not being entered in system Communicate the COSF Process Provide ongoing training for completing COSF using multi-sources of information –Question unusual data –Troubleshoot problems 34

How can we improve Child Outcome data? Provide professional development opportunities with Part B and C Analyze teaming procedures for completing COSF using multi-sources of information Encourage school districts to discuss and practice COSF process at staff meetings 35

Questions, comments? Opportunity to share comments, experiences….. Questions? Thank you! 36