We worry about what a child will be tomorrow, yet we forget that he is someone today. --Stacia Tauscher

Positive Outcomes for Colorado’s Young Children and Families Creating A Meaningful Approach to Accountability

What Was the Impetus for Our Outcomes Work? In the beginning and still… Colorado’s work toward a comprehensive system of care and education More recently influenced by… Increasing push for outcome measures from local community level

Where We Began 1990 Small Number of Districts Begin Collecting Longitudinal Data on Colorado Preschool Program (CPP) Results 2004 Pilot is Discontinued 2001 State Dept of Ed Funds Project to Develop and Pilot a Child Outcomes Measurement System for Early Childhood Special Education and the CPP Number of Districts Collecting CPP Longitudinal Data Continues to Increase

What We Thought We Wanted A new and separate set of outcomes and indicators A new and “perfect” measurement tool Rubrics to help increase inter-rater reliability with the measurement tool A state data system

What We Learned A new and separate set of outcomes and indicators Diminished the use of Colorado’s early childhood guidelines: The Building Blocks to the K-12 Content Standards Added yet another set of expectations for programs such as Head Start or those committed to established curricular goals

What We Learned A new and “perfect” measurement tool “Who were we to think we could improve on the work of the masters?!” There is no perfect tool Providers communicated that the new tool really did not perform differently from what they already had

What We Learned Rubrics to help increase reliability Would have required more time and funding than could be committed Felt duplicative

What We Learned A state data system Regardless of what we decide to measure, this system can still serve to manage the information

Where We Are Now 1990 Small Number of Districts Begin Collecting Longitudinal Data on Colorado Preschool Program (CPP) Results 2003 Pilot is Discontinued 2001 State Early Childhood Team Funds Project to Develop and Pilot a Child Outcomes Measurement System for Early Childhood Special Education and the CPP 2004 State Early Childhood Team Revisits Core Values and Desired Purposes, Begins New Series of Meetings with Stakeholders Number of Districts Collecting CPP Longitudinal Data Continues to Increase

Core Values Guiding Colorado Decision Making There should be a multi-dimensional systems approach to include:  Child outcomes – long and short term  Family perceptions of child outcomes  Family satisfaction surveys  Teacher perceptions of school readiness  Program quality measures  Broad systems outcomes

Core Values Guiding Colorado Decision Making The system should be inclusive of all children.

Core Values Guiding Colorado Decision Making Child outcome measures should  Be contextualized, naturalistic, authentic  Fit Colorado early childhood guidelines (Building Blocks)  Be individualized

Core Values Guiding Colorado Decision Making Child outcome measures should (cont.)  Be based on sound developmental information  Utilize information from primary caregivers including families  Be culturally and linguistically appropriate  Be useful in influencing day-to-day parenting and educational practices  Be ongoing

Core Values Guiding Our Discussions on Assessment To the maximum extent possible, any strategies selected should  Positively influence the lives of children and families  Meet multiple needs at the program, community, state and federal level  Respect local efforts and accomplishments

Purposes of Colorado’s System To positively influence the lives of children and families

Purposes of Colorado’s System And to: Describe and value child progress over time Influence day to day interactions and interventions provided by the adults in a child’s life Influence program planning Show program efficacy at local and state level Feed data to broad systems evaluation project Inform policy development

Proposed Purposes of Colorado’s System Determine if funding is sufficient to provide an effective early childhood care and education program Determine supports needed by staff for ongoing professional development Define what types of early childhood programs work best.

New Directions Child Short Term Progress Data –The Ounce –Creative Curriculum Developmental Continuum –High/Scope Child Observation Record –Work Sampling Developmental Checklist To be determined: Establish an alternative for children with significant support needs

New Directions Child Longitudinal Data % of students on Individual Literacy Plans in Kindergarten, First and Second Grades % of children qualified for special education in primary grades not involved in state funded preschool program Colorado Student Assessment Program (CSAP) scores at 3 rd and 6 th grades % of children exited from special education Re-entrance to special education % of children retained Continued engagement with the education system (graduation, formal transition following secondary level, etc)

New Directions Consumer Feedback Data Survey of family views of child progress Survey of kindergarten teacher perceptions of school readiness Family satisfaction surveys

New Directions Program Quality Data Infant/Toddler Environmental Rating Scale Early Childhood Environmental Rating Scale Early Language and Literacy Classroom Observation Other NAEYC Accreditation Colorado Quality Standards Educare Rating System

Lessons Learned (so far) A diverse and balanced work group results in balanced work product Staff development is key Strategic planning is necessary for marketing to various stakeholder groups When the pressure is on, it’s easy to drift from core values…

Resources We Found Useful Principles and Recommendations for Early Childhood Assessments; Goal 1 Early Childhood Assessments Resource Group, The National Education Goals Panel, Assessing the State of State Assessments: Perspectives on Assessing Young Children; SERVE, Smart Start Technical Assistance Grant National School Readiness Project And coming soon Policy Matters

Not everything that can be measured counts, and not everything that counts can be measured. --Albert Einstein