Building a Quality Measurement System

Slides:



Advertisements
Similar presentations
Orelena Hawks Puckett Institute American Institutes for Research PACER Center University of Connecticut Center for Excellence in Disabilities Presentation.
Advertisements

Researchers as Partners with State Part C and Preschool Special Education Agencies in Collecting Data on Child Outcomes Kathy Hebbeler, ECO at SRI International.
Embedding Child and Family Outcomes into Practice – Part 1 Kathy Hebbeler ECO at SRI International Early Childhood Outcomes Center Webinar for the Massachusetts.
Refresher: Background on Federal and State Requirements.
Update on Child Outcomes for Early Childhood Special Education Lynne Kahn ECO at UNC The Early Childhood Outcomes (ECO) Center The National Association.
2011 OSEP Leadership Mega Conference Collaboration to Achieve Success from Cradle to Career 2.0 The Results are In: Using Early Childhood Outcome Data.
Supporting States in Building a Child Outcomes Measurement System Prepared for the ECO Advisers Meeting February 2011.
1 Measuring Child Outcomes: State of the Nation. 2 Learning objective: To gain new information about the national picture regarding measuring child outcomes.
Highs and Lows on the Road to High Quality Data American Evaluation Association Anaheim, CA November, 2011 Kathy Hebbeler and Lynne Kahn ECO at SRI International.
Presented at Annual Conference of the American Evaluation Association Anaheim, CA, November 2011 Lessons Learned about How to Support Outcomes Measurement.
The Results are In! Child Outcomes for OSEP EI and ECSE Programs Donna Spiker Early Childhood Outcomes Center at SRI International October 13, 2011 (CCSSO-SCASS.
Update on Part C Child Outcomes Lynne Kahn ECO at UNC The Early Childhood Outcomes (ECO) Center June 2011 Kathy Hebbeler ECO at SRI International.
The Results are In: Using Early Childhood Outcome Data Kathy Hebbeler Early Childhood Outcomes Center at SRI International August, 2011.
Presented at Division for Early Childhood National Harbor, Maryland November, Child Outcomes: What We Are Learning from National, State, and Local.
Early Childhood Outcomes Center Using the Child Outcomes Summary Form February 2007.
The Center for IDEA Early Childhood Data Systems ECTA/DaSy System Framework Self- Assessment June 18, 2015.
The Current Status of States' Early Childhood Outcome Measurement Systems Kathy Hebbeler, SRI International Lynne Kahn, FPG Child Dev Inst October 17,
Presented at 2012 Child and Family Outcome Conference Minneapolis, MN October, 2012 The Child and Family Outcomes Measurement Frameworks Donna Spiker Early.
Council for Exceptional Children/Division of Early Childhood Conference October 2010 Kim Carlson, Asst. Director/619 Coordinator Ohio Department of Education.
1 Measuring Child Outcomes: State of the Nation. 2 Learning objective: To gain new information about the national picture regarding measuring child outcomes.
Presented at Division for Early Childhood International Conference on Young Children with Special Needs and Their Families October, 2010 Building a Quality.
Presented at Measuring Child and Family Outcomes Meeting Crystal City, VA July, 2010 Building a Child Outcomes Measurement System Kathy Hebbeler, ECO at.
Assessment and Young Children with Disabilities Kathy Hebbeler SRI International 1 Early Childhood Outcomes Center CEELO Roundtable San Francisco, CA June.
ECO FAMILY EXPERIENCES AND OUTCOMES MEASUREMENT SYSTEM Lauren Barton, ECO at SRI Siobhan Colgan, ECO at FPG Kathy Hebbeler, ECO at SRI Melissa Raspa, ECO.
Presented at State Kindergarten Entry Assessment (KEA) Conference San Antonio, Texas February, 2012 Comprehensive Assessment in Early Childhood: How Assessments.
Presented at ECEA-SCASS Meeting Savannah, Georgia October, 2010 OSEP Initiatives on Early Childhood Outcomes Kathy Hebbeler Early Childhood Outcomes Center.
Embedding Child and Family Outcomes into Practice – Part 2 Kathy Hebbeler ECO at SRI International Early Childhood Outcomes Center Webinar for the Massachusetts.
Measuring and Improving Child and Family Outcomes Conference New Orleans, Sept 19-21, 2011 Using the Child Outcomes Measurement System (COMS) Self-Assessment.
Parent and National TA Perspectives on EC Outcomes Connie Hawkins, Region 2 PTAC Kathy Hebbeler, ECO at SRI Lynne Kahn ECO at FPG and NECTAC.
ECO FAMILY EXPERIENCES AND OUTCOMES MEASUREMENT SYSTEM SIOBHAN COLGAN, ECO AT FPG CHELSEA GUILLEN, ILLINOIS MELISSA RASPA, ECO AT RTI ALICE RIGEWAY, CONNECTICUT.
Improving Data, Improving Outcomes Conference Washington, DC Sept , 2013 Planful Changes: Using Self-Assessments to Improve Child and Family Outcome.
Measuring EC Outcomes DEC Conference Presentation 2010 Cornelia Taylor, ECO Christina Kasprzak, ECO/NECTAC Lisa Backer, MN DOE 1.
Presented at Annual Conference of the American Evaluation Association Anaheim, CA, November 2011 Lessons Learned about How to Support Outcomes Measurement.
Kathy Hebbeler, ECO at SRI Lynne Kahn, NECTAC and ECO at FPG
Early Childhood Personnel Center
Incorporating Early Childhood into Longitudinal Data Systems:
2015 Leadership Conference “All In: Achieving Results Together”
OSEP Project Directors Meeting
Supporting Improvement of Local Child Outcomes Measurement Systems
ECO Family Experiences and Outcomes measurement system
ECTA/DaSy System Framework Self-Assessment
Using Family Survey Data for Program Improvement
Measuring Outcomes for Programs Serving Young Children with Disabilities Lynne Kahn and Christina Kasprzak ECO/NECTAC at FPG/UNC June 2,
Early Childhood Outcomes: Using Data for Program Improvement
The Early Childhood Technical Assistance Center
Supporting States in Building a Child Outcomes Measurement System
OSEP Initiatives on Early Childhood Outcomes
Part C/619 System Framework goal Governance Funding/ Finance
Data on Child and Family Outcomes: Tools for Improving State Systems
ECTA/DaSy System Framework Self-Assessment
Using outcomes data for program improvement
Supporting Improvement of Local Child Outcomes Measurement Systems
Lynne Kahn Kathy Hebbeler The Early Childhood Outcomes (ECO) Center
Why Collect Outcome Data?
Using Data for Program Improvement
Early Childhood and Family Outcomes
Update from ECO: Possible Approaches to Measuring Outcomes
History of work between ODE and ECO
Measuring Outcomes for Programs Serving Young Children with Disabilities Lynne Kahn and Christina Kasprzak ECO/NECTAC at FPG/UNC June 2,
Using Data for Program Improvement
Researchers as Partners with State Part C and Preschool Special Education Agencies in Collecting Data on Child Outcomes Kathy Hebbeler, ECO at SRI International.
Using Family Survey Data for Program Improvement
Measuring EC Outcomes DEC Conference Presentation 2010
Measuring Part C and Early Childhood Special Education Child Outcomes
Refresher: Background on Federal and State Requirements
Christina Kasprzak Frank Porter Graham Child Development Institute
Using Child and Program Standards to Improve Child Outcomes
Measuring Child and Family Outcomes Conference August 2008
Implementing, Sustaining and Scaling-Up High Quality Inclusive Preschool Policies and Practices: Application for Intensive TA September 10, 2019 Lise.
Presentation transcript:

Building a Quality Measurement System Kathy Hebbeler Early Childhood Outcomes Center SRI International Presented at Division for Early Childhood International Conference on Young Children with Special Needs and Their Families October, 2010 1

Early Childhood Outcomes Center "Success should be judged by results, and data is a powerful tool to determine results. We can't ignore facts. We can't ignore data." President Barack Obama July 24, 2009 Early Childhood Outcomes Center

System for Producing Good Child and Family Outcomes Prof’l Development Preservice Inservice Evidence Based Practice Good outcomes for children and families High quality services and supports for children 0-5 and their families Good Federal policies and programs Good State policies and programs Good Local policies and programs Part of the intentionality we need to building our systems is the availability and use of good information about the direct service component and the other components in the systems. Without good information, we are operating in a “pay and pray” mode. Without good data, we don’t know what we are buying with our money. And we don’t have the tools to identify program weaknesses and address them. Strong Leadership Adequate funding Information infrastructure

Early Childhood Outcomes Center A good information infrastructure is an essential tool to providing high quality services and supports. (You cannot have data based-decision making without good data.) This really is about children and families. Early Childhood Outcomes Center

Early Childhood Outcomes Center Early Childhood Information Infrastructure: Data Needed for Program Improvement WHO SERVICES OUTCOMES PERSONNEL COST Who – Ages Disabilities Race/ethnicity Services – what, how much, how long – part c and 619 – many different services; not so much with state operated preschool Early Childhood Outcomes Center

Early Childhood Outcomes Center A Framework and Self Assessment for Building a Child Outcomes Measurement System Early Childhood Outcomes Center

Purpose of the Framework Provide a common language for ECO and other TA providers to use in discussing COMSs with states. Provide a organizing structure of categorizing resources and state examples related to implementation of a COMS. Serve as the organizing structure for the self assessment Early Childhood Outcomes Center

Framework and Self-Assessment Set of components and quality indicators Provides the structure for the self-assessment Self-assessment Scale that provides criteria for levels of implementation within each quality indicator Rating assigned based on level of implementation within each indicator Early Childhood Outcomes Center

Process for Framework Development Built off what we had learned from ECO work with states and previous ECO conceptual framework Literature review Repeated discussion and review internally and with 7 Partner States

Framework Partner States Part C 619 California X Colorado Delaware Maine Minnesota New York Ohio

COMS Framework Components Purpose Analysis Data Collection and Trans-mission Reporting Using Data The difference between a data system and an outcomes measurement system. Cross-system Coordination Evaluation Early Childhood Outcomes Center

COMS Framework Components Purpose The state has effective procedures for collecting, storing, and transmitting data to the state. Analysis Data Collection and Trans-mission Reporting Using Data The difference between a data system and an outcomes measurement system. Cross-system Coordination Evaluation Early Childhood Outcomes Center

COMS Framework Components Purpose State coordinates child outcomes measurement and data use across EC systems. Analysis Data Collection and Trans-mission Reporting Using Data Cross-system Coordination Evaluation Early Childhood Outcomes Center

Early Childhood Outcomes Center Quality Indicator Provides additional detail as to what constitutes quality implementation of the component. 18 quality indicators across the 7 components Early Childhood Outcomes Center

Quality Indicators for Data Collection and Transmission 2. Data collection procedures are carried out efficiently and effectively. 3. Providers, supervisors, and others involved in data collection have the required knowledge, skills, and commitment. 4. State's method for entering, transmitting, and storing data is effective and efficient. Early Childhood Outcomes Center

Structure of Self Assessment Components (7) = Major areas of framework Quality Indicators (18 total) = Statements of basic requirements of a quality COMS Elements (number varies with each indicator) = Define what constitutes high quality on the Quality Indicator. Early Childhood Outcomes Center

Early Childhood Outcomes Center

Early Childhood Outcomes Center

Early Childhood Outcomes Center

The Scale for the Quality Indicators Implementation of Elements Quality Indicator Score All elements are fully implemented 7 Nearly all elements are fully implemented and the rest are in process 6 Most of the elements are fully implemented and the rest are in process. 5 At least one element is fully implemented and the rest are in process 4 All of the elements are in process 3 Some of the elements are in process 2 None of the elements are yet in process 1 Early Childhood Outcomes Center

Early Childhood Outcomes Center

Recommended State Approach for Using the Self Assessment Complete the entire self assessment. Identify the component(s) and quality indicators to address first. Develop action plan to improve the related elements. Implement improvement activities. Re-assess status and identify “next step” priorities at regular intervals Early Childhood Outcomes Center

Next steps for ECO in developing the self assessment Populate the COMS framework with resources related to the components Revise the self assessment based on feedback Develop a framework for a Family Outcomes Measurement System Early Childhood Outcomes Center

Early Childhood Outcomes Center For more information For updates to the framework and the self-assessment and resources to support the quality indicators: www.the-eco-center.org Early Childhood Outcomes Center