Early Childhood Outcomes Center1 Involving Families.

Slides:



Advertisements
Similar presentations
Illinois October, 2008 Early Childhood Outcomes: Using Data for Program Improvement Kathy Hebbeler ECO at SRI International Robin Rooney and Christina.
Advertisements

Early Childhood Outcomes Center1 The Fun Stuff: Using the Data.
Using outcomes data for program improvement Kathy Hebbeler and Cornelia Taylor Early Childhood Outcome Center, SRI International.
Microfilming Procedures with Kim Smith (aka Microfilm Whisperer)
Introduction to Competency-Based Residency Education
Riso Digital Education Center1 Appendix05 RP(RP3105) Print (TCP/IP) (WindowsXP)
Riso Digital Education Center1 Appendix 03: Windows XP CS-2000.
Riso Kagaku Technical Training Center1 MZ Technical Training (Refer to MZ Technical Manual Revison 0.3)
Early Childhood Outcomes Center 1 Using the Child Outcomes Summary From Part II: What is the COSF Using the Child Outcomes Summary From Part II: What.
Hawai’i January, 2008 Progress toward Measuring Goals in Early Intervention: What’s New from What Counts Kathy Hebbeler ECO at SRI International.
Module 1 Learning More about the Summary of Functional Performance Every day, we are honored to take action that inspires the world to discover, love and.
Promoting Quality Child Outcomes Data Donna Spiker, Lauren Barton, Cornelia Taylor, & Kathleen Hebbeler ECO Center at SRI International Presented at: International.
Ideas from the Outcomes Think Tank. Gather family’s concerns and general information about child following program procedures Use 3 global outcomes as.
Module 2 Learning More about the Summary of Functional Performance Every day, we are honored to take action that inspires the world to discover, love and.
Early Childhood Outcomes Center1 Refresher: Child Outcome Summary Form Child Outcome Summary Form.
Indicator 7 Child Outcomes MAKING SENSE OF THE DATA June
Early On® Michigan Child Outcomes
Data Analysis for Assuring the Quality of your COSF Data 1.
Refresher: Background on Federal and State Requirements.
CHILD OUTCOMES BASELINE AND TARGETS FOR INDICATOR 7 ON THE STATE PERFORMANCE PLAN State Advisory Panel for Exceptional Children November 12, 2009 January.
Using data for program improvement Early Childhood Outcomes Center1.
Minnesota Manual of Accommodations for Students with Disabilities Training Guide
1 Assuring the Quality of your COSF Data. 2 What factors work to improve the quality of your data? What factors work to lessen the quality of your data?
Parent Introduction to School-wide Positive Behavior Supports (SW-PBS)
The Current Status of States' Early Childhood Outcome Measurement Systems Kathy Hebbeler, SRI International Lynne Kahn, FPG Child Dev Inst October 17,
Partnering with Local Programs to Interpret and Use Outcomes Data Delaware’s Part B 619 Program September 20, 2011 Verna Thompson & Tony Ruggiero Delaware.
Pacific TA Meeting: Quality Practices in Early Intervention and Preschool Programs.
ENHANCE Update Research Underway on the Validity of the Child Outcomes Summary (COS) Process ECO Center Advisory Board Meeting March 8, 2012 Arlington,
Overall Teacher Judgements
Intro to Positive Behavior Interventions & Supports (PBiS)
Quality Assurance: Looking for Quality Data 1 I know it is in here somewhere Presented by The Early Childhood Outcomes Center Revised January 2013.
1 Early Childhood and Accountability OSEP’s Project Director’s Meeting August 2006.
ND Early Childhood Outcomes Process Nancy Skorheim – ND Department of Public Instruction, Office of Special Education.
Early Childhood Outcomes Center Do My Data Count? Questions and Methods for Monitoring and Improving our Accountability Systems Dale Walker, Sara Gould,
Approaches to Measuring Child Outcomes Kathy Hebbeler ECO at SRI International Prepared for the NECTAC National Meeting on Measuring Child and Family Outcomes,
Intro to Positive Behavior Supports (PBiS) Vermont Family Network March 2010.
Michigan Partnering with Parents to Help Measure Outcomes for Young Children and Families Chandra Jones Vanessa Winborne MICC Parent Michigan Part C Coordinator.
Overview to Measuring Early Childhood Outcomes Ruth Littlefield, NH Department of Education Lynne Kahn, FPG Child Dev Inst November 16,
Using COS Data to Inform Program Improvement at All Levels Every day, we are honored to take action that inspires the world to discover, love and nurture.
Early Childhood Outcomes Center 1 The Child Outcomes Summary Form (COSF)
Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC) National Early Childhood TA Center Delaware COSF Training,
Understanding and Using Early Childhood Outcome (ECO) Data for Program Improvement Kansas Division for Early Childhood Annual Conference Feb. 23rd 2012.
Using COS Data to Inform Program Improvement at All Levels Every day, we are honored to take action that inspires the world to discover, love and nurture.
Understanding and Using Early Childhood Outcome (ECO) Data for Program Improvement TASN – KITS Fall 2012 Webinar August 31 st, 2012 Tiffany Smith Phoebe.
AN OVERVIEW OF THE CHILD OUTCOMES SUMMARY RATING PROCESS 1 Maryland State Department of Education - Division of Special Education/Early Intervention Services.
Michigan Partnering with Parents to Help Measure Outcomes for Young Children and Families Vanessa WinborneJulie Lagos Michigan Part C CoordinatorParent,
What the data can tell us: Evidence, Inference, Action! 1 Early Childhood Outcomes Center.
1 We Changed the COSF The Flip The Skills The Decision-Tree Questions.
How to Involve Families in the Child Outcome Summary (COS) Process Debi Donelan, MSSA Early Support for Infants and Toddlers Katrina Martin, Ph.D. SRI.
Including Parents In Alaska Child Outcomes. Alaska Child Outcomes Development Summer 2005 – General Supervision Enhancement Grant (GSEG) Infant & Toddler.
Looking at Data Presented by The Early Childhood Outcomes Center
Quality Assurance: Looking for Quality Data
There is great power in harmony and mutual understanding.
Child Outcomes Summary Process April 26, 2017
Child Outcomes Summary (COS) Process Module
the Child Outcomes Data Workshop!
Integrating Outcomes Learning Community Call February 8, 2012
Assuring the Quality of your COSF Data
Using outcomes data for program improvement
Ensuring the Quality of Child Outcomes Data
Background on Provincial Report Cards
Update from ECO: Possible Approaches to Measuring Outcomes
There is great power in harmony and mutual understanding.
Child Outcome Summary Form
Child Outcomes Summary (COS) Process Module
Refresher: Background on Federal and State Requirements
Involving Families Early Childhood Outcomes Center.
Involving Families in the COS Process
Assuring the Quality of your COSF Data
Presentation transcript:

Early Childhood Outcomes Center1 Involving Families

Early Childhood Outcomes Center2 Informing Families What are you doing to inform families about the data collection? Why it is occurring What it involves What it means for them and their child

Early Childhood Outcomes Center3 Federal and State Activities State Activities ates.cfm#State_sites

Early Childhood Outcomes Center4

5 Preparing Families Helping families be active participants in the discussion What is working? What is not working? General principle: Families need to know what to expect

Early Childhood Outcomes Center6 What Do We Expect from Families Yes - That they will be able to provide rich information about their childs functioning across settings and situation Maybe but not necessarily – That they will know whether their child is showing age appropriate behavior

Early Childhood Outcomes Center7 Involving Families in a Conversation about Their Child Avoid jargon Avoid questions that can be answered with a yes or no Does Anthony finger feed himself? Ask questions that allow parents to tell you what they have seen Tell me about how Anthony eats

Early Childhood Outcomes Center8 Involving Families in a Conversation about Their Child What is working? What is not working?

Early Childhood Outcomes Center9 Involving Families in the Rating Discussion What % of families are participating? How are you doing this? What is working? What is not working?

Early Childhood Outcomes Center10 Families Right to COSF Information All families have a right to know what ratings have given to their child -- and to the records containing the information.

Early Childhood Outcomes Center11 Quality Review of Discussion Activity Including Families in the Rating Discussion

Early Childhood Outcomes Center12 Looking for Quality Data I know it is in here somewhere

Early Childhood Outcomes Center13 Activity What factors work to improve the quality of your data? What factors work to lessen the quality of your data? How to address these factors?

Early Childhood Outcomes Center14 Take Home Message If you conclude the data are not (yet) valid, they cannot be used for program effectiveness, program improvement or anything else. What do you if the data are not as good as they should be? Answer: Continue to improve data collection through ongoing quality assurance

Early Childhood Outcomes Center15 Many steps to ensuring quality data Before Good data collection/Training Good data system and data entry procedures During Ongoing supervision of implementation Feedback to implementers Refresher training After Review of COSF records Data analyses for validity checks

Early Childhood Outcomes Center16 Many steps to ensuring quality data Before Good data collection/Training Good data system and data entry procedures During Ongoing supervision of implementation Feedback to implementers Refresher training After Review of COSF records Data analyses for validity checks

Early Childhood Outcomes Center17 Promoting quality data Training and support before and during data collection Analysis of the data after data collection Data system and verification after data collection

Early Childhood Outcomes Center18 Promoting Quality Data Through training and communication related to: Assessment Understanding the COSF process Age expectations Data entry

Early Childhood Outcomes Center19 Promoting Quality Data Through training materials, such as Video team and child examples Written child examples Quizzes for ensuring learning Refresher trainings – Beware of Drift!!

Early Childhood Outcomes Center20 Promoting Quality Data Through data systems and verification, such as Data system error checks Good data entry procedures

Early Childhood Outcomes Center21 Many steps to ensuring quality data Before Good data collection/Training Good data system and data entry procedures During Ongoing supervision of implementation Feedback to implementers Refresher training After Review of COSF records Data analyses for validity checks

Early Childhood Outcomes Center22 Ongoing supervision Review of the process Is the process high quality? Are teams reaching the correct rating? Methods Observation Videos

Early Childhood Outcomes Center23 Quality Review of COSF Team Discussion 1. Do all team members participate in the discussion? 2. Is parent input considered in the rating? Give examples. 3. Is the team documenting the rating discussion? Give examples. 4. Does the team discuss multiple assessment sources? What are they?

Early Childhood Outcomes Center24 Quality Review of COSF Team Discussion 5. Does the team describe the childs functioning, rather than just test scores? Give examples. 6. Does the discussion include the childs full range of functioning, including skills and behaviors that are age appropriate, immediate foundational, and leading to immediate foundational? Give examples.

Early Childhood Outcomes Center25 Quality review through process checks Provider surveys Self assessment of competence Knowledge checks Process descriptions (who participates?) Identification of barriers Kansas survey Alaskas survey

Questions from Alaskas Survey 3. How would you rate your own level of proficiency with the COSF process? (please select only one) I am confident I know how to do it, and I do it well I know how to do it, but I need some more practice and assistance I understand it to a point, but I need more training I do not know how to do this yet 4. Some cases are different from others, but of the choices below, which process seems to be the most typical in your experience? (please select only one) I gather information and determine COSF ratings on my own I gather information and consult with another provider to determine COSF ratings I gather information and consult with the family to determine COSF ratings I gather information, discuss it with a team and the team determines the COSF ratings

Early Childhood Outcomes Center27 Ongoing Supervision Feedback to teams is critical Refresher training Beware of Auto pilot Drift

Early Childhood Outcomes Center28 Quality Review of COSF Team Discussion Activity Observe team video Evaluate quality

Early Childhood Outcomes Center29 Many steps to ensuring quality data Before Good data collection/Training Good data system and data entry procedures During Ongoing supervision of implementation Feedback to implementers Refresher training After Review of COSF records Data analyses for validity checks

Early Childhood Outcomes Center30 Quality Review of Completed COSFs Is the COSF complete? Is there adequate evidence for the basis for the rating? Does the evidence match the appropriate outcome area? Is the evidence based on functional behaviors?

Early Childhood Outcomes Center31 Quality Review of Completed COSFs Is there evidence that the childs functioning across settings and situations considered? Are the ratings consistent with the evidence?

Early Childhood Outcomes Center32 Quality Review of COSF Activity Review completed COSF with errors

Early Childhood Outcomes Center33 Promoting quality data through data analysis Examine the data for inconsistencies If/when you find something strange, look for other data that might help explain it. Is the variation caused by something other than bad data?

Early Childhood Outcomes Center34 The validity of your data is questionable if… The overall pattern in the data looks strange Compared to what you expect Compared to other data Compared to similar states/regions/school districts

Early Childhood Outcomes Center35 COSF Ratings - Fall RatingClass 1Class 2Class 3Class

Spring Fall total Review Total Outcome 3: Appropriate Action

Spring Fall total Review Total Outcome 3: Appropriate Action

Spring Fall total Review Total Outcome 3: Appropriate Action

Spring Fall total Review Total Outcome 3: Appropriate Action

Early Childhood Outcomes Center40 OSEP Categories Class 1 (%) Class 2 (%) Class 3 (%) e. Maintained Age Appro Trajectory d. Changed Traj – Age Appro c. Changed Traj – Closer to Age Appropriate b. Same Trajectory -Progress a. Flat Trajectory – No Prog. 261

Early Childhood Outcomes Center41 Questions to ask Do the data make sense? Am I surprised? Do I believe the data? Believe some of the data? All of the data? If the data are reasonable (or when they become reasonable), what might they tell us?

Early Childhood Outcomes Center42 Validity Validity refers to the use of the information Does evidence and theory support the interpretation of the data for the proposed use? Or Are you justified in reaching the inference you are reaching based on the data? Standards for Educational and Psychological Testing (1999) by American Educational Research Association, American Psychological Association, National Council on Measurement in Education

Early Childhood Outcomes Center43 The validity of your data is questionable if: ?

Early Childhood Outcomes Center44 ….not all providers are not knowledgeable about in the COSF process …not all providers are careful with the COSF process …the data look strange …etc.

Early Childhood Outcomes Center45 Many steps to ensuring quality data Before Good data collection/Training Good data system and data entry procedures During Ongoing supervision of implementation Feedback to implementers Refresher training After Review of COSF records Data analyses for validity checks