Linking Early Intervention Quality Practices With Child and Family Outcomes Sherry Franklin, North Carolina Part C Coordinator Deborah Carroll, PhD, Branch Head May 15, 2012

NC Part C Context  State Lead Agency  17 Local Lead Agencies  13 State Employees  4 Contract Agencies  Community Early Intervention Service Providers

Results Component  Continuous Improvement Visit- November 14-18, 2011  Verification  Results Component  May – June: Results Focus Selection  Family Outcomes  Birth to 1 Child Find

Orienting Programs/Providers to Key Practices that Support Child and Family Outcomes  State Interagency Coordinating Council formed a task group to assist in Results Component Selection  Reviewed Family Outcomes Survey and Process  So What?  Reviewed “Relationship of Quality Practices to Child and Family Outcome Measurement Results”

Orienting Programs/Providers to Key Practices that Support Child and Family Outcomes Families and Stakeholders were able to:  Share their experiences with expected practices  Define common strengths and challenges  Come to consensus on the importance of the skills/training of Early Intervention Service Coordinators

Conducting Self-Assessment of State or Local Performance on Practices FOCUS MONITORING- PROCEDURAL SAFEGUARDS  U SE OF THE T OOL TO T RAIN M ONITORS ON THE P RACTICES T HAT H AVE A D IRECT I MPACT ON “K NOW Y OUR R IGHTS ”  E MBED Q UESTIONS R ELATED TO P RACTICES IN I NTERVIEW T OOLS

NOW WHAT? HOW TO GET STARTED HOW TO IMPLEMENT A STATEWIDE CHANGE IN PRACTICE HOW TO ACHIEVE DESIRED OUTCOME

Data Accountability Center (DAC)

Bottom Line  State-Local Partnership  State Implementation Team  Local Implementation Team  Quality Data  Specific Problem/Issue  Data-based Decisions

Concord Durham Greensboro Rocky Mount Our Partnership Morganton Shelby

Implementation Team  Represents community members and systems stakeholders  Advises and assists systems change  Develops & implements clear plans with assignments of tasks/timelines  Keeps implementation process focused  Solves problems that arise during the process. Fixen, D.L., Naoom, S.F., Blasé, K.A., Freedman, R.M., & Wallace, F. (2005). Implementation Research; A Synthesis of the Literature. Tampa, Florida: University of South Florida, National Implementation Research Network

Local Implementation Team MUST INVOLVE A TEAM  Program Director or designee  Data Person/Quality Assurance staff  Providers/staff involved in issue topic  Parent  Others as needed * Must be a person with influence/authority

State Implementation Team MUST INVOLVE A TEAM  Administrators  Data Person  ICC member  Parent  Others as needed * Must be a person with influence/authority

DAC Framework for Data Use Consists of three phases w/ several steps: Preparation Phase 1. Identify relevant data Inquiry Phase 1.Conduct data analysis 2.Determine Root Cause Action Phase 1.Plan for improvement 2.Implement Plan 3.Evaluate progress

Proactive Versus Reactive Both are Positive A process to review existing data to select priorities for program improvement. A process to determine program compliance and effectiveness. Proactive A process used to respond to a state identified problem. A process used to respond to a locally identified problem. Reactive

DATA QUALITY STANDARDS How do you know whether the data collected/used is of high quality?

Data Quality Standards Timely Accurate  Reliable  Consistent  Objective  Valid  Complete  Credible Secure Useful  Interpretable  Relevant  Transparent  Accessible Data collected, submitted, analyzed, and reported must be:

Initial Questions (Using Available Data) 1.What do you notice? What are the patterns? Trends? 2.What kinds of questions do you have as you look at the available data? 3.What other data might you want to explore to dig into these questions? 4.What is the storyline? 5.What are these data telling you? 6.What do you want to know?

Drill down involves accessing information by starting with a general category and moving through the hierarchy of field to file to record; it is the act of focusing in to get to the root cause. Source: Adapted from Webopedia

A hypothesis is defined as “…a starting-point for further investigation from known facts”. The Concise Oxford Dictionary, 1990)

Why is a Hypothesis Important? A good hypothesis will help you: 1. Focus your investigation 2. Keep you from “losing the forest for the trees” 3. Ensure that you stay on course in your investigation

Data Analysis Plan The analysis plan provides an outline of additional data that need to be analyzed to test the hypothesis and determine root cause ; it helps with preparing a clear and concise presentation of the results of your analysis activities

Root Cause Determining the root cause enables the creation of effective actions to prevent the problem from re- occurring

DATA BASED DECISION MAKING  Data should be used to drive:  Root Cause Analysis leading to a hypothesis(es)  Improvement Planning  Evaluation (effectiveness )

NEXT STEPS Implementation of Pilot experience Use Information for Improvement and Statewide Implementation Strategies

Questions/Comments