1. Joint Infant and Toddler Steering Committee/Early Learning Regional Coalition Statewide Meeting “Using our Data for Continuous Improvement” Organizational Research Services May 15, 2013

2. Designing and Test Driving the Infant and Toddler Child Care Initiative: aka a Strategic Learning Evaluation Kids' Potential, Our Purpose

3. The Drawing Board: Why I/T CCC?

4. WAKidsLove.Talk.Play

5. Kids' Potential, Our Purpose Infant Toddler Highway

6. Kids' Potential, Our Purpose Design Features of the I/T CCC Car Regional variations The Motor: the Essentials  Interdisciplinary approach with focus on attachment  One-on-one consultation with child care providers serving children in vulnerable situations Data-informed design:  I/T Steering Committees conducted needs assessment to develop Regional Service Models

7. Check Points for Strategic Learning: Data collected so far Kids' Potential, Our Purpose Check Conditions of the Road Check Under the Hood Report the Test Drive Results Check the Mileage of the Car

8. Check the Mileage of the Car: Report Distance Traveled Data Collected: Output data submitted by each region every 4 months in a periodic report on implementation of their model Data Collected: Output data submitted by each region every 4 months in a periodic report on implementation of their model Kids' Potential, Our Purpose Check the Mileage of the Car

9. Exploration & Adaptation Regional Strategies/RSM Exploration & Adaptation Regional Strategies/RSM Program Installation Building infrastructure for implementation Program Installation Building infrastructure for implementation Initial Implementation Recruiting providers, beginning consultation services Initial Implementation Recruiting providers, beginning consultation services Full Operation Delivering consultation at nearly full capacity Full Operation Delivering consultation at nearly full capacity Innovation Revise Regional Service Models based on year one evaluation/ reflection Innovation Revise Regional Service Models based on year one evaluation/ reflection Sustainability Formalize core model strategies and contracting process Sustainability Formalize core model strategies and contracting process C1 C2 C3 C2 C3 Progress of Implementation through Periodic Reports Year 1 of I/T CCC Consultation Regions position during Periodic Report 1 (Prior to Dec. 31, 2011) Regions position during Periodic Report 3 (Apr. 1 2012 to June 30, 2012) 201120122013 Regions position during Periodic Report 2 (Jan. 1 2012 to March 31, 2012) C1 C2 C3 What We Learned Kids' Potential, Our Purpose

10. Aspects of Regional Variability  How licensed care providers were recruited  Types of providers  Consultant pool  Type of assessment done in the classroom  Focus of individual consultation  Dosage of consultation  Timelines for each region The need for shared vocabulary to tell a statewide story  Clarity around children served  Clearer definitions of providers  Clearer definition of consultation hours  More explanation on consultation goals Kids' Potential, Our Purpose What We Learned

11. Check Conditions of the Road: Assess Infrastructure Data Collected: Findings from 20 key informant interviews with Regional Leads and Steering Committee members on influential systems level factors Data Collected: Findings from 20 key informant interviews with Regional Leads and Steering Committee members on influential systems level factors Kids' Potential, Our Purpose Check Conditions of the Road

12. Supports to implementation  Broad and regionally representative steering committees built trust with providers  A history of regional relationships enhanced provider and consultant recruitment  Developing a communication system facilitated interdisciplinary consultation  Implementing the RSM unified the steering committee Challenges to implementation  Some regional geography made it challenging to recruit consultants and providers serving children in vulnerable situations Kids' Potential, Our Purpose What We Learned

13. Check Under the Hood: Look More Deeply at Moving Parts Data Collected: Survey responses from 157 providers to better understand who and how Data Collected: Survey responses from 157 providers to better understand who and how Kids' Potential, Our Purpose Check Under the Hood

14. Regions were reaching kids in vulnerable situations Percent of children living below 200% of the FPL level study sample compared to Washington State and U.S. What We Learned: Reach of I/T CCC Regions were reaching ethnically diverse populations 39% 44% 43% I/T CCCWA StateNational I/T CCC WA State National

15. In spite of regional differences there were shared Core Implementation components:  Consultant meets with a child care provider and they discuss potential needs  Consultant uses some form of assessment tool to determine needs more formally  Consultants and provider jointly set goals  Consultation typically is hands on in the classroom with opportunities for one-on-one debriefing and answering questions Kids' Potential, Our Purpose What We Learned

16. Report the Test Drive Results: Sharing Outcomes and Findings Data Collected: Evidence of changes in teachers, consultants, directors and learning environment from over 150 provider and consultant interviews and 9 classroom observations Data Collected: Evidence of changes in teachers, consultants, directors and learning environment from over 150 provider and consultant interviews and 9 classroom observations Kids' Potential, Our Purpose Report the Test Drive Results

17. Key Outcomes:  Providers are hungry for enhancing their skills  Providers can demonstrate new skills and attitudes toward sensitive care giving  Changing the physical environment is an important step toward promoting sensitive caregiving and healthy attachment  A trusting relationship between the consultant and provider is essential and takes time  Consultation dosage matters: more than 5 sessions leads to greater increase in knowledge and skills Kids' Potential, Our Purpose What We Learned

18. A Detailed Look: Providers increase knowledge and skills

19. Teachers/caregivers  88% were very satisfied with overall consultation experience  83% were very satisfied with their relationship with primary consultant  83% would participate in more consultation if offered  67% were very satisfied with hours of consultation received Child Care Center Directors  82% were very satisfied with overall consultation experience  94% were very satisfied with their relationship with primary consultant  92% would participate in more consultation if offered  76% were very satisfied with hours of consultation received 19 More Details: High Level of Satisfaction

20. Kids' Potential, Our Purpose Reflecting on the Test Drive Recommendations for Using a Strategic Learning Approach for Other Test Drives  Have a firm understanding of the WHAT and HOW (process)  Be adaptable- don’t be afraid to make changes to data collection process in the initial stages  Triangulate data- gather data from lots of perspectives  Match data collection and analysis to the stage of the implementation- don’t try to reach conclusions too early or demonstrate impact before it can be done Incorporating Learnings from Our Test Drive We plan to:  Revise Regional Service Model  Begin formalizing model by adopting components of success across all regions  Adapt and improve data collection tools*  Strengthen capacity in the regions for self-evaluation  Explore using standardized assessment tools to track teacher/caregiver outcomes Exploration & Adaptation Regional Strategies/RSM Exploration & Adaptation Regional Strategies/RSM Program Installation Building infrastructure for implementation Program Installation Building infrastructure for implementation Initial Implementation Recruiting providers, beginning consultation services Initial Implementation Recruiting providers, beginning consultation services Full Operation Delivering consultation at nearly full capacity Full Operation Delivering consultation at nearly full capacity Innovation Revise Regional Service Models based on year one evaluation/ reflection Innovation Revise Regional Service Models based on year one evaluation/ reflection Sustainability Formalize core model strategies and contracting process Sustainability Formalize core model strategies and contracting process C1 C2 C3 C2 C3 Progress of Implementation through Periodic Reports Year 1 of I/T CCC Consultation Regions position during Periodic Report 1 (Prior to Dec. 31, 2011) Regions position during Periodic Report 3 (Apr. 1 2012 to June 30, 2012) 201120122013 Regions position during Periodic Report 2 (Jan. 1 2012 to March 31, 2012) C1 C2 C3

21. Paula Rowland, PhD prowland@organizationalresearch.com, ext. 228 Cameron Clark, MPA/MAIS cclark@organizationalresearch.com, ext. 223 Organizational Research Services www.organizationalresearch.com 206-728-0474 Contact Information

22. www.del.wa.gov www.twitter.com/DEL_wa