1. Out of School Time Part III: Quality Connections to Quality Rating & Improvement Systems (QRIS) and School Age Settings Jennifer Harris, Arkansas State University Joe Bertoletti, Weikart Center Tammie Cloyes, Arkansas Department of Education Tonya Russell, Arkansas Division of Child Care and Early Childhood Education April 19, 2012 #readyby21

2. Agenda Welcome and Introductions QIS and QRIS – Similarities and Differences Challenges and Opportunities Arkansas Panel Discussion Discussion

3. Theory of Change: Multiple Levels of Settings Point of Service Setting Organizational Setting Policy Setting Continuous Improvement Practices for Site Teams Quality Instruction & Proximal Child Outcomes Low Stakes Accountability and Supports

4. Essential Elements: QIS and QRIS Systems…. Yohalem., N., Devaney, E., Wilson-Ahlstrom A., & Smith, C. (forthcoming). A Guide to Building Quality Improvement Systems in Out-of-School Time. Washington, DC: Forum for Youth Investment. QIS Systems (Wallace) Guidelines & incentives for participation Shared definition of quality Site Level Continuous improvement process Lead organization Information system(s) QRIS (Child Trends) Quality Standards Process for Monitoring standards Support for Quality Improvement Provisions of financial Incentives Dissemination of Program Quality info

5. OPPORTUNITIES & CHALLENGES SMALL GROUP ACTIVITY

6. Factors that may limit effectiveness of current QRIS models: (a) small differences in structure and design (e.g., using different monitoring measures) make cross- site and network comparisons difficult; (b) coordination of improvement supports/momentum is blocked by lack of coordination across agencies, services, and data systems; and (c) policies lack clarity about goals, timeframe, and expectations for actual improvement. Note: Points A, B, C from Tout, Zaslow, Halle, & Forry (2009) Lack of resources for improvement We have questions about publicity of data

8. Defining Quality Qualistar (Rand, 2008) – Classroom environment – Child-staff ratio – Staff-director training & education – Parent involvement – Accreditation YPQI – Classroom environment (SA & Youth PQA, Form A) – Leading Indicator Domains External Relationships Organizational Setting Instructional Setting Child Outcomes Parent Satisfaction

9. Coaching QRIS 1 Coaching is adapted based on needs of program and strengths of coach Lower scoring, higher needs programs receive more coaching Sites show a cyclical pattern Coaching intended to: – Prepare providers for rating – Facilitate rating process – Improve the rating – Improve understanding of the ERS Coaches and Practitioners collaboratively develop a quality improvement plan/ action plan YPQI/TACSS Coaching Coaching is relationship based, and therefore adaptable. Programs have both shown promise and exhibited challenges. Programs show a cyclical pattern. Coaching intended to : – Enhance the effectiveness of leaders to develop a culture of continuous quality improvement – Target managers, with a cascade of effects on instructional staff, and youth. – Increase fidelity of implementation of the YPQI Coaches and Practitioners collaboratively develop plan. 1 From Child Trends Feb 2011 Research Brief: Coaching for Quality Improvement: Lessons Learned from Quality Rating and Improvement System

10. Arkansas By the Numbers

11. Understanding the Arkansas “Quality” Landscape QRIS – Better Beginnings (BB) Arkansas 21CCLC Programs Arkansas Out of School Network Programs targetedLicensed programs * participating in BB (statewide) All 21CCLC sites approximately 100 sites (statewide) Programs not licensed - mostly community and faith- based – (statewide) Level of stakes Medium Assessment scores are one component of BB and sites are eligible for enhancement grants upon completion of level requirements – BB is voluntary Low Programs are required to participate but scores not tied to funding. Data used to provide tailored technical assistance and guide future PD Low Data collected will be used to provide tailored technical assistance – Strong interest in working with intermediaries that support OST programs TA & Training Support provided Free technical assistance is built into systems of quality supported by both the Division of Child Care and Early Education (DCCECE) and the Arkansas Department of Education (ADE) and provided by Arkansas State University Childhood Services. Core trainings are provided throughout the state and will be open to any OST program interested in the YPQI regardless of funding stream. External Assessors, coached, consultants, etc. that support programs are funded and shared collectively by DCCECE and ADE funds. Staff support provided by ASU Childhood Services. 2011/2012 school year time frame Programs can choose at any time to get involved in the YPQI once interest is expressed YPQI intervention will follow-school year calendar – August 2011- July 2012 Programs can choose at any time to get involved in the YPQI once interest is expressed * Separate stand alone OST program licensing regulations are being developed. Separate regulations are being created in order to be more inclusive of the differing needs of OST programs (including middle and high school) in comparison to what is in place currently which is suited for traditional school-age child care programs.

12. Highlighted Features of School Age Programs Participating in Better Beginnings Must be a licensed program to participate – New regulations provide an expansion of applicability beyond “traditional care model” programs to better accommodate programs serving older youth, 21CCLC programs, community based programs, etc. Program has choice of assessment instrument – YPQA, SAPQA, or SACERS (School Age Child Care Environmental Rating Scale) Programs can enter Better Beginnings at any time and system must be responsive to program needs when presented

13. Better Beginnings Features Supported by YPQI Elements Training Requirements/Opportunities – Introduction to the YPQI (opportunity) – YPQA Basics (requirement) – Planning with Data (opportunity) ** – Quality Coaching (opportunity)** – Youth Methods (opportunity) Self – Assessment (requirement) External Assessment (requirement) Technical Assistance (opportunity) Coaching (opportunity) – Limited regional coaching personnel available starting in FY 2013 ** Helps to meet “Programming Planning/Management” training requirements outlined at all 3 levels

14. Opportunities and Challenges Arkansas Panel Reflection

15. Questions? Questions are guaranteed in life. Answers are not.