1. Copyright © 2011 American Institutes for Research All rights reserved. Oregon 21st CCLC Leading Indicators Breakout Session Neil Naftzger and Deborah Moroney October 21, 2011

2. 2 Agenda Review purposes and goals of the Leading Indicator system Grantee review and feedback on the Leading Indicators Outline next steps

3. 3 The Fine Print Primary purpose of the leading indicator system is to support program improvement The leading indicators are not meant to be an accountability system Leading indicators are aligned with ODE-defined goals for the 21st CCLC program Predicated on (a) research-supported best practices and (b) practices that are theoretically linked to the achievement of desired outcomes Leading indicator data needs to be used in a fashion at the grantee and center level which considers local context The primary data source used to support the Leading Indicators is the Site Coordinator survey

4. 4 Key Questions How do we know if the indicators accurately describe the quality of your program? ? Is this Indicator understandable and interpretable? ? Does this Indicator convey meaningful information? ? Will this Indicator support discussions and conversations with 21st CCLC staff?

5. 5 What We Know About Program Quality Collaboration & Partnerships (inputs) + Quality Staff w/ Diverse Skills (inputs) + Intentional Programming (activities) + Attendance & Engagement (outputs) = Positive Youth Outcomes

6. 6 Collaboration (Inputs) LI: Partner engagement – Partners associated with the center are actively involved in planning, decision making, evaluating, and supporting the operations of the afterschool program. LI: Staff at the center will be engaged in intentional efforts to collaborate and communicate frequently about ways to improve program quality. LI: Steps are taken by the center to establish linkages to the school day and use data on student academic achievement to inform programming

7. 7 Great Staff (Inputs) LI: Staff at the center are provided with training and/or professional development. LI: Staff at the center complete one or more self- assessment during the programming period. LI: Staff at the center are periodically evaluated/assessed during the program period.

8. 8 Intentional Activities +Students+ LI: There is evidence of alignment between (a) program objectives relative to supporting youth development, (b) student needs, and (c) program philosophy/model AND frequency/extent to which key opportunities and supports are provided to youth. LI: There is evidence of alignment between(a) program objectives relative to the academic development of students, (b) student needs, and (c) program philosophy/model AND activities being provided at the center. LI: Intentionality in activity and session design among staff responsible for the delivery of activities meant to support student growth and development in mathematics and reading/language arts.

9. 9 Intentional Activities +Families+ LI: Steps are taken by the center to reach out and communicate with parents and adult family members of participating students. LI: There is evidence of alignment between (a) program objectives relative to supporting family literacy and related development, (b) family needs, and(c) program philosophy/ model AND activities being provided at the center.

10. 10 Outputs & Outcomes Outputs Attendance Program Hours Program Offerings Outcomes Academic Success Social and Emotional Development

11. 11 Key Questions How do we know if the indicators accurately describe the quality of your program? + Is this Indicator understandable and interpretable? + Does this Indicator convey meaningful information? + Will this Indicator support discussions and conversations with 21st CCLC staff?

12. 12 Impact The data we collect from the Leading Indicators and PPICS study ideally supports conversations and implementation of quality programs locally and also helps us as a field understand Out-of-School Time program IMPACT

13. 13 Dates to Remember TaskStart DateEnd Date PPICS Related Activities APR DataOpen11/15/2011 Student ID Data10/18/201112/15/2011 Site Coordinator Survey 11/21/201112/15/2011 Site Visits 2/15/20123/15/2012

14. 14 Contact Neil Naftzger Principal Researcher P: 640-649-6616 E-Mail: nnaftzger@air.org Deborah Moroney Senior Researcher P: 312-288-7609 E-Mail: dmoroney@air.org