1. Understanding Your LI Reports October 16, 2015 October 2015 Copyright © 2015 American Institutes for Research. All rights reserved. Samantha Sniegowski Researcher AIR

2.  To familiarize you with Leading Indicator report  To answer questions  To prepare you for the Advanced Planning with Data trainings October 26 – Webinar training for Cohorts 9 & 10 October 29 – Live training for Cohort 11 Goals for the Webinar 2

3.  Part of overall evaluation of 21 st CCLC in WA  Intended to support continuous improvement  Not intended to support compliance monitoring  Summarizes performance on best practices  Allows programs to compare performance to state  Promotes discussion Overview of LI Reports 3

4.  Information submitted by you into PPICS  Site coordinator survey  Staff survey  PQA Form A and B data  Youth survey data  Program attendance data  OSPI data warehouse (not yet available) **All data is from previous school year Where Do the Data Come From? 4

5.  User interface Project director and local evaluators have access – Site coordinator access Can view summary or full report or both  5 major sections Center Profile Organizational Practices Instructional Practices Partnerships Practices Youth Outcomes Understanding your report 5

6. User interface 6

7. 7

8. 8

9. 9

10. 10 Select project/grant Select centerSelect report typeSelect domainsHit submit to generate report

11.  Basic characteristics  Recruitment  Attendance  Activity provision  Number of partners  Site Coordinator characteristics  Staff characteristics Center Profile 11

12. Center Profile 12

13.  1.1 – Continuous Improvement 1.1.1 Program Climate 1.1.2 Internal Communication, Staff Survey 1.1.3 Internal Communication, Site Coordinator Survey  1.2 – Leadership and Management 1.2.1 Leadership and management (Form B PQA) Organizational Practices 13

14.  2.1 – Instructional Quality (Content) 2.1.1 Intentionality in Program Design, Site Coordinator Survey 2.1.2 Intentionality in Program Design, Staff Survey  2.2 – Instructional Quality (Process) 2.2.1 Point of Service Quality (PQA Form A) 2.2.2 Youth Centered Policies and Practices (PQA Form B) Instructional Practices 14

15.  3.1 – Family Engagement 3.1.1 Family Communication  3.2 – School Context 3.2.1 Data Use, Staff Survey 3.2.2 Data Use, Site Coordinator Survey 3.2.3 Linkages to the School Day, Staff Survey 3.2.4 Linkages to the School Day, Site Coordinator Survey  3.3 – Community Context 3.3.1 Family and Community – Form B PQA Partnership Practices 15

16. Sample Indicator 16 Indicator Name Explanation of indicator Scale score for state and center for all sub indicators Click for more info. No data indicates survey not completed

17. Sample Indicator 17 Summary of all items by response category Item by item responses

18. Sample Indicator 18 Celebrate Strengths Identify areas for improvement

19. PQA Form A Data 19 Two types of data

20.  4.1 – Youth Program Experiences Skills and Beliefs  4.2 – Reading and Mathematics Performance (Grades 4–8)  4.3 – School Day Attendance (Grades 6–12)  4.4 – School Day Disciplinary Incidents (Grades 1–12)  4.5 – Percentage of Credits Earned (Grades 10–12) Youth Outcomes 20

21. Youth Outcomes 21 4.1 – Youth Program Experiences Skills and Beliefs

22.  Examine graphs and tables to understand overall report and what it includes  Compare how your center is doing relative to the state average.  Celebrate your strengths!  What can you work on?  Identify two areas for improvement in preparation for Advanced Planning with Data workshop. How to Review Report 22

23. Questions? Email questions to: WA21stCCLC@air.orgWA21stCCLC@air.org or Samantha Sniegowski ssniegowski@air.org 312-690-7371 23