1. A New Adventure Begins for Program Quality! PROGRAM QUALITY ASSESSMENTS Presented by: Anne Reeder, Program Quality Assessment Coordinator DESE Grantee Workshop September 19, 2013

2. TODAY WE WILL COVER… What are the PQAs? Why are we doing the PQAs? How will this actually work? (Who, when, where…)

3. WHAT ARE THE PQAS? Weikart Center for Youth Program Quality School Age Program Quality Assessment (SAPQA) Youth Program Quality Assessment (YPQA) STEM Add-On to YPQA

4. WHAT ARE THE PQAS? A validated instrument designed to assess the quality of youth programs and identify staff training needs, A set of items that measures youth access to key development experiences, A tool which produces scores that can be used for comparison and assessment of progress over time.

5. SELECTION OF THE PQA State-of-the-art instrument Good evidence for reliability and validity Measures what we know is our unique contribution to youth success Many other states are also using the PQAs Ability to compare to other programs Ready-made package of support

6. WHY ARE WE ADDING THE PQAS? 21 st CCLC funding is a hot topic of discussion in DC DESE needs consistent data to support Missouri’s use of funds Current program evaluations do not provide a comprehensive, across-the-board picture Several other states have adopted the PQAs for consistent measures

7. l National Organizations: Light Green- full-state implementation Dark Green- place-based implementation Gold- full-state + place-based YPQI Quality Improvement Systems PQA Downloads: 533 Youth PQA 457 School-Age PQA Individual Box Sets= 20 sites

8. WEIKART CENTER REACH IN 2012-2013 Point of Service Setting Organization Setting Policy Setting >21,125 Staff Estimate based on mean of 6.5 staff per site in YPQI Study Sample 85 Networks/Systems >276,250 Child & Youth Estimate based on mean daily attendance of 85 youth per day in YPQI Study Sample >3250 Sites

9. 21 ST CENTURY COMMUNITY LEARNING CENTERS Aqua – Statewide quality improvement system Blue - City or School District quality improvement system Yellow - Youth PQA used as part of statewide evaluation Purple - Statewide quality improvement system and statewide evaluation

10. PQA CONTENT

11. WHAT WILL THE DATA BE USED FOR? Another point of data for your program’s External Evaluation A point of data for you and your coach (ARE) to include in your Action Plans By using a consistent valid tool, DESE will have better data to submit to the USDE. Better Data = More Money for programs

12. PQA

13. PROCESS Who are the assessors? 4-H Youth Development Specialists or MU HDFS Specialists Intense multi-day inter-rater reliability training Scheduling Anne Reeder will handle all aspects of scheduling You will need to provide in advance a copy of the site’s schedule for the day of the observation Observation No surprises No more than 3 hours Scores Reporter

14. SAMPLE PQA REPORT

15. PQA SUMMARY REPORT

16. PAQ SUMMARY REPORT

17. PQA SUMMARY REPORT The online Reporter has determined the following suggestions for professional development based on the three lowest scoring items in this report. The Scores Reporter makes suggestions automatically and based solely on scores. These suggestions are not meant to replace the thoughtful conversations of staff members during an improvement planning process, but are provided for consideration and to enhance discussion. Building Community Creating a safe space in which you feel a sense of belonging is beneficial for their growth and learning (National Research Council and the Institute of Medicine, 2002). When youth get to know each other, don’t leave other youth out, think of the program as theirs, and get recognized for their accomplishments, they build relationships with peers and adults. (National Research council and the Institute of Medicine (2002). Community Programs to Promote Youth Development Washington, DC; National Academy Press. 96-99) Reframing Conflict An approach in which adults support youth in addressing their conflicts and problems helps build a healthy, cohesive group and can produce growth and learning for young people. The HighScope youth-centered approach involves a nonthreatening matter-of-fact attitude and helps youth have a voice in determining both the cause and the solution to the conflict. It is a problem- solving approach that seeks to turn conflicts into learning opportunities.

18. PQA SAMPLE REPORT Structure and Clear Limits Structure and clear limits can provide a strong foundation to a youth program. An appropriate structure with routines, activities, and rituals sets the stage. Clear limits establish what’s okay and not okay and can ensure a safe program climate. When done well, structure and clear limits can provide the space kids need to explore and express themselves, a feeling of fairness, and the predictability that young people learn to count on to meet their needs (National Research Council and Institute of Medicine, 2002). (National Research Council and the Institute of Medicine. (2002). Community Programs to Promote Youth Development. Washington, DC: National Academy Press. 91-94) Youth Voice Providing young people with chances to make decisions about their activities and how they carry them out can improve motivation and buy-in, and more importantly, offering choices in the solace of a youth program space gives youth a chance to practice for the bigger choices they’ll make outside of the program.

19. COACHING - METHODS TRAININGS Questions Thank you and enjoy the rest of your conference!