1. PVAAS School Consultation Guide Fall 2010 Session C: 9-12 High School – All Data Tools PVAAS Statewide Core Team pdepvaas@iu13.org

2. Agenda Purpose of the Consultation The Power of Two The Guide Book PA AYP Reports PSSA Data Interactive Reports – Getting Results Data Handbook PVAAS Reports Student Search and Projection Reports Next Steps Future Considerations Questions PVAAS 2010 Consultation Guide - Session C 9/15/2010

3. Purpose of Consultation Focus: Multiple Source Data Reports for Math and Reading in grade 11 including PAAYP, eMetric, and PVAAS. Options: –Divide the team with half focusing on math, half focusing on reading –Choose to focus on one subject during the session and complete other subjects at a later time. Intended to facilitate your inspection, analysis and interpretation of your 2010 data. To inform your investigation into root causes and assist in developing action plans to increase student achievement. PVAAS 2010 Consultation Guide - Session C 9/15/2010

4. The Power of Two! Considering Achievement and Growth TOGETHER!

5. The Scatter Plot Coordinate System Vertical Axis Mean Predicted Scaled Score Horizontal Axis Growth Measure in Standard Errors 2009 Mean Scaled Score Growth Descriptor Boundaries (±2SEs) PVAAS 2010 Consultation Guide - Session C 9/15/2010

6. Scatter Plot Regions and Their Meanings PVAAS 2010 Consultation Guide - Session C 9/15/2010

7. Statewide Scatter Plots Grade 11 PVAAS 2010 Consultation Guide - Session C 9/15/2010

8. Let’s Look At Your Scatterplots!

9. Instructions – See Guide Book Session focuses on Math and Reading, Grade 11 About your inspection, analysis and interpretation of YOUR data! Purpose is to use the data to explore root causes and move to action planning to enhance student achievement. PVAAS 2010 Consultation Guide - Session C Consultation Guide Pg. 1 9/15/2010

10. PA AYP Report http://paayp.emetric.net/ PVAAS 2010 Consultation Guide - Session C 9/15/2010

11. Report # 1 – PAAYP Data Table Guiding Statement: At least (63% Reading, 56% Math) of the students in the high school were Advanced or Proficient in the targeted subject area. The high school met the AYP target for participation in the targeted subject area for all relevant student groups. Investigate your PAAYP Data Table and answer the questions in your guidebook. PVAAS 2010 Consultation Guide - Session C C.G. Pg. 2 9/15/2010

12. Getting Results Data Packet PSSA Data Interactive – eMetric https://solutions1.emetric.net/pssa/ PVAAS 2010 Consultation Guide - Session C 9/15/2010

13. Report # 2 – Getting Results Data Packet Guiding Statement: All students and every subgroup in grade 11 met or exceeded the NCLB READING/MATH target (63% Reading, 56% Math) of Proficient or Advanced. Investigate your Most Recent PSSA Results Report for each grade level and subgroup and answer the questions in the guidebook. PVAAS 2010 Consultation Guide - Session C C.G. Pg. 3 9/15/2010

14. Report # 3 – Getting Results Data Packet Guiding Statement: The trend for the past 3 years for all students and all subgroups in grade 11 reflects an increase each year in the percent of students Proficient or Advanced in the targeted subject area.. Investigate your Multi-Year Report and answer the questions in your guidebook. PVAAS 2010 Consultation Guide - Session C C.G. Pg. 4 9/15/2010

15. Report # 4 – Getting Results Data Packet Guiding Statement: All students and all measurable subgroups are indicating consistently good (at least 60% correct) performance in each of the reporting categories in the targeted subject area. Investigate your Reporting Categories Report and answer the questions in your guidebook. PVAAS 2010 Consultation Guide - Session C C.G. Pg. 5 9/15/2010

16. PVAAS Reports https://pvaas.sas.com PVAAS 2010 Consultation Guide - Session C 9/15/2010

17. TWO Types of PVAAS Information Today Looking Back/Evaluation… Value-added Growth Reports For Cohorts of Students Looking Forward/Planning… PVAAS Projection Reports For Individual Students and Cohorts of Students PVAAS does NOT calculate growth of an individual student. PVAAS 2010 Consultation Guide - Session C 9/15/2010

18. Legend for Predictive Methodology Progress is defined by the district or school effect, which is a measure of the difference between observed performance and predicted performance. Progress is significantly above the progress of the average district in the state. Progress is not detectably different from the progress of the average district in the state. Progress is significantly below the progress of the average district in the state. PVAAS 2010 Consultation Guide - Session C 9/15/2010

19. Report # 5 – School Value-added Guiding Statement: Grade 11 met or exceeded the expected performance in Reading and Math. Investigate your School Value-added Report and answer the questions in your guidebook. PVAAS 2010 Consultation Guide - Session C C.G. Pg. 6 9/15/2010

20. Report # 6 – Performance Diagnostic Guiding Statement: Every predicted PSSA performance category in grade 11 met or exceeded the predicted performance in Reading/Math. Investigate your Performance Diagnostic Report for grade 11. Complete the table and answer the questions in your guidebook. PVAAS 2010 Consultation Guide - Session C C.G. Pg. 7 9/15/2010

21. Interpretation of the Performance Diagnostic Report 9/15/2010PVAAS 2010 Consultation Guide - Session C + ─ 0

22. Report # 6 – Performance Diagnostic Guiding Statement: Every predicted PSSA performance category in grade 11 met or exceeded the predicted performance in Reading/Math. Investigate your Performance Diagnostic Report for grade 11. Complete the table and answer the questions in your guidebook. PVAAS 2010 Consultation Guide - Session C C.G. Pg. 7 9/15/2010

23. Patterns of Growth B C A PVAAS 2010 Consultation Guide - Session C 9/15/2010

24. Report # 7 – Performance Diagnostic - Subgroups Guiding Statement: Every predicted PSSA performance category in grade 11 met or exceeded the predicted performance in Reading/Math. Investigate your Performance Diagnostic Reports by subgroup for grade 11. Complete the table and answer the questions in your guidebook. There are multiple reports available depending on the appropriate subgroups based on your student population. PVAAS 2010 Consultation Guide - Session C C.G. Pg. 8-10 9/15/2010

25. TWO Types of PVAAS Information Today Looking Back/Evaluation… Value-added Growth Reports For Cohorts of Students Looking Forward/Planning… PVAAS Projection Reports For Individual Students and Cohorts of Students PVAAS does NOT calculate growth of an individual student. PVAAS 2010 Consultation Guide - Session C 9/15/2010

26. Report # 8 – School (Single Grade) Projection Summary Report Guiding Statement: The percent of students in the 70% -100% probability range of reaching proficiency in the targeted subject area on the grade 11 PSSA is equal to or exceeds the AYP target for the appropriate year. Investigate your School (Single Grade) Projection Summary Report for grade 8 projected to grade 11, and answer the questions in your guidebook. PVAAS 2010 Consultation Guide - Session C C.G. Pg. 11 9/15/2010

27. Report # 9 – Projection Summary (Single Grade) - Subgroups Guiding Statement: The percent of students in the 70% -100% probability range of reaching proficiency in the targeted subject area on the grade 11 PSSA is equal to or exceeds the AYP target for the appropriate year. Investigate your School (Single Grade) Projection Summary Report for grade 8 projected to grade 11 for all subgroups, and answer the questions in your guidebook. There are multiple reports available depending on the appropriate subgroups based on your student population. PVAAS 2010 Consultation Guide - Session C C.G. Pg. 12-14 9/15/2010

28. See Data Tool Reference Guide Examples & Non-Examples of Effective Use of PVAAS Student Projection Reports! PVAAS 2010 Consultation Guide - Session C 9/15/2010

29. Student Search Capabilities and Projection Reports The Student Search capability allows you to search and investigate the probabilities of students reaching selected PSSA performance level ranges on future PSSA examinations. This feature also allows you to narrow or expand your search based on various student demographic criteria of interest. PVAAS 2010 Consultation Guide - Session C C.G. Pg. 15 9/15/2010

30. Student Search Report We recommend that you experiment with the different search options to focus on groups of students that are of interest to you. You may wish to reflect back on the reports and questions already addressed in this session to guide your search on groups of students you wish to investigate and discuss. PVAAS 2010 Consultation Guide - Session C C.G. Pg. 16 9/15/2010

31. See Data Tool Reference Guide District and building level faculty roll-out guides! PVAAS 2010 Consultation Guide - Session C 9/15/2010

32. Next Steps Discuss with your team the next steps in using these data to enhance educational programming for your students. Use the table in the guidebook to document your ideas for further actions. Actions:Involving Who? Other Data to Consider? Timeline Examples:  Share results with staff o Plan for sharing  Reconvene this team and go deeper  Discuss our results with SIP team  John/Sally o Full team  Full team  Fred /Spot eMetric eMetric, 4sight local assessment  1 month o Next Tuesday at 2PM  Next Friday at midnight  Next SIP team meeting PVAAS 2010 Consultation Guide - Session C C.G. Pg. 17 9/15/2010

33. Considerations for the Future Discuss with your team what types of support you might find useful from your IU PVAAS contact(s), as well as any other resources or materials needed from the PDE PVAAS Statewide Team. When you are ready to discuss PVAAS with your faculty, you might want to consult the Faculty Roll-out Guide in the Data Tool Reference Guide. Detach and return page 19 of the Consultation Guide to your session facilitator. PVAAS 2010 Consultation Guide - Session C 9/15/2010

34. Questions: PVAAS Materials or Statewide Implementation pdepvaas@iu13.org 717-606-1911 PVAAS Report Web Site https://pvaas.sas.com 9/15/2010PVAAS 2010 Consultation Guide - Session C

35. Thomas Gluck Acting Secretary of Education Commonwealth of Pennsylvania www.pde.state.pa.us 333 Market Street Harrisburg, PA 17126 9/15/2010PVAAS 2010 Consultation Guide - Session C