PVAAS School Consultation Guide Fall 2010 Session C: 9-12 High School – All Data Tools PVAAS Statewide Core Team

Agenda Purpose of the Consultation The Power of Two The Guide Book PA AYP Reports PSSA Data Interactive Reports – Getting Results Data Handbook PVAAS Reports Student Search and Projection Reports Next Steps Future Considerations Questions PVAAS 2010 Consultation Guide - Session C 9/15/2010

Purpose of Consultation Focus: Multiple Source Data Reports for Math and Reading in grade 11 including PAAYP, eMetric, and PVAAS. Options: –Divide the team with half focusing on math, half focusing on reading –Choose to focus on one subject during the session and complete other subjects at a later time. Intended to facilitate your inspection, analysis and interpretation of your 2010 data. To inform your investigation into root causes and assist in developing action plans to increase student achievement. PVAAS 2010 Consultation Guide - Session C 9/15/2010

The Power of Two! Considering Achievement and Growth TOGETHER!

The Scatter Plot Coordinate System Vertical Axis Mean Predicted Scaled Score Horizontal Axis Growth Measure in Standard Errors 2009 Mean Scaled Score Growth Descriptor Boundaries (±2SEs) PVAAS 2010 Consultation Guide - Session C 9/15/2010

Scatter Plot Regions and Their Meanings PVAAS 2010 Consultation Guide - Session C 9/15/2010

Statewide Scatter Plots Grade 11 PVAAS 2010 Consultation Guide - Session C 9/15/2010

Let’s Look At Your Scatterplots!

Instructions – See Guide Book Session focuses on Math and Reading, Grade 11 About your inspection, analysis and interpretation of YOUR data! Purpose is to use the data to explore root causes and move to action planning to enhance student achievement. PVAAS 2010 Consultation Guide - Session C Consultation Guide Pg. 1 9/15/2010

PA AYP Report PVAAS 2010 Consultation Guide - Session C 9/15/2010

Report # 1 – PAAYP Data Table Guiding Statement: At least (63% Reading, 56% Math) of the students in the high school were Advanced or Proficient in the targeted subject area. The high school met the AYP target for participation in the targeted subject area for all relevant student groups. Investigate your PAAYP Data Table and answer the questions in your guidebook. PVAAS 2010 Consultation Guide - Session C C.G. Pg. 2 9/15/2010

Getting Results Data Packet PSSA Data Interactive – eMetric PVAAS 2010 Consultation Guide - Session C 9/15/2010

Report # 2 – Getting Results Data Packet Guiding Statement: All students and every subgroup in grade 11 met or exceeded the NCLB READING/MATH target (63% Reading, 56% Math) of Proficient or Advanced. Investigate your Most Recent PSSA Results Report for each grade level and subgroup and answer the questions in the guidebook. PVAAS 2010 Consultation Guide - Session C C.G. Pg. 3 9/15/2010

Report # 3 – Getting Results Data Packet Guiding Statement: The trend for the past 3 years for all students and all subgroups in grade 11 reflects an increase each year in the percent of students Proficient or Advanced in the targeted subject area.. Investigate your Multi-Year Report and answer the questions in your guidebook. PVAAS 2010 Consultation Guide - Session C C.G. Pg. 4 9/15/2010

Report # 4 – Getting Results Data Packet Guiding Statement: All students and all measurable subgroups are indicating consistently good (at least 60% correct) performance in each of the reporting categories in the targeted subject area. Investigate your Reporting Categories Report and answer the questions in your guidebook. PVAAS 2010 Consultation Guide - Session C C.G. Pg. 5 9/15/2010

PVAAS Reports PVAAS 2010 Consultation Guide - Session C 9/15/2010

TWO Types of PVAAS Information Today Looking Back/Evaluation… Value-added Growth Reports For Cohorts of Students Looking Forward/Planning… PVAAS Projection Reports For Individual Students and Cohorts of Students PVAAS does NOT calculate growth of an individual student. PVAAS 2010 Consultation Guide - Session C 9/15/2010

Legend for Predictive Methodology Progress is defined by the district or school effect, which is a measure of the difference between observed performance and predicted performance. Progress is significantly above the progress of the average district in the state. Progress is not detectably different from the progress of the average district in the state. Progress is significantly below the progress of the average district in the state. PVAAS 2010 Consultation Guide - Session C 9/15/2010

Report # 5 – School Value-added Guiding Statement: Grade 11 met or exceeded the expected performance in Reading and Math. Investigate your School Value-added Report and answer the questions in your guidebook. PVAAS 2010 Consultation Guide - Session C C.G. Pg. 6 9/15/2010

Report # 6 – Performance Diagnostic Guiding Statement: Every predicted PSSA performance category in grade 11 met or exceeded the predicted performance in Reading/Math. Investigate your Performance Diagnostic Report for grade 11. Complete the table and answer the questions in your guidebook. PVAAS 2010 Consultation Guide - Session C C.G. Pg. 7 9/15/2010

Interpretation of the Performance Diagnostic Report 9/15/2010PVAAS 2010 Consultation Guide - Session C + ─ 0

Report # 6 – Performance Diagnostic Guiding Statement: Every predicted PSSA performance category in grade 11 met or exceeded the predicted performance in Reading/Math. Investigate your Performance Diagnostic Report for grade 11. Complete the table and answer the questions in your guidebook. PVAAS 2010 Consultation Guide - Session C C.G. Pg. 7 9/15/2010

Patterns of Growth B C A PVAAS 2010 Consultation Guide - Session C 9/15/2010

Report # 7 – Performance Diagnostic - Subgroups Guiding Statement: Every predicted PSSA performance category in grade 11 met or exceeded the predicted performance in Reading/Math. Investigate your Performance Diagnostic Reports by subgroup for grade 11. Complete the table and answer the questions in your guidebook. There are multiple reports available depending on the appropriate subgroups based on your student population. PVAAS 2010 Consultation Guide - Session C C.G. Pg /15/2010

TWO Types of PVAAS Information Today Looking Back/Evaluation… Value-added Growth Reports For Cohorts of Students Looking Forward/Planning… PVAAS Projection Reports For Individual Students and Cohorts of Students PVAAS does NOT calculate growth of an individual student. PVAAS 2010 Consultation Guide - Session C 9/15/2010

Report # 8 – School (Single Grade) Projection Summary Report Guiding Statement: The percent of students in the 70% -100% probability range of reaching proficiency in the targeted subject area on the grade 11 PSSA is equal to or exceeds the AYP target for the appropriate year. Investigate your School (Single Grade) Projection Summary Report for grade 8 projected to grade 11, and answer the questions in your guidebook. PVAAS 2010 Consultation Guide - Session C C.G. Pg. 11 9/15/2010

Report # 9 – Projection Summary (Single Grade) - Subgroups Guiding Statement: The percent of students in the 70% -100% probability range of reaching proficiency in the targeted subject area on the grade 11 PSSA is equal to or exceeds the AYP target for the appropriate year. Investigate your School (Single Grade) Projection Summary Report for grade 8 projected to grade 11 for all subgroups, and answer the questions in your guidebook. There are multiple reports available depending on the appropriate subgroups based on your student population. PVAAS 2010 Consultation Guide - Session C C.G. Pg /15/2010

See Data Tool Reference Guide Examples & Non-Examples of Effective Use of PVAAS Student Projection Reports! PVAAS 2010 Consultation Guide - Session C 9/15/2010

Student Search Capabilities and Projection Reports The Student Search capability allows you to search and investigate the probabilities of students reaching selected PSSA performance level ranges on future PSSA examinations. This feature also allows you to narrow or expand your search based on various student demographic criteria of interest. PVAAS 2010 Consultation Guide - Session C C.G. Pg. 15 9/15/2010

Student Search Report We recommend that you experiment with the different search options to focus on groups of students that are of interest to you. You may wish to reflect back on the reports and questions already addressed in this session to guide your search on groups of students you wish to investigate and discuss. PVAAS 2010 Consultation Guide - Session C C.G. Pg. 16 9/15/2010

See Data Tool Reference Guide District and building level faculty roll-out guides! PVAAS 2010 Consultation Guide - Session C 9/15/2010

Next Steps Discuss with your team the next steps in using these data to enhance educational programming for your students. Use the table in the guidebook to document your ideas for further actions. Actions:Involving Who? Other Data to Consider? Timeline Examples:  Share results with staff o Plan for sharing  Reconvene this team and go deeper  Discuss our results with SIP team  John/Sally o Full team  Full team  Fred /Spot eMetric eMetric, 4sight local assessment  1 month o Next Tuesday at 2PM  Next Friday at midnight  Next SIP team meeting PVAAS 2010 Consultation Guide - Session C C.G. Pg. 17 9/15/2010

Considerations for the Future Discuss with your team what types of support you might find useful from your IU PVAAS contact(s), as well as any other resources or materials needed from the PDE PVAAS Statewide Team. When you are ready to discuss PVAAS with your faculty, you might want to consult the Faculty Roll-out Guide in the Data Tool Reference Guide. Detach and return page 19 of the Consultation Guide to your session facilitator. PVAAS 2010 Consultation Guide - Session C 9/15/2010

Questions: PVAAS Materials or Statewide Implementation PVAAS Report Web Site 9/15/2010PVAAS 2010 Consultation Guide - Session C

Thomas Gluck Acting Secretary of Education Commonwealth of Pennsylvania Market Street Harrisburg, PA /15/2010PVAAS 2010 Consultation Guide - Session C