Pennsylvania Value-Added Assessment System (PVAAS): A Compass for Improvement Oxford Area School District February 14, 2013

PVAAS IS : Analysis of existing assessment data Longitudinal PSSA scores in available content areas Math, Reading, Science, Writing Provides reliable estimates A measure of a school’s effectiveness Critical Relationship: Growth Data vs. Achievement Data

PVAAS IS NOT Another test Another test Able to provide a measure of growth for an individual student Able to provide a measure of growth for an individual student A comparison of single test scores A comparison of single test scores

High Achievement Average Achievement Low Achievement Current Data Collection Approaches Achievement is based on each student’s ending point.

OASD/State 2012 Reading PSSA Disaggregated Groups

Key Concepts AchievementProgress Measures students’ performance at a single point in time Compares student performance to a standard Critical to students’ post- secondary opportunities Highly correlated with demographic factors, such as socioeconomic status Measures students’ progress across time/years Compares student performance to his/her own prior performance Critical to ensuring students’ future academic success Not correlated with demographic factors

Key Concepts  PVAAS reporting reflects the effectiveness of your district’s or school’s Standards-Aligned System  PVAAS reporting reflects the district’s or school’s system regarding curriculum, assessment, and instruction

Key Concepts There is NO relationship between demographic variables such as socioeconomic status and growth. There are high achieving schools making high growth; There are high achieving schools making low growth; There are low achieving schools making high growth; There are low achieving schools making low growth. Growth reporting reflects what WE do with students in terms of academic growth in schools/districts. -- VAAS can remove the effects of factors not under the control of the school. (McCaffrey, Lockwood, Koretz & Hamilton, 2003; Ross, Wang, Sanders, Wright & Stringfield, 1999a; Wright, Horn & Sanders, 1997).

PVAAS Adds Another Variable To Achievement…Progress Below Growth Standard At or Above Growth Standard Progress is based on each cohort’s starting point. 0 = Growth Standard

TWO Types of PVAAS Information Today Looking Back/Evaluation… Value-added Growth Reports For Groups of Students Looking Forward/Planning… PVAAS Projection Reports For Individual Students and Groups of Students

What questions does PVAAS answer? 1. Did each group of students make a year’s worth of growth in reading (grades 4-8 and 11), math (grades 4-8 and 11), science (grades 4, 8 and 11), and writing (grades 5, 8 and 11)? 1. Did each subgroup of students make a year’s worth of growth in reading (grades 4-8 and 11), math (grades 4-8 and 11), science (grades 4, 8 and 11), and writing (grades 5, 8 and 11)? 1. Is each student on a trajectory to reach proficient or advanced on a future PSSA reading, math, science, and writing?

SAS PVAAS Website Professional Development Opportunities, New Features, Guide to District/School Reports, Guide to Public Reporting, IU Point of Contact...

Overview of PVAAS Reporting

PVAAS Reporting Value-Added Reports and Projections Reading, Math, Science and Writing Reading, Math, Science and Writing District Level Reporting District Level Reporting School Level Reporting School Level Reporting Grade Level Reporting (4-8, 11) Grade Level Reporting (4-8, 11) Subgroups Reporting (ex. IEP, ED, ELL) Subgroups Reporting (ex. IEP, ED, ELL) Performance Levels (Advanced, Proficient, Basic, Below Basic) Performance Levels (Advanced, Proficient, Basic, Below Basic) Student Level Reporting – Only for projections Student Level Reporting – Only for projections Reading, Math, Science, WritingReading, Math, Science, Writing

Did students make one year’s academic growth last year?

Scatter Plot Quadrants and Their Meanings Quad 1 - Excelling Higher Achievement, Higher Growth Quad 4 - Improving Lower Achievement, Higher Growth Quad 2 - Slipping Higher Achievement, Negative Growth Quad 3 - Underperforming Lower Achievement, Lower Growth 16

School to County Grade 4 Math

School to County Grade 4 Reading

School to County Grade 5 Math

School to County Grade 5 Reading

School to County Grade 6 Math

School to County Grade 6 Reading

School to County Grade 7 Math

School to County Grade 7 Reading

School to County Grade 8 Math

School to County Grade 8 Reading

School to County Grade 11 Math

School to County Grade 11 Reading

Publicly Released Data: School Search Allows users to find and compare the achievement and gains of grade levels in all schools in PA (grades 4-8 & 11) Allows users to find and compare the achievement and gains of grade levels in all schools in PA (grades 4-8 & 11) Will display the school’s quintile relative to all schools in PennsylvaniaWill display the school’s quintile relative to all schools in Pennsylvania Can search for “comparable schools”Can search for “comparable schools” Similar demographicsSimilar demographics January

Average Growth Index Math (Grades 4-8) Math (Grades 4-8) AGI 10.7 (19 th out of 553 districts)AGI 10.7 (19 th out of 553 districts) *Significant evidence that the district exceeded the standard for PA Academic Growth*Significant evidence that the district exceeded the standard for PA Academic Growth Range of growth 20.5 – (-55.9)Range of growth 20.5 – (-55.9) Only 1/12 other Chester County school district ranked higher.Only 1/12 other Chester County school district ranked higher.

Average Growth Index Reading (Grades 4-8) Reading (Grades 4-8) AGI 5.6 (38 th out of 553 districts)AGI 5.6 (38 th out of 553 districts) *Significant evidence that the district exceeded the standard for PA Academic Growth*Significant evidence that the district exceeded the standard for PA Academic Growth Range of growth 15.4 – (-46.3)Range of growth 15.4 – (-46.3) Only 3/12 other Chester County school districts ranked higher.Only 3/12 other Chester County school districts ranked higher.

Gerald L. Zahorchak, D.Ed. Secretary of Education Commonwealth of Pennsylvania Market Street Harrisburg, PA 17126