Accountability data overview August 2014

Topics  Changes to 2014 accountability reporting  Overview of accountability measures  Progress & Performance Index (PPI)  School percentiles  Accountability & assistance levels  Reports  Resources & tools Massachusetts Department of Elementary and Secondary Education 2

Highlights of ESEA Flexibility in MA  Goal: Reducing proficiency gaps by half by 2017  Accountability & assistance levels for schools & districts (Levels 1-5)  Progress & Performance Index (PPI) – a performance measure that includes student growth, science, & other indicators  School percentiles – representing performance relative to other schools of the same school type  “High needs” subgroup data reported  Low income students, students with disabilities, current & former English language learners Massachusetts Department of Elementary and Secondary Education 3

Description2012 & 2013 reporting2014 reporting Extra credit for reengaging dropouts N/AHigh schools that reengaged 2 or more dropouts in the school year will earn 25 extra credit PPI points (all students & high needs groups only) Weighting of growth and achievement in school percentiles Achievement – 80% Growth – 20% Non-high schools: Achievement – 75% Growth – 25% High schools: Achievement – 50% Growth – 25% High school indicators – 25% Methodology for identifying Commendation Schools Better alignment between Commendation School criteria and that of federal Blue Ribbon Schools program. Commendation Schools will be identified when official MCAS & accountability data are released in mid-September. Changes to 2014 accountability reporting 4 Massachusetts Department of Elementary and Secondary Education

Description2012 & 2013 reporting2014 reporting Accountability reporting for PARCC PBA field test schools with some students exempt from MCAS testing N = 89 N/A2014 PPI and school percentiles calculated using highest value for all MCAS results or MCAS results excluding PBA field test grades accountability & assistance level based on 2014 cumulative PPI and school percentile. Accountability reporting for PARCC PBA field test schools with all students exempt from MCAS testing N = 13 N/ANo 2014 PPI or school percentile accountability & assistance level held constant. Changes to 2014 accountability reporting 5 Massachusetts Department of Elementary and Secondary Education

Description2012, 2013, & 2014 reporting2015 reporting Persistently low graduation rates Any school with a graduation rate of less than 60% for four consecutive years is automatically placed in Level 3 Any school with a graduation rate of less than 67% for the most recent four-year graduation rate & 70% for each of the three prior five- year rates will be placed in Level 3. Implementation in 2015, but schools will be notified in 2014 if they would have been impacted by this change in Participation ratesSchools testing less than 95% of students in any group on any of the required statewide assessments are automatically ineligible for Level 1, & schools testing less than 90% of students in any group on any test are automatically ineligible for Levels 1 and 2. Current school participation consequences will also be applied at the district level. Implementation in 2015, but districts will be notified in 2014 if they would have been impacted by this change in Preview of changes to 2015 accountability reporting 6 Massachusetts Department of Elementary and Secondary Education

Reducing proficiency gaps by half by Massachusetts Department of Elementary and Secondary Education 7

8 Reducing proficiency gaps by half by

 The PPI is a measure of progress toward a group’s gap-narrowing goals  Annual PPI shows progress over two years  Cumulative PPI represents trend over time  Core indicators (up to 7)  ELA, math, & science proficiency gap narrowing (CPI)  ELA & math growth (SGP)  Annual dropout rate  Cohort graduation rate (4-and 5-year)  Extra credit  Reducing percentage of students scoring Warning/Failing &/or increasing percentage of students scoring Advanced (10 percent or more)  Reengaging dropouts (2 or more students) What are some key PPI concepts? Massachusetts Department of Elementary and Secondary Education 9

Annual PPI = total points / # core indicators Cumulative PPI = (2011* * * *4) / 10 Core indicatorsUp to 700 points awarded 1. ELA proficiency gap narrowing0, 25, 50, 75, or Math proficiency gap narrowing0, 25, 50, 75, or Science proficiency gap narrowing 0, 25, 50, 75, or ELA growth0, 25, 50, 75, or Math growth0, 25, 50, 75, or Annual dropout rate0, 25, 50, 75, or Cohort graduation rate0, 25, 50, 75, or 100 Extra credit indicatorsUp to 175 additional points awarded ELA, math, science W/F reduction ELA, math, science ADV increase Dropout reengagement25 Massachusetts Department of Elementary and Secondary Education 10

The PPI and the school percentile Massachusetts Department of Elementary and Secondary Education 11  PPI is a criterion-referenced measure of progress  Percentiles are relative, & help the state & districts focus supports on low-achieving students in low performing schools  Massachusetts uses school types (ES, ESMS, MS, MSHS/K-12, HS) to fairly compare the performance of schools serving the same or similar grades & distribute resources equitably  Every school’s percentile & PPI tells a different story  Schools with lower percentiles but higher PPIs for all student groups are showing improvement over time  Schools with higher percentiles but lower PPIs are high performing, but have more work to do to support student success

What are some key Level concepts? Massachusetts Department of Elementary and Secondary Education 12  Schools & districts are classified into a level based on a four-year trend  The cumulative PPI for all students & high needs students is used to classify schools into Levels 1 & 2  School percentiles (1-99) represent performance relative to other schools of the school type, & are used to determine Level 3 schools (lowest-performing 20 percent per state law)  Districts are classified based on the level of lowest- performing school (exception for Board action)

13 Massachusetts Department of Elementary and Secondary Education How are schools classified?

Sample reports

Accountability reports  Layer 1:  Accountability & assistance level  Reason(s) for level designation  School percentile (schools only)  Determination of need for Special Education technical assistance or intervention (districts and single-school districts only)  Cumulative Progress & Performance Index (PPI) for all student groups  Summary of school accountability information (districts only)  Layer 2 (group-specific):  Annual & cumulative PPI figures  Points awarded for each indicator  Assessment participation data  Layer 3:  Detailed data for each indicator for all student groups 15 Massachusetts Department of Elementary and Secondary Education

Level 1 school (first layer of report) Massachusetts Department of Elementary and Secondary Education 16

Level 1 school (second layer of report) Massachusetts Department of Elementary and Secondary Education 17

Level 1 school (third layer of report) Massachusetts Department of Elementary and Secondary Education 18

Level 2 school (first layer of report) Massachusetts Department of Elementary and Secondary Education 19

Level 3 school (first layer of report) Massachusetts Department of Elementary and Secondary Education 20

Resources & tools

Resources and tools Massachusetts Department of Elementary and Secondary Education 22

Gap-halving calculators Massachusetts Department of Elementary and Secondary Education 23

PPI calculator Massachusetts Department of Elementary and Secondary Education 24

District analysis, review, & assistance tools Massachusetts Department of Elementary and Secondary Education 25

District analysis, review, & assistance tools Massachusetts Department of Elementary and Secondary Education 26

Questions? Massachusetts Department of Elementary and Secondary Education