School & district accountability reporting Title I Technical Assistance & Networking Session October 17, 2013

What will we cover today?  Massachusetts’ accountability measures  Goal  Progress & Performance Index (PPI)  School percentiles  Framework for accountability & assistance  Sample reports  Accountability system resources  Requirements 2 Massachusetts Department of Elementary and Secondary Education

What were the major changes for 2012? Massachusetts Department of Elementary and Secondary Education 3 1.New goal of reducing proficiency gaps by half by Accountability & assistance levels for schools and districts (Levels 1-5) 3.New performance measure (Progress & Performance Index - PPI) that includes student growth, science, & other indicators 4.School percentiles reported, representing performance relative to other schools of the same school type 5.“High needs” subgroup data reported Low income students, students with disabilities, current and former English language learners

What is the new goal? Massachusetts Department of Elementary and Secondary Education 4 1.Subtract 2011 Composite Performance Index (CPI) from Divide by 2 3.Divide by 6 to calculate annual targets

What are some key PPI concepts? 6  PPI is a measure of progress toward a group’s gap narrowing goals  Annual PPI shows progress over two years  Cumulative PPI represents trend over time  PPI runs from 0-100: 75 considered to be On Target  Core indicators (up to 7)  ELA, math, & science proficiency gap narrowing (CPI)  ELA & math growth (SGP)  Annual dropout rate  Cohort graduation rate (4- and 5-year)  Extra credit for reducing percentage of students scoring Warning/Failing or increasing percentage of students scoring Advanced Massachusetts Department of Elementary and Secondary Education

Annual PPI = total points / # core indicators Cumulative PPI = (2009* * * *4) / 10 Core indicatorsUp to 700 points awarded 1. ELA proficiency gap narrowing0, 25, 50, 75, or Math proficiency gap narrowing0, 25, 50, 75, or Science proficiency gap narrowing 0, 25, 50, 75, or ELA growth0, 25, 50, 75, or Math growth0, 25, 50, 75, or Annual dropout rate0, 25, 50, 75, or Cohort graduation rate0, 25, 50, 75, or 100 Extra credit indicatorsUp to 150 additional points awarded ELA, math, science W/F reduction ELA, math, science ADV increase Massachusetts Department of Elementary and Secondary Education 7

What are some key level concepts?  Schools and districts are classified into a level based on a four-year trend  Cumulative PPI for all students and high needs students is used to classify schools into Levels 1 & 2  School percentiles (1-99) represent performance relative to other schools of the school type, and are used to determine Level 3 schools (lowest-performing 20 percent per state law)  Progress and Performance Index (PPI) and school percentiles are used to determine Level designations for schools  Districts are classified based on the level of the lowest- performing school, or as a result of Board action 8 Massachusetts Department of Elementary and Secondary Education

The PPI and the school percentile Massachusetts Department of Elementary and Secondary Education 9  PPI is a criterion-referenced measure of progress  Percentiles are relative, and help the state and districts focus supports on low-achieving students in low performing schools  Massachusetts uses school types (ES, ESMS, MS, MSHS, HS) to fairly compare the performance of schools serving the same or similar grades  Every school’s percentile and PPI tells a different story  Schools with lower percentiles but higher PPIs for all student groups are showing improvement over time  Schools with higher percentiles but lower PPIs are high performing, but have more work to do to support student success

Sample reports

Level 1 school (first layer of report) Massachusetts Department of Elementary and Secondary Education 12

Level 1 school (second layer of report) Massachusetts Department of Elementary and Secondary Education 13

Third layer of report Massachusetts Department of Elementary and Secondary Education 14

Level 2 school (first layer of report) Massachusetts Department of Elementary and Secondary Education 15

Level 3 school (first layer of report) Massachusetts Department of Elementary and Secondary Education 16

Accountability system resources

Videos, lists, explanatory materials, & tools  Accountability videos  Lists of schools and districts by accountability & assistance level  School Leaders’ Guide to the 2013 Accountability Determinations  Includes required actions by school and district level  PPI and CPI calculators for planning and goal setting Massachusetts Department of Elementary and Secondary Education 18

Massachusetts Department of Elementary and Secondary Education 19

Requirements

Planning  District improvement plan  Three-year plan  Supplemented annually with a District Action Plan  District Standards and Indicators as resource  School improvement plan  One-year plan  Conditions for School Effectiveness (CSE) Self-Assessment as resource for development and/or revision  Title I schoolwide program plan  Alignment between CSEs and federal Title I schoolwide program plan requirements  If all CSEs are addressed, school improvement plan may also serve as the schoolwide program plan 21 Massachusetts Department of Elementary and Secondary Education

Grant reservations Any district with one or more Title I schools classified in Level 2-5 must reserve a portion of its Title I, Part A grant funds on a sliding scale for interventions and supports to address the needs of low-achieving students in low- performing schools  reservation is based on the district’s 2012 accountability and assistance level  0 to 25 percent of Title I allocation  For Level 2 districts, reservation percentage determined by percent of students not yet proficient on MCAS  See FY14 Title I grant application website for more details: Massachusetts Department of Elementary and Secondary Education

Notifications Three types – all can be combined in one notice 1.Accountability notification to inform families of relevant accountability data, including an explanation of the improvement activities in place a.Accountability and Assistance Level b.School percentile (1-99) c.Progress and Performance Index (PPI) 2.Right-to-know notification to inform families of their right to request certain information about the qualifications of their child’s teacher(s) a.Whether the teacher is licensed in the grade levels and subject areas they teach b.Whether the teacher is teaching under an emergency license or waiver c.The college degree and major of the teacher d.Whether the child is provided services by paraprofessionals and, if so, their qualifications 23 Massachusetts Department of Elementary and Secondary Education

Notifications 3.School/district report card to provide families federally required information a.Educator qualifications b.Student achievement (MCAS and NAEP) c.Accountability ESE has created a 2-page school report card overview for that districts can distribute to families of all enrolled students More information on the school report card overview, including distribution requirements, will be coming later this fall. 24 Massachusetts Department of Elementary and Secondary Education

Notifications ESE has created a template for a single letter that satisfies all federal notification requirements  Can serve as a cover letter to the school report card or overview  Customizable  Available in 10 languages 25 Massachusetts Department of Elementary and Secondary Education

Massachusetts Department of Elementary and Secondary Education