1. School & district accountability reporting Title I Technical Assistance & Networking Session October 17, 2013

2. What will we cover today?  Massachusetts’ accountability measures  Goal  Progress & Performance Index (PPI)  School percentiles  Framework for accountability & assistance  Sample reports  Accountability system resources  Requirements 2 Massachusetts Department of Elementary and Secondary Education

3. What were the major changes for 2012? Massachusetts Department of Elementary and Secondary Education 3 1.New goal of reducing proficiency gaps by half by 2017 2.Accountability & assistance levels for schools and districts (Levels 1-5) 3.New performance measure (Progress & Performance Index - PPI) that includes student growth, science, & other indicators 4.School percentiles reported, representing performance relative to other schools of the same school type 5.“High needs” subgroup data reported Low income students, students with disabilities, current and former English language learners

4. What is the new goal? Massachusetts Department of Elementary and Secondary Education 4 1.Subtract 2011 Composite Performance Index (CPI) from 100 2.Divide by 2 3.Divide by 6 to calculate annual targets

6. What are some key PPI concepts? 6  PPI is a measure of progress toward a group’s gap narrowing goals  Annual PPI shows progress over two years  Cumulative PPI represents trend over time  PPI runs from 0-100: 75 considered to be On Target  Core indicators (up to 7)  ELA, math, & science proficiency gap narrowing (CPI)  ELA & math growth (SGP)  Annual dropout rate  Cohort graduation rate (4- and 5-year)  Extra credit for reducing percentage of students scoring Warning/Failing or increasing percentage of students scoring Advanced Massachusetts Department of Elementary and Secondary Education

7. Annual PPI = total points / # core indicators Cumulative PPI = (2009*1 + 2010*2 + 2011*3 + 2012*4) / 10 Core indicatorsUp to 700 points awarded 1. ELA proficiency gap narrowing0, 25, 50, 75, or 100 2. Math proficiency gap narrowing0, 25, 50, 75, or 100 3. Science proficiency gap narrowing 0, 25, 50, 75, or 100 4. ELA growth0, 25, 50, 75, or 100 5. Math growth0, 25, 50, 75, or 100 6. Annual dropout rate0, 25, 50, 75, or 100 7. Cohort graduation rate0, 25, 50, 75, or 100 Extra credit indicatorsUp to 150 additional points awarded ELA, math, science W/F reduction25 + 25 + 25 ELA, math, science ADV increase25 + 25 + 25 Massachusetts Department of Elementary and Secondary Education 7

8. What are some key level concepts?  Schools and districts are classified into a level based on a four-year trend  Cumulative PPI for all students and high needs students is used to classify schools into Levels 1 & 2  School percentiles (1-99) represent performance relative to other schools of the school type, and are used to determine Level 3 schools (lowest-performing 20 percent per state law)  Progress and Performance Index (PPI) and school percentiles are used to determine Level designations for schools  Districts are classified based on the level of the lowest- performing school, or as a result of Board action 8 Massachusetts Department of Elementary and Secondary Education

9. The PPI and the school percentile Massachusetts Department of Elementary and Secondary Education 9  PPI is a criterion-referenced measure of progress  Percentiles are relative, and help the state and districts focus supports on low-achieving students in low performing schools  Massachusetts uses school types (ES, ESMS, MS, MSHS, HS) to fairly compare the performance of schools serving the same or similar grades  Every school’s percentile and PPI tells a different story  Schools with lower percentiles but higher PPIs for all student groups are showing improvement over time  Schools with higher percentiles but lower PPIs are high performing, but have more work to do to support student success

11. Sample reports

12. Level 1 school (first layer of report) Massachusetts Department of Elementary and Secondary Education 12

13. Level 1 school (second layer of report) Massachusetts Department of Elementary and Secondary Education 13

14. Third layer of report Massachusetts Department of Elementary and Secondary Education 14

15. Level 2 school (first layer of report) Massachusetts Department of Elementary and Secondary Education 15

16. Level 3 school (first layer of report) Massachusetts Department of Elementary and Secondary Education 16

17. Accountability system resources

18. Videos, lists, explanatory materials, & tools  Accountability videos  Lists of schools and districts by accountability & assistance level  School Leaders’ Guide to the 2013 Accountability Determinations  Includes required actions by school and district level  PPI and CPI calculators for planning and goal setting Massachusetts Department of Elementary and Secondary Education 18 www.doe.mass.edu/apa/accountability

19. Massachusetts Department of Elementary and Secondary Education 19

20. Requirements

21. Planning  District improvement plan  Three-year plan  Supplemented annually with a District Action Plan  District Standards and Indicators as resource  School improvement plan  One-year plan  Conditions for School Effectiveness (CSE) Self-Assessment as resource for development and/or revision  Title I schoolwide program plan  Alignment between CSEs and federal Title I schoolwide program plan requirements  If all CSEs are addressed, school improvement plan may also serve as the schoolwide program plan 21 Massachusetts Department of Elementary and Secondary Education www.doe.mass.edu/apa/titlei/parta/program-design/default.html?section=PL

22. Grant reservations Any district with one or more Title I schools classified in Level 2-5 must reserve a portion of its Title I, Part A grant funds on a sliding scale for interventions and supports to address the needs of low-achieving students in low- performing schools  2013-14 reservation is based on the district’s 2012 accountability and assistance level  0 to 25 percent of Title I allocation  For Level 2 districts, reservation percentage determined by percent of students not yet proficient on MCAS  See FY14 Title I grant application website for more details: www.doe.mass.edu/apa/titlei/grant-applications www.doe.mass.edu/apa/titlei/grant-applications 22 Massachusetts Department of Elementary and Secondary Education

23. Notifications Three types – all can be combined in one notice 1.Accountability notification to inform families of relevant accountability data, including an explanation of the improvement activities in place a.Accountability and Assistance Level b.School percentile (1-99) c.Progress and Performance Index (PPI) 2.Right-to-know notification to inform families of their right to request certain information about the qualifications of their child’s teacher(s) a.Whether the teacher is licensed in the grade levels and subject areas they teach b.Whether the teacher is teaching under an emergency license or waiver c.The college degree and major of the teacher d.Whether the child is provided services by paraprofessionals and, if so, their qualifications 23 Massachusetts Department of Elementary and Secondary Education

24. Notifications 3.School/district report card to provide families federally required information a.Educator qualifications b.Student achievement (MCAS and NAEP) c.Accountability ESE has created a 2-page school report card overview for 2013-14 that districts can distribute to families of all enrolled students More information on the school report card overview, including distribution requirements, will be coming later this fall. 24 Massachusetts Department of Elementary and Secondary Education

25. Notifications ESE has created a template for a single letter that satisfies all federal notification requirements  Can serve as a cover letter to the school report card or overview  Customizable  Available in 10 languages 25 Massachusetts Department of Elementary and Secondary Education www.doe.mass.edu/apa/accountability/reportcard/

26. titlei@doe.mass.edu 781.338.6230 26 Massachusetts Department of Elementary and Secondary Education