1. School Performance Measure Calculations SY 2014-15 1 Office of Achievement and Accountability

2. This presentation is intended to guide you in reviewing your School Performance Measure (SPM) report. It will answer the following questions: What is the School Performance Measure (SPM)? What are the categories and indicators of SPM? How do I interpret my 2014-15 SPM report? How is SPM calculated? Where can I find more information about SPM? Agenda 2

3. What is the School Performance Measure? 3

4. School Performance Measure Overview 4 The SPM reflects City Schools’ values including progress for all students and the cultivation of a nurturing learning environment Collectively, a school’s teachers and school leadership play an instrumental role in affecting student growth The SPM serves as a component of the 2014-15 teacher and school leader evaluation systems For more information on SPM in evaluations, please visit City Schools Inside regarding teacher and school leader evaluationsteacher school leader

5. School Performance Measure Overview 5 The SPM is a measure of quantitative indicators that reflects a whole school’s year-long performance. Data are: Lagged, so the 2014-15 SPM is based on SY 2013-14 data District-normed, so schools are scored relative to one another Context-specific, giving consideration to absolute performance and annual progress Alternative schools and alternative options programs are excluded from SPM because the majority of these schools and programs are missing data on most indicators

6. What are the categories and indicators of SPM? 6

7. 2014-15 School Performance Measure Categories The SPM measures school performance in 3 categories o Elementary and middle schools have only learning environment data as a result of the transition to PARCC o Schools serving grades 9-12 include progress and college & career readiness 7 School Performance Measure Learning Environment Progress College and Career Readiness ES/MS (100%) HS (33%) HS Only (33%)

8. 2014-15 School Performance Measure Indicators 8 Learning EnvironmentProgress* College/Career Readiness* (or Growth) ES/MS Indicators School Survey: Parents School Survey: Staff School Survey: Students Attendance Rate Chronic Absence Rate Cohort Retention Rate (2-year) Not applicable for SY 14-15 HS Indicators School Survey: Parents School Survey: Staff School Survey: Students Attendance Rate Chronic Absence Rate Cohort Retention Rate (2-year) Dropout Rate (4-year) Progress toward AMO for: HSA Algebra HSA English HSA Biology SAT/ACT Participation AND Progress toward AMO for: College/Career Preparation Graduation rate (5-year) * Progress and college/career readiness use state-developed annual measurable objective (AMO) data. When 2014 AMO data are not available, 2013 data are used.(AMO) data

9. How do I interpret my 2014-15 SPM report? 9

10. Elementary and Middle Schools SPM = Learning Environment School Survey: Parents School Survey: Staff School Survey: Students Attendance Rate* Chronic Absence Rate* Cohort Retention Rate (2-year)* 2014-15 School Performance Measure Reports 10 * For these indicators, schools receive the greater of two scaled scores: either the absolute performance or the change in the indicator from the previous year. Unlike the other indicators, low rates of chronic absence yield higher scores.

11. High Schools Learning Environment School Survey: Parents, Staff, and Students Attendance Rate* Chronic Absence Rate* Cohort Retention Rate (2- year)* Dropout Rate (4-year)* 2014-15 School Performance Measure Rep orts 11 Progress AMO- HSA Algebra AMO- HSA English AMO- HSA Biology College & Career Readiness SAT/ACT Participation Rate AMO- College/Career Preparation AMO – Graduation Rate (5-year) SPM = Average of three categories: * For these indicators, schools receive the greater of two scaled scores: either the absolute performance or the change in the indicator from the previous year. Unlike the other indicators, low rates of chronic absence and dropout yield higher scores.

12. 1. Scoring: Comparisons Between Schools Scaled scores on each indicator are calculated based on each school’s performance relative to other schools in the same school grade-band 2. Absolute or Change Scores Scaled scores are compared, and schools receive whichever score is greater: the absolute or change score 3. Overall Scoring The overall score is calculated by taking the average of scaled scores for each available indicator How is SPM calculated? 12

13. 1. Scoring: Comparisons Between Schools 13 Schools receive scaled scores based on how they perform relative to other schools within their grade-bands (E, EM, M, MH, H)* SPM is on a 100-point scale, and scores are based on floors (10 th percentile) and targets (90 th percentile, or 1 for AMO data) based on the following calculation: In this example, the floor is 64.2 and the target is 79.6 School indicator value– floor Target– floor x 100 * Grade bands M, MH, and EMH were grouped for learning environment data, and EMH, MH, and H were grouped for high school-only data 65.9– 64.2 79.6– 64.2 x 100 = 11.04 1.7 15.4 =

14. 2. Absolute or Change Scores 14 Schools can receive scores for improving their performance from the previous year in attendance, chronic absence, cohort retention, and dropout rate In this example, the school receives the change score because it is greater than the absolute score for attendance. Here is the comparison: Absolute: 2014 Attendance = 87.87% Because the floor for elementary schools is 89.37% for attendance, this school would receive a scaled score of 0 based on absolute attendance. Change: Change in Attendance (performance from SY 2014 (87.87%) – performance from SY 2013 (88.0%)= -.83 Because the floor is -1.76, and the target is.62 for change in attendance, this school would receive a scaled score of 39.22.

15. 3. Overall Scoring 15 Elementary/Middle Schools Each of the Learning Environment indicators receives an equal weight in the final score Final score= average of 6 indicators (or available indicators) High Schools All indicators within categories receive an equal weight Final score= average of 3 categories (or available categories)

16. Where can I find additional information about SPM? 16

17. Additional Resources 17 Accessing SPM reports Principals have access to SPM reports on Principal’s Dashboard For more information on SPM in evaluations, please visit City Schools Inside regarding teacher and school leader effectiveness evaluationsteacher school leader For questions not addressed on the website, please contact: Effectiveness@bcps.k12.md.us

18. INDICATOR DEFINITIONS Appendix 18

19. Learning Environment Indicators IndicatorDefinition School Survey- Parents Average percent (%) of parents responding positively to items regarding school administration, physical environment, learning climate, family involvement, school resources, safety, satisfaction with school, creativity and the arts, and student grit, on 100-point index School Survey- Staff Average percent (%) of staff responding positively to items regarding school administration, physical environment, learning climate, family involvement, school resources, safety, satisfaction with school, creativity and the arts, and student grit, on 100-point index School Survey- Students Average percent (%) of students responding positively to items regarding school administration, physical environment, learning climate, family involvement, school resources, safety, satisfaction with school, creativity and the arts, and student grit, on 100-point index Attendance Rate Average daily attendance rate (%, aggregate number of days attending divided by the aggregate number of days of membership) Chronic Absence Rate Proportion of enrolled students absent more than 20 days (%, number of students absent more than 20 school days and enrolled at least 90 days, divided by total number of students enrolled at least 90 days) Cohort Retention Rate (2-year) Proportion of students remaining at school 2 years after normal entry grade (%, number of students who remain at the school two years after entry at normal entry grade divided by the number of students who enroll at the beginning of the entry year-- base year for 2014 is 9/30 enrollment file for SY11-12) Dropout Rate (4-year) (HS only) 4-year adjusted proportion of dropouts in 2010 cohort (%, number of students who withdraw from school (for any reason other than death) and do not reenroll, divided by the number of students who entered grade 9 for the first time in 2010. Adjusted for transfers to other schools and other districts-- transfer students are removed from denominator) 19

20. Progress Indicators HS Only IndicatorDefinition AMO- HSA Algebra Proportional achievement relative to HSA Algebra AMO (%, number of students advanced and proficient in algebra divided by the total number of students eligible to take assessments; this proficiency rate is divided by the school's AMO target. AMOs are set in annual equal increments toward a 50% reduction in the percentage of students who are not proficient by 2017. Proficiency rates from assessments administered in SY10-11 are used for the baseline year.) AMO- HSA English Proportional achievement relative to HSA English AMO (%, number of students advanced and proficient in English divided by the total number of students eligible to take assessments; this proficiency rate is divided by the school's AMO target. AMOs are set in annual equal increments toward a 50% reduction in the percentage of students who are not proficient by 2017. Proficiency rates from assessments administered in SY10-11 are used for the baseline year.) AMO- HSA Biology Proportional achievement relative to HSA Biology AMO (%, number of students advanced and proficient in biology divided by the total number of students eligible to take assessments; this proficiency rate is divided by the school's AMO target. AMOs are set in annual equal increments toward a 50% reduction in the percentage of students who are not proficient by 2017. Proficiency rates from assessments administered in SY10-11 are used for the baseline year.) 20

21. College/Career Readiness Indicators HS Only IndicatorDefinition SAT/ACT Participation Proportion students who took SAT or ACT (%, number of diploma track seniors who took the SAT or ACT divided by the number of students in grade 12 based on end of year attendance records that are graduating or still enrolled and not on a SPED Certification track) AMO- College/Career Preparation Proportional measure of graduates qualifying for any of following: AP/IB proficiency, CTE concentrator, or college enrollment relative to AMO (%, number of students succeeding in one of the following areas: Advanced Placement or International Baccalaureate, Career and Technology Education Concentrators, and College Enrollment within 16 months of high school graduation, divided by number of graduates; this rate is divided by the school's AMO target. The CCP targets are on a trajectory toward 2017, when each school is expected to reduce its percent of students that are not completing the CCP goals by half.) AMO- Graduation Rate (5-year) Proportional measure of graduation rate relative to AMO (%, number of students who graduated with a regular Maryland High School Diploma in 5-year adjusted cohort (from June 2013 to June 2014) divided by number of students in cohort; this number is divided by the school's AMO target. The 5-year adjusted cohort graduation rate targets are on a trajectory toward 2020, when each school is expected to reduce its rate of non-graduating students by half.) 21