School Performance Measure Calculations SY 2015-16 Office of Achievement and Accountability

Agenda This presentation is intended to guide you in reviewing your School Performance Measure (SPM) report. It will answer the following questions: What is the School Performance Measure (SPM)? What are the categories and indicators of SPM? What improvements were made for the 2015-16 school year? How do I interpret my 2015-16 SPM report? How is SPM calculated?

What is the School Performance Measure?

School Performance Measure Overview The SPM reflects City Schools’ values, including the importance of progress for all students and the cultivation of a nurturing learning environment Collectively, a school’s teachers and school leadership play an instrumental role in affecting student growth and the learning environment within the school The SPM serves as a component of the 2015-16 teacher and school leader evaluation systems For more information on SPM in evaluations, please visit City Schools Inside regarding teacher and school leader evaluations

School Performance Measure Overview The SPM is a measure of quantitative indicators that reflect a whole school’s year-long performance. Data are: Alternative schools and alternative options programs are excluded from SPM because the majority of these schools are missing data on most indicators So the SY 2015-16 SPM is based on SY 2014-15 data Lagged So schools are scored relative to one another District-Normed So consideration is given to absolute performance and annual progress within a school School-Specific

What are the categories and indicators of SPM?

2015-16 School Performance Measure Categories Learning Environment Achievement Student Growth OR College and Career Readiness ES/MS (100%) HS (50%) Not applicable HS Only (50%) The SPM measures school performance in 3 categories: Learning Environment, Achievement, and Student Growth OR College and Career Readiness. For SY 15-16, Achievement data are not available for any schools as a result of the transition to PARCC and Student Growth indicators are not available for schools serving grades PK-8

2015-16 SPM Indicators by Domain Learning Environment Domain Achievement Domain Student Growth OR College/Career Readiness Domain ES/MS Indicators School Survey: Parents School Survey: Students Attendance Rate Chronic Absence Rate Not applicable HS Indicators Dropout Rate (4-year) College or Career Readiness Participation (SAT/ACT, AP, CTE, dual enrollment) College or Career Readiness Success (SAT/ACT, AP, CTE, dual enrollment) Graduation rate (5-year)

What changes were made since the 2014-15 SPM?

Stakeholder Feedback To improve the School Performance Measure, a series of focus groups were held with three stakeholder groups: Principals Teachers District office staff These groups discussed what indicators and calculations would make SPM the most meaningful for professional practice and school improvement efforts Feedback was used to improve the indicators and the calculation used in 2015-16 SPM

Changes to 2015-16 SPM Indicators Learning Environment School Survey –Student Based on focus group feedback and district review of survey indicators, use selected items that are most relevant to school climate and staff responsibilities. School Survey—Parent School Survey—Staff Omit as an indicator for SY 15-16 calculations, based on feedback that what teachers report about their own schools should not be used for or against them in their individual evaluations. Cohort Retention Omit as an indicator for SY 15-16 calculations. This is based on entering grade band, so it does not include all teachers’ impacts on their students.

Changes to 2015-16 SPM Indicators & Calculations Achievement Progress Toward HSA Goals Omit achievement indicators as the district transitions to PARCC. College and Career Readiness – HS Only College and Career Readiness indicators Redefine College and Career Readiness indicators in terms of participation AND success in readiness benchmarks Changes to 2015-16 SPM Calculations Calculation Change Minimum Service to School Include a minimum threshold of service to a school for SPM to apply to an individual’s evaluation. This minimum is set to 3 months. Final Scores in Reports Round final scores in evaluation reports to whole numbers to increase readability.

2015-16 SPM Selected School Survey Items- Students School Survey- Students Admin14* The school mission is clearly communicated Learn14 I feel like I belong at this school Learn16 School staff respect the students Learn18* My school prepares me for college and to have a career Learn19 If students break rules, there are fair consequences Parent1* My parent or guardian feels welcome at this school Parent3 When I do something good at school, my parent or guardian hears about it Parent4 When I do something bad at school, my parent or guardian hears about it Resource 7 My teachers can give me extra help with schoolwork when I need it Resource8 There is someone at my school who I can talk to about my problems Satisfy2 I learn a lot at my school Satisfy 8 I like the classes I take Satisfy11 Overall, I am satisfied with my school Satisfy12* I would recommend this school to others *Schools with only grades 3-5 have fewer items than schools with students in grades 6-12. Of the items listed here, four (marked with *) are not included in the survey for students in grades 3-5. All School Survey items not listed here are excluded from 2015-16 SPM calculations.

2015-16 SPM Selected School Survey Items- Parents School Survey- Parents Creative1* Student work in the arts is displayed or presented in my child's school Learn13 Teachers at this school care about my child Learn14 My child feels like she/he belongs at this school Learn18 This school prepares students for college and to have a career Learn19 If students break rules, there are fair consequences Parent1 I feel welcome at my child's school Parent3 When my child does something good at school, I usually hear about it from the school Parent4 When my child does something bad at school, I usually hear about it from the school Parent5 School staff work closely with parents to meet students' needs Parent19 I feel that my input into my child's education is valued Parent23 This school regularly communicates with parents about how they can help their children learn Resource 7 Teachers provide extra academic help to students who need it Satisfy11 Overall, I am satisfied with my child's school Satisfy12 I would recommend my child's school to other parents *All School Survey items not listed here are excluded from 2015-16 SPM calculations.

How do I interpret my 2015-16 SPM report?

2015-16 School Performance Measure Reports Elementary and Middle Schools SPM = Learning Environment Student School Survey Rating Parent School Survey Rating Attendance Rate OR Change in Attendance Rate * Chronic Absence Rate OR Change in Chronic Absence Rate * * For these indicators, schools receive the greater of two scaled scores: either the absolute performance or the change in the indicator from the previous year. Unlike the other indicators, low rates of chronic absence yield higher scores.

2015-16 School Performance Measure Reports High Schools SPM = Average of two categories: Learning Environment Student School Survey Rating Parent School Survey Rating Attendance Rate* Chronic Absence Rate* Dropout Rate (4-year)* College/Career Readiness College or Career Participation College or Career Success Graduation Rate (5-year) * For these indicators, schools receive the greater of two scaled scores: either the absolute performance or the change in the indicator from the previous year. Unlike the other indicators, low rates of chronic absence and dropout yield higher scores.

How is SPM calculated? 1. Scoring: Comparisons Between Schools School scores on each indicator are calculated based on each school’s performance relative to other schools in the same school grade-band 2. Absolute or Change Scores Scores are compared, and schools receive whichever score is greater: the absolute or change score 3. Overall Scoring The overall score is calculated by taking the average of scores for each available indicator for each domain, and then the average of domain scores

1. Scoring: Comparisons Between Schools Schools receive scores based on how they perform relative to other schools within their grade-bands (E, EM, M, MH, H)* SPM is on a 100-point scale, and scores are based on floors (10th percentile) and targets (90th percentile) based on the following calculation: A value below the floor yields an indicator score of 0, and a value above the target yields an indicator score of 100 In this example, based on school performance in this grade-band, the floor for parent school survey rating is 78.0 and the target is 94.9, so that: School indicator value– floor Target– floor x 100 82.0-78.0 94.9-78.0 4.0 16.9 = x 100 = 23.7 * Grade bands M, MH, and EMH were grouped for learning environment data, and EMH, MH, and H were grouped for high school-only data

2. Absolute or Change Scores Schools can receive scores for improving their performance from the previous year in attendance, chronic absence, and dropout rate In this example, the school receives the change score because it is greater than the absolute score for attendance. Here is the comparison: Absolute: 2015 Attendance = 88.7% Because the floor for this school is 88.9% for attendance, this school would receive an indicator score of 0 based on absolute attendance. Change: Change in Attendance = 0.0 Because the floor is -1.55, and the target is .77 for change in attendance rate, this school would receive an indicator score of 66 for 0 change in attendance. Because this provides more points than the absolute rate, it is used in the SPM calculation.

3. Overall Scoring Elementary/Middle Schools Each of the Learning Environment indicators receives an equal weight in the final score Final score = average of 4 indicators (or available indicators) High Schools All indicators within categories receive an equal weight Final score = average of 2 categories (or available categories)

Where can I find additional information about SPM?

Additional Resources Accessing SPM reports Principals have access to SPM reports on Principal’s Dashboard For more information on SPM in evaluations, please visit City Schools Inside regarding teacher and school leader effectiveness evaluations For questions not addressed on the website, please contact: Effectiveness@bcps.k12.md.us

Indicator Definitions Appendix Indicator Definitions

Learning Environment Indicators Definition School Survey- Parents Positive parent response rate (number of positive responses to items selected for inclusion in SPM divided by number of total responses to items selected, expressed as a percent (%) by school). Data are included when N > 50 or N >10% of student enrollment. School Survey- Students Positive student response rate (number of positive responses to items selected for inclusion in SPM divided by number of total responses to items selected, expressed as a percent (%) by school). Data is included when N > 30% of student enrollment. Attendance Rate Average daily attendance rate (aggregate number of days attending divided by the aggregate number of days of membership, expressed as a percent (%), by school). Chronic Absence Rate Proportion of students absent more than 20 days (number of students absent more than 20 school days and enrolled at least 90 days, divided by total number of students enrolled at least 90 days, expressed as a percent (%), by school). Dropout Rate (4-year) (HS only) 4-year adjusted proportion of dropouts in 2011 cohort (number of students who withdraw from school (for any reason other than death) and do not reenroll, divided by the number of students who entered grade 9 for the first time in 2010, expressed as a percent (%), by school. Adjusted for transfers to other schools and other districts (transfer students are removed from denominator).

College and Career Readiness Indicators High School Only Definition College/Career Readiness Participation Proportion 12th graders who took SAT, ACT, or AP exams, are enrolled in CTE courses, OR are enrolled in college courses (number of diploma track seniors who took the SAT, ACT, AP exams, CTE courses, or credit-bearing college courses during high school divided by the number of students in grade 12 based on end of year attendance records that are graduating or still enrolled and not on a special education certification track, expressed as a percent (%) by school). College/Career Readiness Success Proportion 12th graders qualifying for any of following: SAT/ACT benchmark; AP proficiency, CTE completer, or passing college coursework (number of students succeeding in one of the following areas: meeting the 75th district percentile in SAT or ACT composite score; receiving a 3 or higher on any AP exam; completing all coursework in a CTE pathway; and passing a college course during high school, divided by the number of students in grade 12 based on end of year attendance records that are graduating or still enrolled and not on a special education certification track), expressed as a percent (%) by school). Graduation Rate (5-year) Adjusted 5- year graduation rate (number of students who graduated with a regular Maryland High School Diploma in 5-year adjusted cohort (from June 2014 to June 2015) divided by number of students in cohort, expressed as a percent (%), by school).