Prepared for DD Key Contacts – September 2013 Understanding Your Top from Your Bottom: A Guide to Michigan’s Accountability System  Prepared for DD Key Contacts – September 2013 Mitch Fowler fowlerm@calhounisd.org

Agenda Credits Scorecard Overview Scorecard Components Top to Bottom Overview Understanding Z-Scores Z-Score Components

Outcomes Participants will: understand the components of the scorecard. analyze scorecard marks to determine areas for further analysis. understand the concept of z-scores utilize z-scores to determine areas for further analysis.

Credits

Difference?

Two Sides to Accountability AYP Scorecard Top to Bottom Ranking (Priority/Focus/Reward/No Label) Criterion – Referenced: New Target with New Cut Scores, 85% Proficient by 2022. Normative – Ranking relative to the state average if at least 30 FAY students. Annual Measurable Objectives (AMOs) based on linear trajectory from 2011/12 Focuses attention on smaller subset of schools; designates Priority, Focus, & Rewards Given to all schools; acts as an “early warning” system; looks at subgroups, set targets The primary mechanism for sanctions and supports for Priority and Focus Schools. All Schools (Approx. 3,400 buildings) Fewer Schools (2,866 buildings)

Scorecard Availability Available on BAA Secure Site Available on MI School Data (Public or Secure)

Scorecard

Scorecard Components Proficiency Participation Completion Rate Based on Annual Measurable Objectives Must be at 85% Proficient by 2022 in ALL Areas and Subgroups Participation Must Test 95% of Students Completion Rate Graduation / Attendance Rate Other Factors SIP / DIP Educator Evaluations

Scorecard Components - Proficiency Annual Measurable Objectives (AMO)

Scorecard Components - Proficiency AMO Example Content Area Annual Increment 2011-12 Base Target 2012-13 Target 2013-14 Mathematics 5.49 30.10 35.59 41.08 Reading 2.35 61.54 63.89 66.23 Science 7.12 13.82 20.94 28.06 Social Studies 5.51 29.87 35.38 40.90 Writing 3.87 46.26 50.13 54.01

Scorecard Components - Proficiency Content Area Annual Increment 2011-12 Base Target 2012-13 Target 2013-14 Science 7.12 13.82 20.94 28.06 All Students made the 20.94% proficiency mark… 2 points. The Bottom 30% of students did not meet the 20.94% proficiency mark… 0 points.

Scorecard Components - Proficiency This is awesome!

Scorecard Components - Proficiency 1 = Top 30% 2 = Middle 40% 3 = Bottom 30%

Creating Top 30 / Bottom 30 Demographic in DataDirector

Creating Top 30 / Bottom 30 Demographic in DataDirector

Creating Top 30 / Bottom 30 Demographic in DataDirector

Creating Top 30 / Bottom 30 Demographic in DataDirector

Creating Top 30 / Bottom 30 Demographic in DataDirector

Using Top 30 / Bottom 30 Demographic in DataDirector

Using Top 30 / Bottom 30 Demographic in DataDirector

Using Top 30 / Bottom 30 Demographic in DataDirector

Scorecard Components - Proficiency Of the 33 proficient students, 18 were provisional… they received a 3.

Scorecard Components - Participation 95% Tested!

Scorecard Components - Participation

Scorecard Components – Completion Rate Attendance Rate

Scorecard Components – Other Factors

Two Sides to Accountability AYP Scorecard Top to Bottom Ranking (Priority/Focus/Reward/No Label) Criterion – Referenced: New Target with New Cut Scores, 85% Proficient by 2022. Normative – Ranking relative to the state average if at least 30 FAY students. Annual Measurable Objectives (AMOs) based on linear trajectory from 2011/12 Focuses attention on smaller subset of schools; designates Priority, Focus, & Rewards Given to all schools; acts as an “early warning” system; looks at subgroups, set targets The primary mechanism for sanctions and supports for Priority and Focus Schools. All Schools (Approx. 3,400 buildings) Fewer Schools (2,866 buildings)

Top to Bottom Availability Available via the BAA Look Up Tool (On the BAA Website Here) Available on MI School Data (Public or Secure)

Top to Bottom Report (MI School Data) Z-Scores TTB Rank

Z-scores (Standard Deviations) Z-scores are centered around zero or the “state average” Positive is ABOVE the state avg. Negative is BELOW the state avg. Top 1/3 > +0.5 Middle 1/3 Between -0.5 & 0.5 Bottom 1/3 < -0.5 State Average Z-score = Zero -3 -2 -1 1 2 3 -0.5 0.5 2% 16% 32% 50% 68% 84% 98% Percentile State Average Slide courtesy of Doug Greer, Ottawa ISD

Top to Bottom Lookup Tool

Slide Courtesy of MDE BAA

Top to Bottom Lookup Tool

Upcoming Accountability PD Visit pdreg.calhounisd.org and search TTB 501 to Register Individual District Consultation by Appointment

Mitch Fowler School Data Consultant fowlerm@calhounisd.org Thank You Questions? Mitch Fowler School Data Consultant fowlerm@calhounisd.org