1. Prepared for DD Key Contacts – September 2013
Understanding Your Top from Your Bottom: A Guide to Michigan’s Accountability System 
Prepared for DD Key Contacts – September 2013
Mitch Fowler

2. Agenda Credits Scorecard Overview Scorecard Components
Top to Bottom Overview
Understanding Z-Scores
Z-Score Components

3. Outcomes Participants will:
understand the components of the scorecard.
analyze scorecard marks to determine areas for further analysis.
understand the concept of z-scores
utilize z-scores to determine areas for further analysis.

4. Credits

5. Difference?

6. Two Sides to Accountability
AYP Scorecard
Top to Bottom Ranking
(Priority/Focus/Reward/No Label)
Criterion – Referenced: New Target with New Cut Scores, 85% Proficient by 2022.
Normative – Ranking relative to the state average if at least 30 FAY students.
Annual Measurable Objectives (AMOs) based on linear trajectory from 2011/12
Focuses attention on smaller subset of schools; designates Priority, Focus, & Rewards
Given to all schools; acts as an “early warning” system; looks at subgroups, set targets
The primary mechanism for sanctions and supports for Priority and Focus Schools.
All Schools (Approx. 3,400 buildings)
Fewer Schools (2,866 buildings)

7. Scorecard Availability
Available on BAA Secure Site
Available on MI School Data (Public or Secure)

8. Scorecard

9. Scorecard Components Proficiency Participation Completion Rate
Based on Annual Measurable Objectives
Must be at 85% Proficient by 2022 in ALL Areas and Subgroups
Participation
Must Test 95% of Students
Completion Rate
Graduation / Attendance Rate
Other Factors
SIP / DIP
Educator Evaluations

10. Scorecard Components - Proficiency
Annual Measurable
Objectives (AMO)

11. Scorecard Components - Proficiency
AMO Example
Content
Area
Annual
Increment
Base Target
Target
Mathematics
5.49
30.10
35.59
41.08
Reading
2.35
61.54
63.89
66.23
Science
7.12
13.82
20.94
28.06
Social Studies
5.51
29.87
35.38
40.90
Writing
3.87
46.26
50.13
54.01

12. Scorecard Components - Proficiency
Content
Area
Annual
Increment
Base Target
Target
Science
7.12
13.82
20.94
28.06
All Students made the 20.94% proficiency mark… 2 points.
The Bottom 30% of students did not meet the 20.94% proficiency mark… 0 points.

13. Scorecard Components - Proficiency
This is awesome!

14. Scorecard Components - Proficiency
1 = Top 30%
2 = Middle 40%
3 = Bottom 30%

15. Creating Top 30 / Bottom 30 Demographic in DataDirector

16. Creating Top 30 / Bottom 30 Demographic in DataDirector

17. Creating Top 30 / Bottom 30 Demographic in DataDirector

18. Creating Top 30 / Bottom 30 Demographic in DataDirector

19. Creating Top 30 / Bottom 30 Demographic in DataDirector

20. Using Top 30 / Bottom 30 Demographic in DataDirector

21. Using Top 30 / Bottom 30 Demographic in DataDirector

22. Using Top 30 / Bottom 30 Demographic in DataDirector

23. Scorecard Components - Proficiency
Of the 33 proficient students, 18 were provisional… they received a 3.

24. Scorecard Components - Participation
95% Tested!

25. Scorecard Components - Participation

26. Scorecard Components – Completion Rate
Attendance Rate

27. Scorecard Components – Other Factors

28. Two Sides to Accountability
AYP Scorecard
Top to Bottom Ranking
(Priority/Focus/Reward/No Label)
Criterion – Referenced: New Target with New Cut Scores, 85% Proficient by 2022.
Normative – Ranking relative to the state average if at least 30 FAY students.
Annual Measurable Objectives (AMOs) based on linear trajectory from 2011/12
Focuses attention on smaller subset of schools; designates Priority, Focus, & Rewards
Given to all schools; acts as an “early warning” system; looks at subgroups, set targets
The primary mechanism for sanctions and supports for Priority and Focus Schools.
All Schools (Approx. 3,400 buildings)
Fewer Schools (2,866 buildings)

29. Top to Bottom Availability
Available via the BAA Look Up Tool
(On the BAA Website Here)
Available on MI School Data (Public or Secure)

30. Top to Bottom Report (MI School Data)
Z-Scores
TTB Rank

31. Z-scores (Standard Deviations)
Z-scores are centered around zero or the “state average”
Positive is ABOVE the state avg.
Negative is BELOW the state avg.
Top 1/3
> +0.5
Middle 1/3
Between
-0.5 & 0.5
Bottom 1/3
< -0.5
State Average
Z-score = Zero -3 -2 -1 1 2 3
-0.5
0.5 2%
16%
32%
50%
68%
84%
98%
Percentile
State Average
Slide courtesy of Doug Greer, Ottawa ISD

32. Top to Bottom Lookup Tool

33. Slide Courtesy of MDE BAA

34. Top to Bottom Lookup Tool

36. Upcoming Accountability PD
Visit pdreg.calhounisd.org and search TTB 501 to Register
Individual District
Consultation by Appointment

37. Mitch Fowler School Data Consultant fowlerm@calhounisd.org
Thank You Questions?
Mitch Fowler
School Data Consultant