1. Smarter Balanced Rubrics, Scoring, and Reporting March 24, 2015
Office of Strategy, Innovation and Performance
Assessment Section
(808)

2. Rubrics Mathematics ELA/Literacy
Scoring Guide for Short-Text Mathematics Items
ELA/Literacy
Rubrics for Full Writes (Practice Test)
Rubrics for Short-Text Items
Rubric templates
for short text items are embedded in the item specifications for Claim 1 for targets 4 /11 and targets 2/9
For research short-text items are in the performance task
Rubrics for Brief Writes
For targets 1a, 3a, and 6a

3. Scoring Guidelines

4. Smarter Balanced Scoring Guide for Selected Short Text Mathematics Items
General Rubric for 2-Point Items (p. 3)
Sample Grade 4
Sample 2-Point Short-Text Item for Grade 4 (Lemons) (p. 4)
Sample Item Specific Rubric for Grade 4 Lemon Item (p. 5)
Anchor Responses 1 – 9 for Lemon Item (pp. 6 – 14)
Sample Grade 8
Sample 2-Point Short-Text Item for Grade 4 (Earth and Moon) (p. 15)
Sample Item Specific Rubric for Grade 8 Earth and Moon Item (p. 16)
Anchor Responses 1 – 10 for Earth and Moon Item (pp. 17 – 26)

5. Smarter Balanced Scoring Guide for Selected Short Text Mathematics Items (range up to 4)
Sample High School
Sample 2-Point Short-Text Item for High School (Parabolas)(p. 27)
Sample Item Specific Rubric for High School Parabolas Item (p. 28)
Anchor Responses 1 – 8 for Parabolas Item (pp )
General Rubric for 4-Point Items (p. 37)
General Rubric for 3-Point Items (p. 38)
General Rubric for 2-Point Items (p. 39)
General Rubric for 1-Point Item (p. 39)

6. Smarter Balanced Mathematics General Rubric for 2-Point Items (p. 39)

7. Item Specific Rubric for 2-pt Grade 4 Lemon Item

8. ELA/Literacy Full Write Rubrics

9. Rubrics for the Full Writes found in Practice Tests

10. Scoring Guides for Practice Test Items

11. Excerpt Grades 3-5 PT Writing Rubric

13. Excerpt Grade 4 Item Specific Rubric (from Practice Test)

14. Rubric Templates for Short-Text ELA/Literacy Items

15. Rubric Templates for Short-Text Items
Rubric templates are embedded in the item specifications for Claim 1 short-text items (targets 4/11 and targets 2/9) and research short- text items in the performance tasks.
All short text rubrics are 0-2 point rubrics

16. Item Specifications

17. Grade 4, Claim 1 Target 4 (1/6)

18. Grade 4, Claim 1 Target 4 (2/6)

19. Grade 4, Claim 1 Target 4 (3/6)

20. Grade 4, Claim 1 Target 4 (4/6)

21. Grade 4, Claim 1 Target 4 (5/6)

22. Grade 4, Claim 1 Target 4 (6/6)- Excerpt p.9

23. ELA/Literacy Brief Write Rubrics

24. ELA Brief Write Rubric Target 1a Narrative (1/3)

25. ELA Brief Write Rubric Target 1a Narrative (2/3)

26. ELA Brief Write Rubric Target 1a Narrative (3/3)

27. ELA Brief Write Rubric Target 3a Informational/Explanatory (1/3)

28. ELA Brief Write Rubric Target 3a Informational/Explanatory (2/3)

29. ELA Brief Write Rubric Target 3a Informational/Explanatory (3/3)

30. ELA/L Brief Write Rubric Target 6a Opinion/Argumentative (1/6)

31. ELA Brief Write Rubric Target 6a Opinion/Argumentative (2/6)

32. ELA Brief Write Rubric Target 6a Opinion/Argumentative (3/6)

33. ELA Brief Write Rubric Target 6a Opinion/Argumentative (4/6)

34. ELA Brief Write Rubric Target 6a Opinion/Argumentative (5/6)

35. ELA Brief Write Rubric Target 6a Opinion/Argumentative (6/6)

36. From: TILSA Alignment Tool Dissemination Workshop, July 2005 in Boston Massachusetts Webb
Degree of Alignment
Standards
Standards
Assessment
Assess-ment
Assessment Items
Standards
Assessment
Standards

37. Scores
Composite
Scale
Claim Level
Threshold

38. Smarter Balanced Scale Scores
Vertical scale
Increase across grade levels
Current level of achievement and growth over time
Aggregate scores for schools and complex areas
Can measure gaps for different groups of students

39. Composite Score Summative Assessment for ELA/Literacy
Computer Adaptive Test and Performance Task
Reading
Writing
Listening
Research
One Composite Score for ELA

40. Composite Score Summative Assessment for Mathematics
Computer Adaptive Test and Performance Task
Concepts and Procedures
Problem Solving & Modeling/Data Analysis
Communicating Reasoning
One Composite Score for Math

41. Claim Level Scores
English Language Arts/Literacy: (1) Reading (2) Writing (3) Listening (4) Research
Mathematics:
Concepts and Procedures
Problem Solving & Modeling/Data Analysis
Communicating Reasoning

42. Claim Level Achievement
Above Standard
Your test results clearly show that you understand and are able to apply your knowledge to the standards in this content area of your grade.
At/Near Standard
Your test results may be just above or just below the standard, but due to the error band, the result is too close too call.
Below Standard
Your test results clearly show that you have not yet met the standard in this content area for your grade.

43. Raw Scores versus Scale Scores
Raw score of 5 or 50%
Peter gets 5 out of 10 easy items correct
Bob gets 5 out of 10 difficult items correct
Raw score of 5 or 50%
Lower Scale Score than Bob
Peter gets 5 out of 10 easy items correct
Higher Scale Score than Peter
Bob gets 5 out of 10 difficult items correct

44. Slide from Achievement Level Setting Workshop in Dallas, TX, October 2014

45. Achievement Levels
Hawaii State Assessments
Smarter Balanced Assessments
Well Below Proficiency Approaches Proficiency Meets Proficiency Exceeds Proficiency
Level 1 Level 2 Level 3 Level 4

46. SB ELA/Literacy Reported Scale Scores
Grade
Level 1
Level 2
Level 3
Level 4 3 4 5 6 7 8 11

47. SB Mathematics Reported Scale Scores
Grade
Level 1
Level 2
Level 3
Level 4 3 4 5 6 7 8 11

48. Level 4 Level 3 Level 2 Level 1
Mathematics and ELA/Literacy Achievement Level Descriptors – High School
Level 4
The student has exceeded the achievement standard and demonstrates the knowledge and skills in [content area] needed for likely success in entry-level credit-bearing college coursework after high school.
Level 3
The student has met the achievement standard and demonstrates progress toward mastery of the knowledge and skills in [content area] needed for likely success in entry-level credit-bearing college coursework after completing high school coursework.
Level 2
The student has nearly met the achievement standard and may require further development to demonstrate the knowledge and skills in [content area] needed for likely success in entry-level credit-bearing college coursework after high school.
Level 1
The student has not met the achievement standard and needs substantial improvement to demonstrate the knowledge and skills in [content area] needed for likely success in entry-level credit-bearing college coursework after high school.

49. Level 4 Level 3 Level 2 Level 1
Mathematics and ELA/Literacy Achievement Level Descriptors – Grades 6-8
Level 4
The student has exceeded the achievement standard and demonstrates advanced progress toward mastery of the knowledge and skills in [content area] needed for likely success in entry-level credit-bearing college coursework after high school.
Level 3
The student has met the achievement standard and demonstrates progress toward mastery of the knowledge and skills in [content area] needed for likely success in entry-level credit-bearing college coursework after high school.
Level 2
The student has nearly met the achievement standard and may require further development to demonstrate the knowledge and skills in mathematics needed for likely success in entry-level credit-bearing college coursework after high school.
Level 1
The student has not met the achievement standard and needs substantial improvement to demonstrate the knowledge and skills in mathematics needed for likely success in entry-level credit-bearing college coursework after high school.

50. Level 4 Level 3 Level 2 Level 1
Mathematics and ELA/Literacy Achievement Level Descriptors – Grades 3-5
Level 4
The student has exceeded the achievement standard and demonstrates advanced progress toward mastery of the knowledge and skills in [content area] needed for likely success in future coursework.
Level 3
The student has met the achievement standard and demonstrates progress toward mastery of the knowledge and skills in [content area] needed for likely success in future coursework.
Level 2
The student has nearly met the achievement standard and may require further development to demonstrate the knowledge and skills in mathematics needed for likely success in future coursework.
Level 1
The student has not met the achievement standard and needs substantial improvement to demonstrate the knowledge and skills in mathematics needed for likely success in future coursework.

51. Score Reports

53. Target Achievement Level
Icon
Target Level
Description
Better than performance on the test as a whole
This target is a relative strength. The group of students performed better on items from this target than they did on the rest of the test as a whole.
Similar to performance on the test as a whole
This target is neither a relative strength nor a relative weakness. The group of students performed about as well on items from this target as they did on the rest of the test as a whole.
Worse than performance on the test as a whole
This target is a relative weakness. The group of students did not perform as well on items from this target as they did on the rest of the test as a whole.
Insufficient information
Not enough information is available to determine whether this target is a relative strength or weakness.

55. The Online Reporting System an overview including the SB Interim Assessments and the Teacher Hand Scoring System

56. ICA Overview
Content Area
Grades
Computer Adaptive Test (CAT) items
Performance Task (PT)
Total “Computer” Time
Classroom Activity (administered prior to the PT)*
Total Time
English Language Arts/Literacy
3–5
1:30
2:00
3:30
:30
4:00
6–8
: 30 HS
4:30
Mathematics
1:00
2:30
3:00
for both ELA and Math
6:00
7:00
6:30
7:30
8:30
ICA mirrors the summative assessment and the components, recommended sequence and duration is the same.
The ICA includes:
a CAT component (fix form this year),
a classroom activity, and
a performance task for each subject.
The components need to be completed (along with the hand scoring of constructed response items) before scores will be available.
Blueprints for the ICAs are the same as the summative assessment and can be found at >> Smarter Balanced >> Test Coordinator/Administrator >> General Information

57. Interim Comprehensive Assessment
Hand Scoring
How much?
How?
The Interim Teacher Hand Scoring System under Smarter Balanced at
Interim Comprehensive Assessment
Items to be Hand Scored
Total Items
CAT PT
Subject
Grade
Test Name
Short Ans
Essay
ELA 3
ICA - Grade 3 2 1 47 4
ICA - Grade 4 48 5
ICA - Grade 5 6
ICA - Grade 6 49 7
ICA - Grade 7 8
ICA - Grade 8 11
ICA - Grade 11 46
Mathematics
Math ICA - Grade 3 37
Math ICA - Grade 4 36
Math ICA - Grade 5
Math ICA - Grade 6
Math ICA - Grade 7
Math ICA - Grade 8
Math ICA - Grade 11 39

58. Available Interim Assessment Blocks: Mathematics
Grade 3
Grade 4
Grade 5
Operations and Algebraic Thinking
Numbers and Operations in Base 10
Fractions
Measurement and Data
Mathematics PT
Grade 6
Grade 7
Grade 8
Ratio and Proportional Relationships
Expressions & Equations, with
Proportionality, Statistics & Probability
Geometry
Number System
Expressions and Equations
Functions
Mathematics PT
High School
Algebra and Functions - Linear Functions
Algebra and Functions - Quadratic Functions
Geometry - Right Triangle Ratios in Geometry
Mathematics PT
Blueprints for the IABs can be found at >> Smarter Balanced >> Test Coordinator/Administrator >> General Information

59. Available Interim Assessment Blocks: ELA
Summary — Grades 3, 4 and 5
Read Literary Texts
Read Informational Texts
Edit/Revise
Brief Writes
Listen/Interpret
Research
Informational PT
Opinion PT (Grade 3)
Narrative PT (Grade 4, 5)
Summary — Grades 6, 7, and 8
Read Literary Texts
Read Informational Texts
Edit/Revise
Brief Writes
Listen/Interpret
Research
Argument PT
Summary — Grade 11
Read Literary Texts
Listen/Interpret
Read Informational Texts
Research
Edit/Revise
Explanatory PT
Brief Writes
Blueprints for the IABs can be found at >> Smarter Balanced >> Test Coordinator/Administrator >> General Information

60. SB Reporting in the Online Reporting System (ORS)
Accessing reports is exactly the same as it has been for HSA
The types of reports available are similar to those available for HSA
SB Summative reports will include “Target Level” summaries at the class level.
The data you will see depends upon your “role” in TIDE

61. Assessment
School Year
Scores for Who
Complex Area
Test and Grade

64. Click to edit Master text styles
Second level
Third level
Fourth level
Fifth level

65. Title and Content Layout with List
Click to edit Master text styles
Second level
Third level
Fourth level
Fifth level

67. Questions ?