1. CALIFORNIA DEPARTMENT OF EDUCATION Tom Torlakson, State Superintendent of Public Instruction CORE Districts Kathy Caric, Senior Assessment Fellow March 2015 Smarter Balanced Assessments Update

2. TOM TORLAKSON State Superintendent of Public Instruction Smarter Balanced Summative Assessments

3. TOM TORLAKSON State Superintendent of Public Instruction Computer Adaptive Tests Testing system selects questions appropriately challenging for student (i.e., based on student’s answer to previous questions). Most students will answer about half the questions correctly and half incorrectly. 3

4. TOM TORLAKSON State Superintendent of Public Instruction Computer Adaptive Tests (cont.) Student is not scored on the basis of the number of correct answers (or, percent correct). Student is scored on both the number of correct answers and the difficulty of the questions completed. 4

5. TOM TORLAKSON State Superintendent of Public Instruction

6. Item Types: Test Administration Manual (TAM) Appendix B 15 different item types Not all assessments will necessarily include all item types Example from TAM page 59 6

7. TOM TORLAKSON State Superintendent of Public Instruction Resources and Practices Crosswalk: Appendix E Describes accessibility resource/feature and its classroom equivalent Example from TAM page 69 7

8. TOM TORLAKSON State Superintendent of Public Instruction Entering Test Settings into TOMS Three options: Manually assign settings in TOMS Template option (similar to Field Test) CAASPP Individual Student Assessment Accessibility Profile (ISAAP) Archived Webcast and PPT: Configuring Online Student Test Settings in TOMS (PPT)Configuring Online Student Test Settings in TOMS (PPT) Archived Webcast (Video)

9. TOM TORLAKSON State Superintendent of Public Instruction Accessibility Guidelines for Classroom Activities 9 TAM page 66 Example from TAM page 66

10. TOM TORLAKSON State Superintendent of Public Instruction Accessibility Resources CDE CAASPP Smarter Balanced Accessibility and Accommodations Web page at http://www.cde.ca.gov/ta/tg/sa/access.asp http://www.cde.ca.gov/ta/tg/sa/access.asp Universal Tools, Designated Supports, and Accommodation Guidelines are located on the CAASPP.org Web site under the test administration tab at http://caaspp.org/administration/instructions/index. html http://caaspp.org/administration/instructions/index. html 10

11. TOM TORLAKSON State Superintendent of Public Instruction Usability, Accessibility and Accommodations Guidelines 11

12. TOM TORLAKSON State Superintendent of Public Instruction Practice Tests and Training Tests 12 Practice TestTraining Test Purpose Provide students with a grade specific testing experience similar in structure and format to the summative assessments Provide students with an opportunity to quickly become familiar with the software and interface features. There are no performance tasks (PTs). Grade Levels Each grade: 3–8, 11 Grade bands: 3–5 6–8 High school Number and Types of Items Approximately 30 items in ELA and 30 items in math per grade level Includes 1 ELA PT and 1 math PT per grade level Approximately 15 items per grade band (6 in ELA and 8–9 in math); PTs are not available Universal Tools, Designated Supports, and Accommodations All Scoring Results are not scored, however answer keys and scoring rubrics are availableResults are not scored

13. TOM TORLAKSON State Superintendent of Public Instruction Item Types in the Practice and Training Tests 13 Example from TAM page 61

14. TOM TORLAKSON State Superintendent of Public Instruction www.caaspp.org Accessing Practice Tests as a “Guest” 1 3 4 2

15. TOM TORLAKSON State Superintendent of Public Instruction Practice and Training Tests Resources Using the Online Practice and Training Tests archived Webcast http://caaspp.org/rsc/videos/archived- webcast_110514.html 15

16. TOM TORLAKSON State Superintendent of Public Instruction Practice and Training Test User Guide 16

17. TOM TORLAKSON State Superintendent of Public Instruction Estimated Testing Time Content AreaGrades Computer Adaptive Test (CAT) items hrs : mins Performance Task (PT) hrs : mins Total hrs : mins Classroom Activity (administered prior to the PT)* hrs : mins Total hrs : mins English Language Arts/Literacy 3–51:302:003:30:304:00 6–81:302:003:30:304:00 112:00 4:00:304:30 Mathematics 3–51:301:002:30:303:00 6–82:001:003:00:303:30 112:001:303:30:304:00 Both 3–53:00 6:001:007:00 6–83:303:006:301:007:30 114:003:307:301:008:30

18. TOM TORLAKSON State Superintendent of Public Instruction Scheduling Testing Time Recommended: CAT first, Performance Tasks second. The classroom activity should be completed within three days prior to administering a PT. ELA PTs have 2 parts and can be completed over 2 days. Mathematics PTs have 1 part and can be completed in 1 day. Recommended: PTs should not be administered on the same day as the CAT. CAT Classroom Activity Performance Task (PT)

19. TOM TORLAKSON State Superintendent of Public Instruction Assessment Results Initial results available approximately 4 weeks after completion. Full results available approximately 8 weeks after completion. Parent report approved at March 11 SBE meeting Format for additional reports in final stages of development 19

20. TOM TORLAKSON State Superintendent of Public Instruction Assessment Reporting Components Overall Scale Score and Overall Achievement Level –English language arts –Mathematics Claim Scores –Below Standard –At or Near Standard –Above Standard 20

21. TOM TORLAKSON State Superintendent of Public Instruction

23. Remember! Scores and achievement levels from the Smarter Balanced assessments cannot and should not be compared with data from the STAR Program/CSTs. Different standards are being assessed. Different assessment methods are being used. Different levels of cognitive rigor are being assessed.

24. TOM TORLAKSON State Superintendent of Public Instruction Using Assessment Results California Education Code Section 60641(a)(2) explicitly states that “State agencies or local educational agencies shall not use a comparison resulting from the scores and results of the CAASPP System assessments and the assessment scores and results from assessments that measured previously adopted content standards”.

25. TOM TORLAKSON State Superintendent of Public Instruction Preparing for Results: Key Messages This year’s results will establish a baseline for the progress we expect students to make over time. Many, if not all students, will need to make significant progress to meet the standards set for math and literacy that accompany college and career readiness. 25

26. TOM TORLAKSON State Superintendent of Public Instruction Communication Resources http://www.cde.ca.gov/ta/tg/sa/caa sppcommsb.asphttp://www.cde.ca.gov/ta/tg/sa/caa sppcommsb.asp http://www.cde.ca.gov/ta/tg/sa/sbc ommonqa.asphttp://www.cde.ca.gov/ta/tg/sa/sbc ommonqa.asp

27. TOM TORLAKSON State Superintendent of Public Instruction Summative Assessments Resources CDE CAASPP Smarter Balanced Summative Assessments Web page at http://www.cde.ca.gov/ta/tg/sa/sbacsummative.asp http://www.cde.ca.gov/ta/tg/sa/sbacsummative.asp Summative Test Administration Manuals are located on the CAASPP.org Web site under the test administration tab at http://caaspp.org/administration/instructions/index. html http://caaspp.org/administration/instructions/index. html Summative Test Administration Resources are located on the CAASPP.org Web site under the TA Resources tab at http://caaspp.org/ta- resources/index.htmlhttp://caaspp.org/ta- resources/index.html 27

28. TOM TORLAKSON State Superintendent of Public Instruction Smarter Balanced Interim Assessments

29. TOM TORLAKSON State Superintendent of Public Instruction Interim Assessments The Smarter Balanced Interim Assessments are comprised of – interim comprehensive assessments (ICAs) and – interim assessment blocks (IABs)

30. TOM TORLAKSON State Superintendent of Public Instruction Interim Assessment Security Assessments are not secure –TAs may view tests and use scoring materials for professional development purposes Assessments are not public –Not viewable or shareable with anyone who is not identified as a user in the Test Operations Management System (TOMS) 30

31. TOM TORLAKSON State Superintendent of Public Instruction Interim Assessment System Security Access to the applications required to administer the interim assessments (i.e., Test Operations Management System [TOMS], Test Administrator Interface, Interim Assessment Hand Scoring System) is restricted to LEA CAASPP coordinators, site coordinators, and TAs set as users in TOMS or the Interim Assessment Reporting System. 31

32. TOM TORLAKSON State Superintendent of Public Instruction Grades Supported by Interim Assessments Interim assessments are available for grades three through eight and for high school. Administration is not constrained by grade level.

33. TOM TORLAKSON State Superintendent of Public Instruction Eligible Grades for Interim Assessments 33 Student Grade Level ICAs and IABs for the 2014–15 School Year* K–2 Grade 3 3 Grade 3 Grade 4 4 Grade 3 Grade 4 Grade 5 5 Grade 4 Grade 5 Grade 6 6 Grade 5 Grade 6 Grade 7 7 Grade 6 Grade 7 Grade 8 8 Grade 7 Grade 8 High School 9 Grade 8 High School 10 Grade 8 High School 11 Grade 8 High School 12 Grade 8 High School *The ICAs and IABs may be accessed by a student no more than two times for the 2014– 15 school year.

34. TOM TORLAKSON State Superintendent of Public Instruction Available Blocks

35. TOM TORLAKSON State Superintendent of Public Instruction IABs for ELA, Grades 3 to 5 35 Grades 3–5 Read Literary Texts Read Informational Texts Edit/Revise Brief Writes Listen/Interpret Research *Narrative Performance Task (Grades 4–5 only in 2014–15) *Informational Performance Task *Opinion Performance Task (Grade 3 only in 2014–15) *Will be available in 2015–16

36. TOM TORLAKSON State Superintendent of Public Instruction IABs for ELA, Grades 6 to 8 36 *Will be available in 2015–16 Grade 6-8 Read Literary Texts Read Informational Texts Edit/Revise Brief Writes Listen/Interpret Research *Narrative Performance Task *Explanatory Performance Task Argument Performance Task

37. TOM TORLAKSON State Superintendent of Public Instruction IABs for ELA, High School 37 *Will be available in 2015–16 High School Read Literary Texts Read Informational Texts Edit/Revise Brief Writes Listen/Interpret Research Explanatory Performance Task *Argument Performance Task

38. TOM TORLAKSON State Superintendent of Public Instruction IABs for Mathematics Grades 3 to 5 38 IAB Name Grade 345 Operations and Algebraic Thinking  * Numbers and Operations in Base 10 *  Fractions  Geometry ** Measurement and Data  *  Mathematics Performance Task  *Will be available in 2015–16

39. TOM TORLAKSON State Superintendent of Public Instruction IABs for Mathematics Grades 6 to 7 39 IAB Name Grade 67 Ratio and Proportional Relationships  Number System *  Expressions and Equations  Geometry  * Statistics and Probability ** Mathematics Performance Task  *Will be available in 2015–16

40. TOM TORLAKSON State Superintendent of Public Instruction IABs for Mathematics Grade 8 40 *Will be available in 2015–16 (available as a single Expressions & Equations Block in 2014–15) Grade 8 *Expressions & Equations I (and Proportionality) *Expressions & Equations II Functions Geometry Mathematics Performance Task

41. TOM TORLAKSON State Superintendent of Public Instruction Interim Assessments Item Information http://www.cde.ca.gov/ta/tg/sa/sba cinterimassess.asphttp://www.cde.ca.gov/ta/tg/sa/sba cinterimassess.asp

42. TOM TORLAKSON State Superintendent of Public Instruction ICAs: Range Number of Items Total number of items –46 to 49 ELA –36-39 Mathematics Number of items requiring hand scoring –6 items ELA –0 to 4 items Mathematics

43. TOM TORLAKSON State Superintendent of Public Instruction IABs: Range of Number of Items Total number of items –12 to 18 ELA and Mathematics Number of items requiring hand scoring –0 to 6 ELA –0-4 Mathematics

44. TOM TORLAKSON State Superintendent of Public Instruction Interim Blocks Not Requiring Local Hand Scoring in 2014–15 English language arts/literacy (ELA/literacy), all grade levels: –Edit/Revise –Listen/Interpret –Research Mathematics, all grade levels: –All non-performance task blocks 44

45. TOM TORLAKSON State Superintendent of Public Instruction Use of the Interim Assessments Interim assessment results are reported locally, not to the state. Interim assessment results are not intended to be used for state and federal accountability. Results may be exported from the test management system and imported into the local student data management system.

46. TOM TORLAKSON State Superintendent of Public Instruction Interim Assessments: Key Features 46 Currently, students have two (2) opportunities to take any given Interim Assessment (ICA or IAB) for which they are eligible. For a given subject and grade, ICA and IAB include the same performance task. Interim assessments are available year- round (i.e., summer months, during the summative assessment administration).

47. TOM TORLAKSON State Superintendent of Public Instruction Accessibility Supports Universal tools, designated supports, and accommodations are modifiable on the TA Interface for the interim assessments −Provides an excellent opportunity to try out accessibility supports with students and actual test items Note: Only universal tools will be modifiable on the TA Interface for the summative assessments. 47

48. TOM TORLAKSON State Superintendent of Public Instruction Interim Assessment Reporting ICAs and the IABs provide individual student results that teachers can examine in relation to the standards in order to adjust instruction. –ICA: Overall score and classification of Below, At/Near, or Above Standard for each Claim –IAB: Classification of Below, At/Near, or Above Standard for each Block 48

49. TOM TORLAKSON State Superintendent of Public Instruction Features By design the Interim Assessment Reporting System includes: ‒ “List of Students” reports ‒ Individual student reports ‒ No aggregate reports Reports are available within 24 hours after student completes an IAB with no local hand scoring requirement or within 24 hours after any required local hand scoring is completed. 49

50. TOM TORLAKSON State Superintendent of Public Instruction Features, (cont.) Results for current year are available. Results exportable as a text-based file. Individual student reports downloadable and printable. Results accessible for students who move within schools of an LEA. Results not accessible for students who move from one LEA to another. 50

51. TOM TORLAKSON State Superintendent of Public Instruction User Access LEA CAASPP Coordinator: Assign additional LEA users (i.e., site coordinators, TAs) access to the Interim Assessment Reporting System. View list of students or individual student ICA or IAB results by school, grade, or individual student. Export data file for all students with interim assessment results. 51

52. TOM TORLAKSON State Superintendent of Public Instruction Individual Student Report − ICA 52

53. TOM TORLAKSON State Superintendent of Public Instruction Individual Student Report − ICA 53

54. TOM TORLAKSON State Superintendent of Public Instruction Individual IAB Student Report 54

55. TOM TORLAKSON State Superintendent of Public Instruction CAASPP Web Site Interim Assessment Resources 55 California Assessment of Student Performance and Progress (CAASPP) Web site at: http://www.caaspp.org Webcasts for Parts I and II and Interim Assessment Hand Scoring System Presentation: Select Training tab. Then select Current Administration. Interim Assessment Hand Scoring System password protected. Resources: Select TA Resources tab. Then select Interim Assessment Resources.

56. TOM TORLAKSON State Superintendent of Public Instruction CAASPP Web Site Interim Assessment Resources 56 PDF files for each of the Classroom Activities for the interim assessment performance tasks by grade and subject. Interim Assessment Administration Resource Guide (PDF)

57. TOM TORLAKSON State Superintendent of Public Instruction Hand Scoring System

58. TOM TORLAKSON State Superintendent of Public Instruction Interim Assessment Hand Scoring System - Login The Interim Assessment Hand Scoring System is part of the connected suite of systems (e.g., TOMS, TA Interface, Completion Status) 58

59. TOM TORLAKSON State Superintendent of Public Instruction Interim Assessment Hand Scoring System Interim Assessment Hand Scoring System allows local scoring of responses requiring human scoring. Two types of access to the system: Scorer (test administrators) Score Manager (LEA CAASPP coordinators and site coordinators) 59

60. TOM TORLAKSON State Superintendent of Public Instruction Interim Assessment Hand Scoring System Roles Scorer (test administrator) Score, view, and reassign responses assigned to them. Access to responses only from tests they have administered or items that have been assigned to them. 60

61. TOM TORLAKSON State Superintendent of Public Instruction Interim Assessment Hand Scoring System Roles (cont.) Score Manager (LEA CAASPP coordinators or site coordinators) Score items, view, and re-assign any response. Access to responses from tests within their assigned LEA or site.

62. TOM TORLAKSON State Superintendent of Public Instruction Interim Assessment Hand Scoring System Hand scoring materials contain non public material and are viewable only by local educational agency (LEA) staff who have completed a California Assessment of Student Performance and Progress (CAASPP) security agreement or affidavit. 62

63. TOM TORLAKSON State Superintendent of Public Instruction Interim Assessments Hand Scoring: Key Features Test administrators, site coordinators, and LEA CAASPP coordinators can all score using the Hand Scoring System. TA that administers the ICA or IAB may be the person to score constructed response items or performance tasks or the items may be reassigned to another scorer. 63

64. TOM TORLAKSON State Superintendent of Public Instruction Interim Assessment Hand Scoring System – Home Page 64

65. TOM TORLAKSON State Superintendent of Public Instruction Interim Assessment Hand Scoring System – Scoring Responses 65

66. TOM TORLAKSON State Superintendent of Public Instruction Interim Assessment Hand Scoring System – Scoring Responses 66

67. TOM TORLAKSON State Superintendent of Public Instruction Interim Assessment Hand Scoring System – Reassigning Responses 67

68. TOM TORLAKSON State Superintendent of Public Instruction Hand Scoring Resources

69. TOM TORLAKSON State Superintendent of Public Instruction Training Guide - ELA –Cover page: Instructions by claim –Stimulus or sources –Item stem –Rubric(s) –Condition code document –Claim and target chart

70. TOM TORLAKSON State Superintendent of Public Instruction Snapshot from Training Guide: Claims and Assessment Targets

71. TOM TORLAKSON State Superintendent of Public Instruction ELA Prep Sets The Prep Set contains 10 example student responses and scoring comments (when available). The responses are ordered high to low for score points 2, 1, and 0. Prep Sets were made using Anchor papers when available. The Prep Set is provided to help the scorer understand how the rubric and scored papers align.

72. TOM TORLAKSON State Superintendent of Public Instruction ELA Exemplars

73. TOM TORLAKSON State Superintendent of Public Instruction ELA Check Set The Check Set contains 10 randomly ordered example student responses without scores or scoring comments. Scores and scoring comments for the Check Set are provided. The Check Set is an opportunity for the scorer to practice accurate scoring. Key to Check Set Scores and scoring comments (when available).

74. TOM TORLAKSON State Superintendent of Public Instruction Training Guide - Mathematics –Cover page –Stimulus for Performance Task –Metadata table –Item stem –Dependent item stem (if applicable) –Rubric and exemplar response –Condition code document

75. TOM TORLAKSON State Superintendent of Public Instruction Mathematics Prep Set The mathematics Prep Sets contain between 5 and 10 student response papers. They are ordered as full credit, partial credit, or no credit. They include metadata, the item stem, student response(s) to dependent item(s) when applicable, student response, and scoring comments.

76. TOM TORLAKSON State Superintendent of Public Instruction Mathematics Check Set The Check Set includes between 5 and 10 student response papers. The response papers are randomly ordered. They include metadata, the item stem, student response(s) to dependent item(s) when applicable, student response, and scoring comments. Key to Check Set scores and scoring comments when available.

77. TOM TORLAKSON State Superintendent of Public Instruction End Result Materials are consistent –Across subjects –Across grades –Across item types Materials are user friendly –Training Guide: Instruction Sheet, Stimulus, Stem, Rubric, Condition Codes –Exemplars: Prep Set, Check Set, Key to Check Set Materials provide professional development resources

78. TOM TORLAKSON State Superintendent of Public Instruction Snapshot of Materials’ Location Prep and Check Sets Instructions and Information

79. TOM TORLAKSON State Superintendent of Public Instruction Interim Assessments Resources CDE CAASPP Web site: http://www.cde.ca.gov/ta/tg/sa/sbacinterimassess.asp CalTAC Training http://www.caaspp.org/training/caaspp/index.html 79

80. TOM TORLAKSON State Superintendent of Public Instruction Interim Assessment Resources (cont.) Interim Assessment Resource Guide Interim Assessment Classroom Activities http://www.caaspp.org/ta-resources/interim.html 80

81. TOM TORLAKSON State Superintendent of Public Instruction California Alternate Assessment

82. TOM TORLAKSON State Superintendent of Public Instruction Purpose of the CAA Give students with significant cognitive disabilities the opportunity to demonstrate their achievement of the Common Core State Standards (CCSS) by taking a test commensurate with their abilities. Assessed through Core Content Connectors (CCCs) that are rewritten main achievement standards from the CCSS. Provide more access to students with significant cognitive disabilities.

83. TOM TORLAKSON State Superintendent of Public Instruction CAA Update CAA field test window April 15 through June 10, 2015. Archived CAA test administration Webcast (March 11, 2015) posted on CAASPP.org. Test Administration Manual, and the content and specific grade-level directions for administration also posted on CAASPP.org

84. TOM TORLAKSON State Superintendent of Public Instruction CAA Update, (cont.) Field test administration will be a one- to-one, computer-based test administration. Testing may occur at any time during the test window. The test system will allow test administrators to start and stop the administration as often as needed to meet students’ needs and to ensure accessibility.

85. TOM TORLAKSON State Superintendent of Public Instruction CAA Update, (cont.) The technology specifications and requirements will be the same as the Smarter Balanced testing system. CAASPP LEA coordinators will be expected to upload all information on eligible CAA students into the Test Operation Management System (TOMS) beginning in March.

86. TOM TORLAKSON State Superintendent of Public Instruction For Further Information California Department of Education CAASPP Office caaspp@cde.ca.gov 916-445-8765 California Department of Education Smarter Balanced Web Pagehttp://www.cde.ca.gov/ta/tg/ca/ CAASPP.org http://caaspp.org/ 1-800-955-2954