1. CAASPP Smarter Balanced Interim Assessments
12/1/2018
CAASPP Smarter Balanced Interim Assessments
Testing Coordinator Training
2016 – 2017 V

2. California Assessment of Student Performance and Progress System
CAASPP
Smarter Balanced Assessments
Summative Assessments
Same window all grades
Interim Assessments
ALL YEAR LONG
Interim Assessment Blocks (IAB)
Interim Comprehensive Assessments (ICA)
Digital Library
California Alternate Assessment (CAA)
Same window all grades as SB
California Science Test (CAST)
Pilot Test
3/20 – 6/last day of school
Standards-Based Test in Spanish (STS)
4/5 - 5/18
REF-6656, State and National Mandated Testing Calendars for the School Year (TO BE UPDATED AFTER October 4)
REF-6755, CAASPP Program Training Requirements for
CAASPP Differential Memorandum (TO BE RELEASED)

3. Bookmark these Webpages
Critical Links
 Best Practice
Bookmark these Webpages
Interim Assessment Tabs

4. Interim Assessment School Site Testing Coordinators Training
Training Objectives
To provide School Site Testing Coordinators with a comprehensive training that will enable them to guide their school in the use of the Smarter Balanced Interim Assessments, including:
Administering the Interim Assessments
Scoring the Interim Assessments
Viewing Score Reports of the Interim Assessments

5. Interim Assessment School Site Testing Coordinator’s Training
Professional Development Topics
Test Administrator Security Affidavit and Learning Zone Class and Assessment (30 min)
Interim Assessment overview and Interim Assessment Viewing System (35-45 min)
Interim Assessment Administration (2+ sessions)
Test Security protocols (25 min)
TOMS accounts
Student logon credentials
Creating a test session in Test Administrator Interface (25-30 min)
Student logon procedures and test session management (25-30 min)
School specific testing logistics (25-30 min)
Device scheduling
Interim Assessments to be administered
Interim Assessment Hand Scoring
Training Guides and Exemplars (2+ sessions)
For instructional planning (35-45 min)
For scoring student’s Interim Assessments (30 min)
Interim Assessment Reporting System (25-30 min)

6. Smarter Balanced Interim Assessments What’s New
New and Improved Assessments
11 new Math IABs
17 new ELA IABs
Manner of Administration
Nonstandardized
Standardized/Benchmark

7. Smarter Balanced Interim Assessments What’s New
New and Improved Assessments
Over the past year, educators from across the country submitted feedback regarding how to improve the assessments. Based on these recommendations, the 2016–17 interim assessments will:
Include more unique items across the ICA and IABs
Include more IABs to measure a greater breadth of content
Include some revised IABs to measure the content with more specificity
The IAB blueprints for the 2016–17 mathematics and ELA are now available for download from the Student Testing Branch website. The blueprints provide information on the claims and targets assessed within each block, the types of items, and the Depth of Knowledge for the items.

8. Smarter Balanced Interim Assessments What’s New
How have the ELA IABs changed?
More targeted information: Edit/revise blocks have been separated to create three blocks for Grades 3–7 and high school. The revised blocks include: revision, editing, and language and vocabulary use.
New Items: Each research block is now more robust with the addition of new items. In total, over 200 new items have been added to the interims. The interim blocks available for 2016–17 are outlined below, with blocks that have been revised or added as noted:

9. Smarter Balanced Interim Assessments What’s New
How have the Mathematics IABs changed?
More Blocks: Eleven new blocks have been added that measure the following domains: Number and Operations in Base Ten, Measurement and Data, Geometry, Operations and Algebraic Thinking, The Number System, Statistics and Probability, and Expressions and Equations.
New Items: In total, 186 new items have been added to the interims. The interim blocks available for 2016–17 are outlined below, with new or revised blocks noted:

10. Smarter Balanced Interim Assessments What’s New

11. Smarter Balanced Interim Assessments What’s New
Manner of Administration ****
The Manner of Administration setting, new for the administration, is used to indicate whether or not an administration of the interim assessments will be standardized. This setting is available for use when administering both ICAs and IABs.
Note: The Manner of Administration setting is used to indicate the results to be
maintained in the IA Reporting System for potential local longitudinal analyses.
To view and set the manner of administration, select the [View] icon ( ) to display the student Test Settings screen (Figure 27).

12. Smarter Balanced Interim Assessments What’s New
Manner of Administration cont.
Two options are available for this setting: Nonstandardized and Standardized/Benchmark. The default setting is Nonstandardized. By choosing the Standardized/Benchmark administration selection, the test administrator is identifying which interim assessment results are appropriate to retain in the Interim Assessment Reporting System for potential longitudinal analyses locally. Standardized/Benchmark should be selected only if the interim assessment will be administered in a standardized manner. Results for any administrations designated Nonstandardized will be purged from the IA Reporting System at the beginning of the following school year.
Alert: LEAs may download all interim assessment results from the IA Reporting System at any time prior to the removal of these data.

13. Smarter Balanced Interim Assessments What’s New
Manner of Administration cont.
The interim assessment for a student should be marked Standardized/Benchmark only if a valid interpretation of results can be made. The exact criteria for selecting the Standardized/Benchmark option for a student is locally determined. Factors that may impact appropriateness include, but are not necessarily limited to, the extent to which:
The student has been previously exposed to the interim assessment items/form taken.
The interim assessment was administered in a consistent manner across time.

14. Smarter Balanced Interim Assessments What’s New
Manner of Administration cont.
Educators and others who make inferences based on test results should have received
adequate training in administering the interim assessments and in interpreting results.
A student with disabilities took the interim assessment in a manner consistent with the accessibility supports (e.g., accommodations) identified in their respective Individualized Education Program (IEP) or Section 504 plan, and in a manner consistent with how the student performs work for their classes.
A student identified as an English learner took the interim assessment with the necessary accessibility supports identified for use with statewide or classroom assessments.

15. Interim Assessment Purpose and Types

16. Smarter Balanced Interim Assessments
Summative assessments
benchmarked to college and career readiness
(Grades 3-8 and 11)
Teachers and schools have information and tools to improve teaching and learning
Standards set
expectations on path to college and career readiness
All students graduate college and career ready
Digital Library: Formative assessment tools and practices
for teachers to improve instruction
Interim assessments Flexible, open, used for actionable feedback

17. Interim Assessment Purpose
The Interim Assessments are one component of the Smarter Balance assessment system and are designed to support teaching and student learning throughout the year. The items are developed under the same conditions, protocols, and review procedures as those used in the summative assessments.
Not secure, but not public
Limited access to only those individuals within the District who have a professional interest in the use of the assessments

18. Interim Assessment Purpose cont.
The content of the tests have been aligned to the Common Core State Standards in grades 3–8 and high school. The grade level to assess should be based on the purpose of the testing event.
Each test can be administered to students in any grade (e.g., a grade 7 interim test is not limited to grade 7 students, but can be administered to students in grades 6 or 8).

19. Interim Assessment Types
Two types of interim assessments:
Interim Comprehensive Assessments (ICAs)
English language arts/literacy (ELA) test and performance task
Mathematics test and performance task
Interim Assessment Blocks (IABs)
There are 5 and 17 IABs per grade and content area and 28 new and improved assessment blocks

20. Smarter Balanced Interim Comprehensive Assessments (ICA)
Fixed form
Use the same blueprints and assess the same standards as the summative assessments
Include the same item types and formats, including performance tasks, as the summative assessments
Yield overall scale scores, overall achievement level designations, and claim score information
Report against the same scale as the summative test

21. Smarter Balanced Interim Comprehensive Assessments (ICA)
Examples of the use of ICAs include:
A new student from another state is given the previous year’s ICA.
Mid-year a teacher gives an ICA to gauge how students might perform on the summative assessment.

22. Smarter Balanced Interim Comprehensive Assessments (ICA)
This document is intended to assist LEA CAASPP coordinators, site coordinators, and test administrators in planning for the administration and local hand scoring of the interim comprehensive assessments (ICA). The following table provides key information, including the total number of items appearing on each ICA. This total includes items that are both machine scored and hand scored. Also included on this table are the number of items that require local hand scoring on the non-Performance Task (PT) constructed response, the PT constructed response, and the PT essay.

23. Smarter Balanced Interim Assessment Blocks (IABs)
Fixed form
Focus on fewer sets of skills (e.g., Geometry)
Flexible; supports instruction and curriculum
Include the same item types and formats, including classroom activities and performance tasks, as the summative assessments
Yield overall information for each block
Results are reported as Below Standard, At/Near Standard, and Above Standard

24. Smarter Balanced Interim Assessment Blocks (IABs)
Examples of the use of IABs include:
A teacher uses the argument performance task to determine the degree of a student’s understanding before or after instruction.
A team of teachers uses a block to become informed about how a group of students are performing in geometry.

25. Smarter Balanced Interim Assessment Blocks (IABs)
The following tables are intended to assist LEAs in planning for the administration and local hand scoring of the Interim Assessment Blocks (IAB). Included in each table are the total number of items on each IAB. The total number of items shown includes both machine scored and hand scored items. Each table also provides the number of constructed response and essay items that require local hand scoring.
The entire list of available IABs for grades
3-8 and 11 can be found at the following web link

26. Test Operations management System (TOMS) and Digital Library Accounts

27. TOMS and Digital Library Account Requirements
REF
CAASPP Program Training Requirements for
Principals
Designate CAASPP Coordinator in the Principal’s Portal
Submit electronically the Security Agreement and Security Affidavit in the Principal’s Portal
Sign a hard copy of the Security Agreement and the Security Affidavit
CAASPP Coordinators
Attend this face-to-face training and sign in
Sign and submit a hard copy of the Security Agreement and the Security Affidavit
Complete the training and assessment in the Learning Zone, “ CAASPP Security Forms Coordinator Training”
Teachers
(IA Administrator Only)
Sign a hard copy of the Security Affidavit
Complete the training and assessment in the Learning Zone, “ CAASPP Security Forms Teacher Training”
Submit a hard copy of the Security Affidavit and the Certificate for the Learning Zone class to the CAASPP Coordinator

28. TOMS ACCOUNT CREATING OR RESETTING
Teachers (IA Administrator Only)
Created by CAASPP Coordinator once security requirements have been completed as per REF (Detailed steps for creating Teacher TOMS account to follow)
If teacher TOMS account needs to be reset, teacher should first try to reset using the CAASPP logon site and clicking on the “Forgot my password” button.
If any teacher cannot reset their TOMS account, they should contact their school CAASPP Coordinator to reset their TOMS account.  If the CAASPP Coordinator isn't able to reset the teacher TOMS account, the Coordinator needs

29. Test Security and TOMS ACCOUNTS
Staff that have been granted accounts to the Smarter Balanced TOMS are permitted to access secure and confidential information and resources. Therefore:
Memorize or store account logon information in a secure location
Do not share account credentials with any other employee or person
Do not request computer to store or remember password
Do not disclose or share any secure material in any format with anyone else
Report to STB (Nancy Foote) if account is compromised

30. Interim Assessment Viewing System

31. Interim Assessment Viewing System
Teacher View enhancement is available for TOMS account holders to use for planning and or training purposes
Is accessible through the caaspp.org website

32. Preview the Tests

33. Preview the Tests cont..

34. Interim Assessment Administration

35. Universal Tools, Designated Supports and Accommodations
Can be provided to any student and are available either an embedded tool (contained within the computer testing program) or as a non-embedded tool (student uses a tangible tool such as a Thesaurus or paper dictionary).
Designated Supports
Must be designated prior to the first day of testing window
Available to ELs for whom the need has been indicated
Decision made by educators familiar with the student’s characteristics and needs
Supports the student has been using during instruction/assessments
Non-embedded supports are to be provided by the school
ELs with disabilities should have the Designated Supports and Accommodations listed on the IEP or Section 504 Plan.
Accommodations
Must always be indicated in a student’s IEP or Section 504 Plan

36. Universal Tools Universal Tools Embedded
Available to ALL students
Embedded
Breaks, Calculator, Digital Notepad, English Dictionary, English Glossary, Expandable Passages, Global Notes, Highlighter, Keyboard Navigation, Mark for Review, Math Tools, Spell Check, Strikethrough, Writing Tools, Zoom
Non-Embedded
Breaks, English Dictionary, Scratch Paper, Thesaurus

37. Designated Supports Designated Supports Embedded
Must be set in TOMS
Available for all students for whom the need has been documented
Embedded
Color Contrast, Masking, Text-to-speech, Translated Test Directions (Glossary), Translations (Stacked), Turn off Any Universal Tools
Non-Embedded
Bilingual Dictionary, Color Contrast, Color Overlay, Magnification, Read Aloud, Scribe, Separate Setting, Translated Test Directions, Translation (Glossary)

38. Accessibility Features
General guidelines for use of all accessibility features:
Student is familiar with the support(s)
Supports are same or similar to those used for instruction and classroom assessment
Student has multiple opportunities to practice in test environment

39. Sample Designated Support for
EL Student
TRANSLATIONS (STACKED)

40. Accommodations CAASPP Matrix One Accommodations
Must be set in TOMS every year
Available for all students as indicated in their IEP or Section 504 Plan
CAASPP Matrix One
The California Department of Education’s Web page displaying the universal tools, designated supports, and accommodations (embedded and non-embedded) allowed as part of CAASPP for 2015–16

41. Accommodations cont. Smarter Balanced Assessments:
Welligent Section K Roster
CAASPP Coordinator will receive from:
Elementary: APEIS
Secondary Schools: Special Education Administrator/Designee
California Alternate Assessment (CAA)
List of Accommodations for each CAA student
FAPE Part 1

42. Test Security and Student Logon Credentials
Student logon credentials (i.e.. SSID and Confirmation Code) are to be considered secure and confidential information that grant access to a student’s Personal Identifiable Information (PII). Therefore:
Schools must establish procedures to maintain all student logon credentials secure by returning them to the CAASPP Coordinator at the end of testing each day.
Schools must train all staff that will be handling student logon credentials on the established procedures and guidelines for maintaining the security of student logon credentials
Schools are to report to the Student Testing Branch if student logon credentials are compromised, using the CAASPP System—Test Administration Testing Incident or Impropriety Report Form located at the Student Testing Branch web site (form is to be faxed to )

43. Interim Assessment Administration Test Session Management

44. Interim Assessment Administration
Accessing and Administering Interim Assessments
Interim Assessments are administered in the same way as summative tests. The IA Administrator ONLY (IA) must use the TA Interface and the student must log on to the test through the secure browser.
Select the [Test Administrator
Interface] button on the CAASPP
portal at
Log onto the TA Interface
using your TOMS sign in credentials.

45. Interim Assessment Administration
Select the test to be administered:

46. Interim Assessment Administration
4. Start operational Test Session to obtain
“Session ID”:

47. Smarter Balanced Interim Assessments Manner of Administration
The Manner of Administration setting, new for the administration, is used to indicate whether or not an administration of the interim assessments will be standardized. This setting is available for use when administering both ICAs and IABs.
Note: The Manner of Administration setting is used to indicate the results to be
maintained in the IA Reporting System for potential local longitudinal analyses.
To view and set the manner of administration, select the [View] icon ( ) to display the student Test Settings screen (Figure 27).

48. Interim Assessment Hand Scoring
Part II (at a later date)

49. Interim Assessment Hand Scoring
Most interim assessment items are scored by the Smarter Balanced test delivery engine.
Hand scoring of constructed-response items and performance tasks is a local responsibility.
Results for individual students are generated only after the constructed-response item scores and performance task scores are inputted into the Interim Assessment Hand Scoring System (IAHSS). (Processing time of up to 48 hours)
Scoring is supported by training guides, rubrics, exemplars (i.e., anchor and practice papers).

50. Training Guides and Exemplars
Training Guides and Exemplars for all constructed response items and performance tasks are accessible in TOMS.
Schools can access these secure materials for professional development and training purposes.

51. Videos, Training Guides and Exemplars

52. Interim Assessment Reporting System

53. Interim Assessment Reporting System Results
Reports for lists of students and individual student reports. No aggregate reports.
ICA: Overall scale score (i.e., 2000 to 3000); Achievement Level (Level 1, 2, 3, or 4); and Claim level (Below, At/Near, or Above Standard).
IAB: Level of Below, At/Near, or Above Standard for each Block.
Exportable data file.

54. Interpreting Interim Assessment Results
The extent to which interim assessments were administered under standardized conditions will affect the interpretations.
Interim assessment results should only be used in combination with other evidence of student learning; they should not be the sole basis for making any high-stakes decisions.

55. Interim Assessment General Information

56. Interim Assessment General Information
Smarter Balanced Interim Assessments
Interim Assessment
Viewing System
TOMS
Test Administrator Interface
Interim Assessment Hand Scoring
System
Interim Assessment Reporting System
Primary Use
Select to access interim assessments for professional development and/or training purposes.
Select to access video demonstrations of interim assessment hand scoring. It includes Training Guides and Exemplars.
Select to start a test session, add tests to the session, verify students’ test settings, approve students for testing, and monitor their progress.
Select to access Interim Assessment Hand Scoring System to score Smarter Balanced Interim assessment responses that require human scoring.
Select to view interim assessment results for tests that have been scored (all required computer-scored and human-scored items must be completed).
Log-in Credentials Needed
TOMS Credentials
TOMS Credentials
Digital Library Credentials
Who creates new teacher accounts and reset teacher passwords?
CAASPP school coordinator in TOMS
Instructions: TOMS: Adding and Managing Users
CAASPP school coordinator in Digital Library
Instructions: SBAC Administration and Registration Tools User Guide
Manuals and
User Guides
n/a
TOMS: Test Administration Setup Guide
Administration of the Online Interim Tests Resource Guide
Interim Assessment Hand Scoring System User Guide
Interim Assessment Reporting System User Guide
Other Resources
ICA number of items and hand scoring requirements
IAB number of items and hand scoring requirements
Interim Assessment Reporting System Quick Start Guide

57. For More Information
CDE Interim Assessments Web Page ETS CAASPP Web Site Student Testing Branch Division of Instruction Division of Special Education ITD Comprehensive Assessment Program Coordinator Chris Mullins