1. CALIFORNIA DEPARTMENT OF EDUCATION Tom Torlakson, State Superintendent of Public Instruction Gina Koency California Department of Education (CDE) Senior Assessment Fellow Yoon Byun Educational Testing Service March 2015 Accessing and Using the Smarter Balanced Interim Assessment Reporting System

2. TOM TORLAKSON State Superintendent of Public Instruction Presentation Purpose Familiarize LEA CAASPP coordinators and others with the following aspects of the Interim Assessment (IA) Reporting System: The results and reports available in the IA Reporting System Navigating results and reports available in the IA Reporting System Using tools and resources in the IA Reporting System to view displays and download/export data

3. TOM TORLAKSON State Superintendent of Public Instruction Presentation Topics Background Information (Purpose, Types, Security, Scoring) IA Reporting System Login and Features “List of Students” Display Individual Student Reports Download/Export Data Files Interpreting Interim Assessment Results Using Interim Assessment Results Contact Information

4. TOM TORLAKSON State Superintendent of Public Instruction Interim Assessment Purpose Designed to support educators during teaching and student learning throughout the year ‒ Measures of early and midyear progress ‒ Identification of specific areas of strength and weakness Uses are locally determined

5. TOM TORLAKSON State Superintendent of Public Instruction Interim Assessment Types Interim comprehensive assessments (ICAs) –Assess the same claims and standards as the summative assessments Interim assessment blocks (IABs) –Assess smaller sets of targets or specific areas –Allows for flexibility by selecting blocks aligned with instruction

6. TOM TORLAKSON State Superintendent of Public Instruction Interim Assessment Scoring Most items are scored by the Smarter Balanced test delivery engine. Hand scoring of constructed-response items and performance tasks is a local responsibility. Reports are generated only after the constructed- response item scores and performance task scores are input into the Interim Assessment Hand Scoring System (IAHSS). Scoring is supported by training guides, rubrics, exemplars (i.e., anchor papers), and practice papers in the IAHSS.

7. TOM TORLAKSON State Superintendent of Public Instruction Interim Blocks Not Requiring Local Hand Scoring in 2014–15 The following IABs are fully machine scored: English language arts/literacy (ELA/literacy), all grade levels: –Edit/Revise –Listen/Interpret –Research Mathematics, all grade levels: –All non-performance task blocks

8. TOM TORLAKSON State Superintendent of Public Instruction IA Reporting System Login Go to http://caaspp.org.http://caaspp.org Select “Interim Assessment Reporting System” button. Use Smarter Balanced Digital Library login (user LEA e-mail and password). Important Note! LEAs will use a different reporting system to access summative assessment results once they are available.

9. TOM TORLAKSON State Superintendent of Public Instruction IA Reporting System Login

10. TOM TORLAKSON State Superintendent of Public Instruction IA Reporting System Home Page List of Districts Search

11. TOM TORLAKSON State Superintendent of Public Instruction IA Reporting System Features By design, the IA Reporting System includes: ‒ “List of Students” display ‒ Interim assessment student reports Reports are available: ‒ Within 24 hours after student completes an IAB with no local hand scoring requirement. ‒ Within 24 hours after any required local hand scoring is completed.

12. TOM TORLAKSON State Superintendent of Public Instruction IA Reporting System Features Results for current year are available. Results exportable as a text-based file. IA student reports downloadable and printable in batch PDFs (updated nightly). Results for students who move within schools in an LEA. If a student moves to a new LEA, the student’s new LEA would need to contact the previous LEA for any prior results for that student.

13. TOM TORLAKSON State Superintendent of Public Instruction IA Reporting System User Access LEA CAASPP Coordinator can: Assign additional LEA user roles (i.e., site coordinators, TAs) access to the IA Reporting System. Important Note! Anyone with access to the IA Reporting System will have access to student Personally Identifiable Information (PII). View list of students or individual student ICA or IAB results by school, grade, or individual student. Export data file for all students within the LEA who have interim assessment results.

14. TOM TORLAKSON State Superintendent of Public Instruction IA Reporting System Results ICAs and the IABs provide individual student results that educators can examine in relation to the standards to adjust instruction. ICA: Overall scale score (i.e., 2000 to 3000); Achievement Level (Level 1, 2, 3, or 4); and Claim level (Below, At/Near, or Above Standard) IAB: Level of Below, At/Near, or Above Standard for each Block (No overall score and no achievement level for IAB.)

15. TOM TORLAKSON State Superintendent of Public Instruction “List of Students” Display Presents the following information listed by individual student name: Individual results for students within grade or subgroup. Overall scores, achievement levels, and errors bands for individual student performance (ICA only). Overall individual student performance by claim (ICA) or block (IAB).

16. TOM TORLAKSON State Superintendent of Public Instruction ICA − List of Students

17. TOM TORLAKSON State Superintendent of Public Instruction IAB − List of Students

18. TOM TORLAKSON State Superintendent of Public Instruction ICA − IA Student Report Student’s mathematics and ELA/literacy overall score and achievement level (i.e., Level 1, 2, 3, or 4). Overall score displayed surrounded by error bands, marked with brackets. (i.e., 2000 to 3000) Claim level of Below Standard, At/Near Standard, or Above Standard. List of accommodations made available to student.

19. TOM TORLAKSON State Superintendent of Public Instruction IAB − IA Student Report Block level of Below Standard, At/Near Standard, or Above Standard. Multiple blocks are provided on the same report. Current and previous results for each block are provided on the same report. Overall scores, error bands, and achievement levels NOT reported for blocks.

20. TOM TORLAKSON State Superintendent of Public Instruction ICA − IA Student Report

21. TOM TORLAKSON State Superintendent of Public Instruction ICA − IA Student Report

22. TOM TORLAKSON State Superintendent of Public Instruction IAB − IA Student Report

23. TOM TORLAKSON State Superintendent of Public Instruction Exportable Data File Exportable Excel file in text-based format includes the following fields (depends on LEA- assigned permission level/role): Overall score for mathematics or ELA/literacy Lower and upper limits of the error band Achievement level (i.e., Level 1, Level 2, Level 3, or Level 4) Claim or block level Assessment type (i.e., ICA or IAB) Accommodations made available to student Student demographic information

24. TOM TORLAKSON State Superintendent of Public Instruction Remember! Scores and achievement levels from the Smarter Balanced assessments cannot and should not be compared with data from STAR. Different standards are being assessed. Different assessment methods are being used. Different levels of cognitive rigor are being assessed.

25. TOM TORLAKSON State Superintendent of Public Instruction Interpreting Interim Assessment Results The following factors should be considered in interpreting and using interim assessment results: Purpose or intended use (e.g., pre-post lesson/unit, benchmark, new student) Conditions under which the administration took place (e.g., one-on-one, group) Test settings such as distractions, noise levels, accommodations provided Student readiness (e.g., no exposure or prior exposure/practice with same/similar content)

26. TOM TORLAKSON State Superintendent of Public Instruction Interpreting Interim Assessment Results Extent to which TAs followed and consistently used training guides, rubrics, and other scoring resources to train and hand score the constructed-response items and performance tasks. Extent to which students were taught the standards aligned to the administered ICAs and IABs

27. TOM TORLAKSON State Superintendent of Public Instruction Interpreting Interim Assessment Results ICA student reports are similar but do have one key difference with the summative assessment Individual Student Results (ISR): Achievement levels on the ICA student reports are reported as Level 1, Level 2, Level 3, or Level 4. Achievement levels on the summative assessment ISR are reported as Standard Not Met, Standard Nearly Met, Standard Met, or Standard Exceeded.

28. TOM TORLAKSON State Superintendent of Public Instruction Interpreting Interim Assessment Results In addition, keep the following in mind: Extent to which interim assessments were administered under standardized conditions will affect the interpretations. Interim assessment results should only be used in combination with other available information. Interim assessment results should not be the sole basis for making any high-stakes decisions.

29. TOM TORLAKSON State Superintendent of Public Instruction Using Interim Assessment Results Interim assessments are designed to support teaching and learning throughout the year. Results may inform: Achievement on the Common Core State Standards (when combined with other information) Identification of specific areas of strengths and weaknesses End-of-unit checks on learning

30. TOM TORLAKSON State Superintendent of Public Instruction Using Interim Assessment Results The Smarter Balanced Digital Library provides Common Core State Standards aligned resources to assist teachers in modifying instruction based on interim assessment results, including: Assessment Literacy Modules Instructional Modules Education Resources Digital Library can be accessed at: www.smarterbalancedlibrary.org/ www.smarterbalancedlibrary.org/

31. TOM TORLAKSON State Superintendent of Public Instruction Contact Information The California Technical Assistance Center (CalTAC) is available to answer your questions! Monday–Friday from 7 a.m.–5 p.m. PT E-mail: caltac@ets.orgcaltac@ets.org Phone: 800-955-2954 Web site: http://caaspp.orghttp://caaspp.org Digital Library Help Desk: 855-631-1510