2017–18 CAASPP California Spanish Assessment Pilot Test Training Video September 8, 2017 Presented by Educational Testing Service 1

Overview of the California Spanish Assessment (CSA) 2-9 Slides Topic 1 Agenda 2 Overview of the California Spanish Assessment (CSA) 2-9 Roles and Responsibilities 10-13 Technology Requirements 14-17 Using the Test Operations Management System (TOMS) 18-26 CSA Pilot Test Administration 27-42 Test Security 43-47 Completion Status Report 48-51 Teacher Involvement 52 Help Desk 53 2017–18 CSA Pilot Test Training Video

The California Spanish Assessment (CSA) Replacing the Standards-based Tests in Spanish (STS) Spanish reading/language arts (RLA) assessment Assesses three domains: Reading Writing Listening 2017–18 CSA Pilot Test Training Video

More About the CSA Based on the Common Core State Standards en Español Linear, non-adaptive Computer-based Stand-alone items and passage-based items 2017–18 CSA Pilot Test Training Video

Purpose of the CSA Support teachers Measure a student’s competency in Spanish RLA The CSA, once operational, will provide: student-level data in Spanish competency aggregate data for Spanish RLA programs high schools with a measure to be used, in part, for the State Seal of Biliteracy 2017–18 CSA Pilot Test Training Video

CSA Target Population Grades three through eight and high school Students who have learned Spanish formally or informally Includes, but is not limited to, students who: are receiving instruction in Spanish in California are seeking a measure that recognizes their Spanish-specific reading, writing, and listening skills 2017–18 CSA Pilot Test Training Video

About the CSA Pilot Test Pilot test window opens on September 18, 2017 and closes October 6, 2017 Students will take the grade band test for the grade they were in during the 2016–17 school year. Grade bands: Grades three through five Grades six through eight High school No student score reports 2017–18 CSA Pilot Test Training Video

Objective of the CSA Pilot Test Evaluate the new computer-based CSA test items Evaluate the functionality of item types in the online environment Use the feedback for the development of the CSA field test and operational assessment 2017–18 CSA Pilot Test Training Video

CSA Timeline Event Date CSA Pilot Test September 18–October 6, 2017 CSA Field Test Fall 2018 CSA Operational Assessment Spring 2019 2017–18 CSA Pilot Test Training Video

What’s Next in This Video? 2017–18 CSA Pilot Test Training Video

Roles and Responsibilities 2017–18 CSA Pilot Test Training Video

Roles and Responsibilities Available User Roles in TOMS: LEA CAASPP Coordinator Test Site Coordinator Test Administrator Test Examiner Test Administrator & Test Examiner Interim Assessment Administrator Only Educator – LEA Educator – Test Site Educator – Roster Not used for the CSA Pilot Test View-only roles 2017–18 CSA Pilot Test Training Video

User Role Guidance TOMS Pre-Administration Guide for CAASPP Testing http://www.caaspp.org/administration/instructions/ User Roles and Definitions in TOMS http://www.caaspp.org/administration/toms/toms-users.html Instructions for Adding Users http://www.caaspp.org/administration/toms/toms-upload-users.html 2016–17 User Role Guidance http://www.caaspp.org/administration/toms/ Videos: TOMS Adding Users One by One and TOMS Adding Users by Batch File Upload http://www.caaspp.org/training/caaspp/ Template for Batch Upload of Users http://www.caaspp.org/administration/toms/ 2017–18 CSA Pilot Test Training Video

Technology Requirements 2017–18 CSA Pilot Test Training Video

Technology Update Reminders: Operating Systems Desktop Operating Systems Windows XP is no longer supported. Secure Browser LEAs must update their secure browser to version 9.x. Note: Test administrator computers may use any standard, supported Web browser. iOS 9.3 and 10.0 are now supported for testing via the latest mobile secure browser. Chrome operating system is supported to version 50+. 2017–18 CSA Pilot Test Training Video

Technology Checklist Prior to test administration, LEA CAASPP coordinators with technology coordinators should: Check for a stable high-speed Internet connection (wired or wireless). Check that testing devices are working. Ensure that secure browsers are properly installed a minimum of two weeks prior to testing. Ensure that the necessary hardware is available and working (e.g., headphones, external keyboards, printers). Configure filters, firewalls, and proxy servers. Ensure that any auto updates are turned off. Updates during testing have the potential to kick students out of testing. Ensure you are using the latest mobile secure browser. 2017–18 CSA Pilot Test Training Video

Technology Resources CAASPP Secure Browsers http://ca.browsers.airast.org/ Bandwidth Checker http://www.caaspp.org/about/bandwidth-checker.html Technical Specifications and Configuration Guide for CAASPP Online Testing http://www.caaspp.org/administration/instructions/ Preparing Technology for 2016–17 CAASPP Testing Webcast http://www.caaspp.org/training/caaspp/ 2017–18 CSA Pilot Test Training Video

Using the Test Operations Management System (TOMS) 2017–18 CSA Pilot Test Training Video

Tasks to Complete in TOMS for the Pilot Test Add and manage all users. Select the fixed CSA pilot test administration window. Review student data. Demographic data from the California Longitudinal Pupil Achievement Data System (CALPADS) Assign online test setting to students. Assign students to the CSA. 2017–18 CSA Pilot Test Training Video

TOMS Student Profile Demographics All demographic data are read-only. 2017–18 CSA Pilot Test Training Video

TOMS Student Profile Demographics   TOMS Student Profile Demographics Data are read-only in TOMS; corrections must be made in CALPADS. Students’ grade levels must be correct in TOMS before the first date of the testing window. Begin reviewing students’ information on September 5. The grade level is not locked on the day the student logs onto the CSA pilot. 2017–18 CSA Pilot Test Training Video

TOMS Student Profile Demographics Do not need to file an incident report if the student begins the test in the wrong grade. If a student begins the wrong test, update the grade in CALPADS to generate the correct test. It may take 24–48 hours for the correction to be visible in TOMS. 2017–18 CSA Pilot Test Training Video

TOMS Test Administrations: Instructional Calendar Fixed CSA pilot testing window, September 18 through October 6. Must select the check box for the CSA pilot test fixed testing window. You cannot assign the test without checking the box for the fixed testing window. 2017–18 CSA Pilot Test Training Video

TOMS Test Administrations: Instructional Calendar 2017–18 CSA Pilot Test Training Video

TOMS Student Profile: Test Mode Select the check box for “California Spanish Assessment Pilot Test” to register a student. 2017–18 CSA Pilot Test Training Video

TOMS Student Profile: Test Settings 2017–18 CSA Pilot Test Training Video

TOMS Student Profile: TOMS Reminders All universal tools will be available and configurable through the test administrator interface. No condition codes 2017–18 CSA Pilot Test Training Video

TOMS Resources Test Operations Management System (TOMS) Pre-Administration Guide for CAASPP Testing Web document http://www.caaspp.org/rsc/pdfs/CAASPP.TOMS-pre- admin-guide.2016-17.pdf CAASPP Student Accessibility Resources and Test Settings Web page http://www.caaspp.org/administration/accessibility/index. html 2017–18 CSA Pilot Test Training Video

CSA Pilot Test Administration 2017–18 CSA Pilot Test Training Video

Systems and Processes for Online Administration Test Administrator Interface & Student Testing Site Administer online CSA Pilot Test TOMS Select fixed CSA pilot test administration window Verify student demographic data Assign students to the CSA pilot test CALPADS Manage student demographic data 1 2 3 2017–18 CSA Pilot Test Training Video

CSA Pilot Test Estimated Testing Times Grade Band # of Pilot Test Items Estimated Testing Time Grades 3–5 23–33 items 70–90 minutes Grades 6–8 High School 110–150 minutes 2017–18 CSA Pilot Test Training Video

Establishing Appropriate Testing Conditions Testing in classroom-sized groups is preferable: Reduces test fear and anxiety Facilitates monitoring and control for test administrators Room should have good lighting and ventilation and be free of noise and interruptions. Remove or cover displayed information that students could use to answer questions. 2017–18 CSA Pilot Test Training Video

Establishing Appropriate Testing Conditions Make appropriate seating arrangements prior to test administration. Students should be seated so that they cannot view the answers of others. Establish procedures to maintain a quiet testing environment. Some students may finish more quickly than others. 2017–18 CSA Pilot Test Training Video

Establishing Appropriate Testing Conditions Cell phones and other electronic devices must be turned off and put away during testing. Post an “Unauthorized Electronic Devices May Not Be Used at Any Time During the Testing Session” sign so that it is clearly visible to all students. Place a “TESTING—DO NOT DISTURB” sign on the door. 2017–18 CSA Pilot Test Training Video

Creating a Test Session 2017–18 CSA Pilot Test Training Video

Test Administrator Interface Found on home page of http://www.caaspp.org/. Test administrator logon 2017–18 CSA Pilot Test Training Video

Test Administrator Interface Select the appropriate CSA pilot test form. 2017–18 CSA Pilot Test Training Video

Test Administrator Interface To approve a student, select the [Approvals] button and then   Test Administrator Interface Session ID will generate in the Test Administrator Interface. To approve a student, select the [Approvals] button and then select the check mark next to the student’s name. 2017–18 CSA Pilot Test Training Video

Test Administrator Interface Universal tools can be configured through the Test Administrator Interface by selecting the icon next to the student’s information. (Add screen shots) 2017–18 CSA Pilot Test Training Video

Student Interface Enter student information to log in to the test. Review test information before beginning test. 2017–18 CSA Pilot Test Training Video

Test Rules for General Assessments Students: Must answer all test questions in a section before moving on to the next section. Must answer all test questions before the test can be submitted. May not return to a test once it has been submitted. Test administrators: Must follow the “SAY” script exactly each time a test session is administered. 2017–18 CSA Pilot Test Training Video

Pausing the CSA Pilot Test Test administrators can pause an individual student’s test without impacting other students. Students can pause their test as well but must be approved by the test administrator to enter the testing session. The general pause rules for the other CAASPP assessments also apply to the CSA pilot test. If the assessment is paused for more than 20 minutes, a student must log back on to the student interface. 2017–18 CSA Pilot Test Training Video

Test Timeout Due to Inactivity Students are automatically logged off of the test after 30 minutes of inactivity. “Activity” means selecting an answer or using a navigation option in the test (e.g., selecting [Next] or [Back], using the Questions drop-down list). Note: Moving the mouse or selecting an empty space on the screen is not considered activity. Before the system logs off, a warning message is displayed. 2017–18 CSA Pilot Test Training Video

Test Expiration Rules The CSA pilot test opportunity remains active until: Student completes and submits the test, or The test expires at the end of the fixed CSA pilot test administration window on October 6. 2017–18 CSA Pilot Test Training Video

Test Administration Resources California Spanish Assessment Online Test Administration Manual http://www.caaspp.org/rsc/pdfs/CSA.pilot- otam.2017-18.pdf 2017–18 CSA Pilot Test Training Video

Test Security 2017–18 CSA Pilot Test Training Video

Test Security and Appeals Security and Test Administration Incident Reporting System (STAIRS) requires LEA CAASPP coordinators and CAASPP test site coordinators to submit an online form to report an incident. 2017–18 CSA Pilot Test Training Video

Test Security There are three types of test security incidents: Impropriety Irregularity Breach 2017–18 CSA Pilot Test Training Video

STAIRS Incident Types for the CSA Pilot Test CSA Pilot Test STAIRS Incidents Impropriety Irregularity Breach Administration Error x   Cheating/Accessing Unauthorized Devices Disruption or Technical Issue Exposing Secure Materials Incorrect Statewide Student Identifier Used Student Disruption 2017–18 CSA Pilot Test Training Video

Test Security Resources Security and Test Administration Incident Reporting System (STAIRS) Web page http://www.caaspp.org/stairs/index.html 2017–18 CSA Pilot Test Training Video

Completion Status Reports 2017–18 CSA Pilot Test Training Video

Completion Status Reports Allow for the monitoring of testing progress for students who participate in the CSA pilot test. Help ensure all students eligible for testing begin, complete, and submit their tests. Note: Once testing is under way, users who will access the Completion Status should check the system regularly. 2017–18 CSA Pilot Test Training Video

Completion Status Reports Completion Status Reports are accessible via the CAASPP Portal for the summative and interim assessments using your TOMS logon. 2017–18 CSA Pilot Test Training Video

Completion Status Reports Resources Using Completion Status Reports to Plan and Manage Testing video http://www.caaspp.org/rsc/videos/archived- training_using-completion-status.2016.html 2017–18 CSA Pilot Test Training Video

Opportunities for Teacher Involvement Item writing Data review Item review Range-finding To get involved, complete the CAASPP Content Reviewer Application at http://caaspp.org/reviewers.html. 2017–18 CSA Pilot Test Training Video

Help Desk Support The California Technical Assistance Center is there to support all LEA CAASPP coordinators! Monday–Friday from 7 a.m.–5 p.m. PT Summative Assessments: 800-955-2954 Digital Library and Interim Assessments: 855-631-1510 E-mail: caltac@ets.org CAASPP Portal: http://www.caaspp.org/ 2017–18 CSA Pilot Test Training Video