1. 2017–18 CAASPP California Spanish Assessment Pilot Test Training Video
September 8, 2017
Presented by
Educational Testing Service 1

2. Overview of the California Spanish Assessment (CSA) 2-9
Slides
Topic 1
Agenda 2
Overview of the California Spanish Assessment (CSA)
2-9
Roles and Responsibilities
10-13
Technology Requirements
14-17
Using the Test Operations Management System (TOMS)
18-26
CSA Pilot Test Administration
27-42
Test Security
43-47
Completion Status Report
48-51
Teacher Involvement 52
Help Desk 53
2017–18 CSA Pilot Test Training Video

3. The California Spanish Assessment (CSA)
Replacing the Standards-based Tests in Spanish (STS)
Spanish reading/language arts (RLA) assessment
Assesses three domains:
Reading
Writing
Listening
2017–18 CSA Pilot Test Training Video

4. More About the CSA Based on the Common Core State Standards en Español
Linear, non-adaptive
Computer-based
Stand-alone items and passage-based items
2017–18 CSA Pilot Test Training Video

5. Purpose of the CSA Support teachers
Measure a student’s competency in Spanish RLA
The CSA, once operational, will provide:
student-level data in Spanish competency
aggregate data for Spanish RLA programs
high schools with a measure to be used, in part, for the State Seal of Biliteracy
2017–18 CSA Pilot Test Training Video

6. CSA Target Population Grades three through eight and high school
Students who have learned Spanish formally or informally
Includes, but is not limited to, students who:
are receiving instruction in Spanish in California
are seeking a measure that recognizes their Spanish-specific reading, writing, and listening skills
2017–18 CSA Pilot Test Training Video

7. About the CSA Pilot Test
Pilot test window opens on September 18, and closes October 6, 2017
Students will take the grade band test for the grade they were in during the 2016–17 school year.
Grade bands:
Grades three through five
Grades six through eight
High school
No student score reports
2017–18 CSA Pilot Test Training Video

8. Objective of the CSA Pilot Test
Evaluate the new computer-based CSA test items
Evaluate the functionality of item types in the online environment
Use the feedback for the development of the CSA field test and operational assessment
2017–18 CSA Pilot Test Training Video

9. CSA Timeline Event Date CSA Pilot Test September 18–October 6, 2017
CSA Field Test
Fall 2018
CSA Operational Assessment
Spring 2019
2017–18 CSA Pilot Test Training Video

10. What’s Next in This Video?
2017–18 CSA Pilot Test Training Video

11. Roles and Responsibilities
2017–18 CSA Pilot Test Training Video

12. Roles and Responsibilities
Available User Roles in TOMS:
LEA CAASPP Coordinator
Test Site Coordinator
Test Administrator
Test Examiner
Test Administrator & Test Examiner
Interim Assessment Administrator Only
Educator – LEA
Educator – Test Site
Educator – Roster
Not used for the CSA Pilot Test
View-only roles
2017–18 CSA Pilot Test Training Video

13. User Role Guidance
TOMS Pre-Administration Guide for CAASPP Testing
User Roles and Definitions in TOMS
Instructions for Adding Users
2016–17 User Role Guidance
Videos: TOMS Adding Users One by One and TOMS Adding Users by Batch File Upload
Template for Batch Upload of Users
2017–18 CSA Pilot Test Training Video

14. Technology Requirements
2017–18 CSA Pilot Test Training Video

15. Technology Update Reminders: Operating Systems
Desktop Operating Systems
Windows XP is no longer supported.
Secure Browser
LEAs must update their secure browser to version 9.x.
Note: Test administrator computers may use any standard, supported Web browser.
iOS 9.3 and 10.0 are now supported for testing via the latest mobile secure browser.
Chrome operating system is supported to version 50+.
2017–18 CSA Pilot Test Training Video

16. Technology Checklist
Prior to test administration, LEA CAASPP coordinators with technology coordinators should:
Check for a stable high-speed Internet connection (wired or wireless).
Check that testing devices are working.
Ensure that secure browsers are properly installed a minimum of two weeks prior to testing.
Ensure that the necessary hardware is available and working (e.g., headphones, external keyboards, printers).
Configure filters, firewalls, and proxy servers.
Ensure that any auto updates are turned off. Updates during testing have the potential to kick students out of testing.
Ensure you are using the latest mobile secure browser.
2017–18 CSA Pilot Test Training Video

17. Technology Resources
CAASPP Secure Browsers
Bandwidth Checker
Technical Specifications and Configuration Guide for CAASPP Online Testing
Preparing Technology for 2016–17 CAASPP Testing Webcast
2017–18 CSA Pilot Test Training Video

18. Using the Test Operations Management System (TOMS)
2017–18 CSA Pilot Test Training Video

19. Tasks to Complete in TOMS for the Pilot Test
Add and manage all users.
Select the fixed CSA pilot test administration window.
Review student data.
Demographic data from the California Longitudinal Pupil Achievement Data System (CALPADS)
Assign online test setting to students.
Assign students to the CSA.
2017–18 CSA Pilot Test Training Video

20. TOMS Student Profile Demographics
All demographic data are read-only.
2017–18 CSA Pilot Test Training Video

21. TOMS Student Profile Demographics
TOMS Student Profile Demographics
Data are read-only in TOMS; corrections must be made in CALPADS.
Students’ grade levels must be correct in TOMS before the first date of the testing window.
Begin reviewing students’ information on September 5.
The grade level is not locked on the day the student logs onto the CSA pilot.
2017–18 CSA Pilot Test Training Video

22. TOMS Student Profile Demographics
Do not need to file an incident report if the student begins the test in the wrong grade.
If a student begins the wrong test, update the grade in CALPADS to generate the correct test.
It may take 24–48 hours for the correction to be visible in TOMS.
2017–18 CSA Pilot Test Training Video

23. TOMS Test Administrations: Instructional Calendar
Fixed CSA pilot testing window, September 18 through October 6.
Must select the check box for the CSA pilot test fixed testing window.
You cannot assign the test without checking the box for the fixed testing window.
2017–18 CSA Pilot Test Training Video

24. TOMS Test Administrations: Instructional Calendar
2017–18 CSA Pilot Test Training Video

25. TOMS Student Profile: Test Mode
Select the check box for “California Spanish Assessment Pilot Test” to register a student.
2017–18 CSA Pilot Test Training Video

26. TOMS Student Profile: Test Settings
2017–18 CSA Pilot Test Training Video

27. TOMS Student Profile: TOMS Reminders
All universal tools will be available and configurable through the test administrator interface.
No condition codes
2017–18 CSA Pilot Test Training Video

28. TOMS Resources
Test Operations Management System (TOMS) Pre-Administration Guide for CAASPP Testing Web document
admin-guide pdf
CAASPP Student Accessibility Resources and Test Settings Web page
html
2017–18 CSA Pilot Test Training Video

29. CSA Pilot Test Administration
2017–18 CSA Pilot Test Training Video

30. Systems and Processes for Online Administration
Test Administrator Interface & Student Testing Site
Administer online CSA Pilot Test
TOMS
Select fixed CSA pilot test administration window
Verify student demographic data
Assign students to the CSA pilot test
CALPADS
Manage student demographic data 1 2 3
2017–18 CSA Pilot Test Training Video

31. CSA Pilot Test Estimated Testing Times
Grade Band
# of Pilot Test Items
Estimated Testing Time
Grades 3–5
23–33 items
70–90 minutes
Grades 6–8
High School
110–150 minutes
2017–18 CSA Pilot Test Training Video

32. Establishing Appropriate Testing Conditions
Testing in classroom-sized groups is preferable:
Reduces test fear and anxiety
Facilitates monitoring and control for test administrators
Room should have good lighting and ventilation and be free of noise and interruptions.
Remove or cover displayed information that students could use to answer questions.
2017–18 CSA Pilot Test Training Video

33. Establishing Appropriate Testing Conditions
Make appropriate seating arrangements prior to test administration.
Students should be seated so that they cannot view the answers of others.
Establish procedures to maintain a quiet testing environment.
Some students may finish more quickly than others.
2017–18 CSA Pilot Test Training Video

34. Establishing Appropriate Testing Conditions
Cell phones and other electronic devices must be turned off and put away during testing.
Post an “Unauthorized Electronic Devices May Not Be Used at Any Time During the Testing Session” sign so that it is clearly visible to all students.
Place a “TESTING—DO NOT DISTURB” sign on the door.
2017–18 CSA Pilot Test Training Video

35. Creating a Test Session
2017–18 CSA Pilot Test Training Video

36. Test Administrator Interface
Found on home page of
Test administrator logon
2017–18 CSA Pilot Test Training Video

37. Test Administrator Interface
Select the appropriate CSA pilot test form.
2017–18 CSA Pilot Test Training Video

38. Test Administrator Interface
To approve a student, select the [Approvals] button and then  
Test Administrator Interface
Session ID will generate in the Test Administrator Interface.
To approve a student, select the [Approvals] button and then select the check mark next to the student’s name.
2017–18 CSA Pilot Test Training Video

39. Test Administrator Interface
Universal tools can be configured through the Test Administrator Interface by selecting the icon next to the student’s information.
(Add screen shots)
2017–18 CSA Pilot Test Training Video

40. Student Interface Enter student information to log in to the test.
Review test information before beginning test.
2017–18 CSA Pilot Test Training Video

41. Test Rules for General Assessments
Students:
Must answer all test questions in a section before moving on to the next section.
Must answer all test questions before the test can be submitted.
May not return to a test once it has been submitted.
Test administrators:
Must follow the “SAY” script exactly each time a test session is administered.
2017–18 CSA Pilot Test Training Video

42. Pausing the CSA Pilot Test
Test administrators can pause an individual student’s test without impacting other students.
Students can pause their test as well but must be approved by the test administrator to enter the testing session.
The general pause rules for the other CAASPP assessments also apply to the CSA pilot test.
If the assessment is paused for more than 20 minutes, a student must log back on to the student interface.
2017–18 CSA Pilot Test Training Video

43. Test Timeout Due to Inactivity
Students are automatically logged off of the test after 30 minutes of inactivity.
“Activity” means selecting an answer or using a navigation option in the test (e.g., selecting [Next] or [Back], using the Questions drop-down list).
Note: Moving the mouse or selecting an empty space on the screen is not considered activity.
Before the system logs off, a warning message is displayed.
2017–18 CSA Pilot Test Training Video

44. Test Expiration Rules
The CSA pilot test opportunity remains active until:
Student completes and submits the test, or
The test expires at the end of the fixed CSA pilot test administration window on October 6.
2017–18 CSA Pilot Test Training Video

45. Test Administration Resources
California Spanish Assessment Online Test Administration Manual
otam pdf
2017–18 CSA Pilot Test Training Video

46. Test Security
2017–18 CSA Pilot Test Training Video

47. Test Security and Appeals
Security and Test Administration Incident Reporting System (STAIRS) requires LEA CAASPP coordinators and CAASPP test site coordinators to submit an online form to report an incident.
2017–18 CSA Pilot Test Training Video

48. Test Security There are three types of test security incidents:
Impropriety
Irregularity
Breach
2017–18 CSA Pilot Test Training Video

49. STAIRS Incident Types for the CSA Pilot Test
CSA Pilot Test STAIRS Incidents
Impropriety
Irregularity
Breach
Administration Error x
Cheating/Accessing Unauthorized Devices
Disruption or Technical Issue
Exposing Secure Materials
Incorrect Statewide Student Identifier Used
Student Disruption
2017–18 CSA Pilot Test Training Video

50. Test Security Resources
Security and Test Administration Incident Reporting System (STAIRS) Web page
2017–18 CSA Pilot Test Training Video

51. Completion Status Reports
2017–18 CSA Pilot Test Training Video

52. Completion Status Reports
Allow for the monitoring of testing progress for students who participate in the CSA pilot test.
Help ensure all students eligible for testing begin, complete, and submit their tests.
Note: Once testing is under way, users who will access the Completion Status should check the system regularly.
2017–18 CSA Pilot Test Training Video

53. Completion Status Reports
Completion Status Reports are accessible via the CAASPP Portal for the summative and interim assessments using your TOMS logon.
2017–18 CSA Pilot Test Training Video

54. Completion Status Reports Resources
Using Completion Status Reports to Plan and Manage Testing video
training_using-completion-status.2016.html
2017–18 CSA Pilot Test Training Video

55. Opportunities for Teacher Involvement
Item writing
Data review
Item review
Range-finding
To get involved, complete the CAASPP Content Reviewer Application at
2017–18 CSA Pilot Test Training Video

56. Help Desk Support
The California Technical Assistance Center is there to support all LEA CAASPP coordinators!
Monday–Friday from 7 a.m.–5 p.m. PT
Summative Assessments:
Digital Library and Interim Assessments:
CAASPP Portal:
2017–18 CSA Pilot Test Training Video