1. Test Delivery System, Changes for the 2016-17 School Year
Training Module
Welcome to the Test Delivery System Changes for the School Year training module. This presentation includes details about changes found in the Test Administrator (TA) Interface and Student Interface that you will see on this year’s online tests.
Copyright © 2014 American Institutes for Research. All rights reserved.

2. Test Administrator Interface Changes
Copyright © 2014 American Institutes for Research. All rights reserved.

3. WCAG 2.0 AA Certification for Test Administrator Interface
Web Content Accessibility Guidelines (WCAG) 2.0 is a well formed technical specification for making web applications accessible to people with disabilities.
In Feb 2015, AIR achieved a AA certification for the Student Application within the Test Delivery System (TDS) which indicates that the application not only meets, but exceeds the basic needs of assistive technology and people with disabilities.
In Spring 2017, AIR will be in the process of obtaining the AA Certification for the Test Administrator Interface within TDS. Once this is done the entire TDS will be WCAG 2.0 compliant.
In Spring 2017, AIR will obtain the AA Certification for the Test Administrator Interface within the Test Delivery System (TDS). This certification indicates that the application not only meets, but exceeds, the basic needs of assistive technology and people with disabilities. This includes the availability of online testing tools, supports, and accommodations that may provide assistance and enhance the testing experience for people with disabilities. AIR has already received the AA Certification for the Student Interface within TDS. With this distinction, the Test Delivery System will be WCAG 2.0 complaint. 3

4. Increased Visibility on Segment Approvals
Students who are waiting for entry or exit approval from a segment are now identified in their own dedicated table on the approvals screen.
Label for the segment is displayed above the new table to help identify those students.
Before
After
This year, AIR has made changes to the approval process of the Test Administrator interface. For instance, students who are waiting on approval from the TA to either start the test or move onto the next segment will be identified in the Test Administrator interface with their distinct table. Also, labels for each segment will be displayed above these new tables to help identify the students waiting approval.

5. Increased Visibility on Student Approvals
Test Administrators will see students organized according to the subject matter of the assessments they are taking. This slide is an example of how the system will display. In this slide, on the left, you can see how the three students waiting for TA approval to test have been color coded according to assessment. Test Administrators may approve students individually, using the green check marks in each student’s Action column, or approve all students at once. Clicking the “Approve All Students” at once button at the top of the screen will bring up the Important pop-up window on the right side of the screen. This pop-up window gives Test Administrators one final opportunity to inspect all student assessment requests before approving.

6. Information Icon Now Available
Click on the [ i ] to get better, more accurate information for the Test Administrators to determine why a student is no longer in their exam.
Helps diagnose why a student’s test session ended (unexpectedly).
Another change this year is the addition of the ‘information icon’ on the TA interface. This icon provides accurate information to the test administrators as to why a student is no longer in their assessment. This feature will also help TA’s diagnosis why a student was kicked out of a testing session. The following two slides provide a sampling of possible ‘information icon’ messages that may appear. If a message appears that requires additional support, please contact the AIR Helpdesk via the information presented on slide 24.

7. Information Icon continued
Login: The student paused their test during the login process. They either clicked on the [Cancel] button when waiting for approval or [Return to Login] on the Test Instructions page.
Default: The system has administrative paused this student’s test. If you believe this was an error please try logging in the student again.
Manual: The student paused their test by clicking the [Pause] button.
Timeout: The test was paused because there was an extended period of inactivity on behalf of the student.
ForbiddenApps: The test was paused because one or more forbidden applications were detected while the student was taking their test. Please close any forbidden applications on that machine and have the student re-login.
ContentError: The student’s test was paused because there was a problem with an item. Please report this problem to the help desk.
The following messages may appear when selecting the information icon. Please review the following lists of potential messages.

8. Information Icon continued
ContentTimeout: The student’s test was paused because an item failed to load and the student elected not to try reloading when prompted. This could be due to a slow/busy network. Please have the student login again.
SegmentHardStopPause: The student paused their test using the button on the segment review screen.
SegmentHardStopExit: The student clicked the button to exit the segment and pause their test on the review screen.
EndTestEarly: The student clicked the end test button.
EnvironmentSecurityCompromised: The student’s test was paused because something changed in the system configuration which de-secured the testing environment.
EnvironmentSecurityDetected: The student’s test was paused because some other application stole focus away from the secure browser thus triggering a security breach event. Please close other applications and have the student re-login to the system.
Denied: The test administrator denied the student from starting or resuming the test/segment.
This slide is a continuation of the types of messages that may appear when selecting the information icon. Please review the following lists of potential messages.

9. Transferring Sessions
In the event that you have problems with your computer or web browser or need to change computers during an active test session, you can transfer the session from one computer, mobile device, or browser to another without stopping the session or interrupting in-progress tests. To transfer a test session to a new device or browser:
• Do not log out of the session you are currently in or stop the test session. If you do, you will end the test session and pause all students’ tests.
• Log in to the TA Interface on the new machine or in the new browser. A session ID prompt will appear.
• Enter the active session ID into the text box and click Enter. When the session ID is validated, you will be able to continue your test administration activities.
The test session on the previous computer or browser will close automatically. This will not stop the session or pause student tests.

10. Logging Out of the TA Interface
To log out of the TA Interface, click the Log Out button in the top right corner of the screen. It is preferable for you to log out only after stopping your active test session, as logging out will cause all in-progress tests to be paused. A confirmation message will appear, asking you to confirm that you want to exit the site and pause all students’ in-progress tests. This confirmation message may look different than the one shown here, depending on the browser you are using. This scenario also occurs when you navigate to another site from the TA Interface. However, regardless of when or how you log out or navigate away from the TA Interface, student data will not be lost. If you need to access another application, we encourage you to open it in a separate browser window.
Click Yes to proceed. When all students have completed testing, refer to the Test Administration Manual for instructions on destroying any printed testing materials and reporting testing improprieties or irregularities.

11. Student Interface Changes
Copyright © 2014 American Institutes for Research. All rights reserved.

12. DESMOS Calculators
Starting in Spring , AIR will replace currently used calculators with the DESMOS calculators. They will be available on practice and training tests as well beginning November 21. DESMOS available online:
Starting in Spring 2017, AIR will replace currently used calculators with the DESMOS calculators.
As shown in the images on this slide, all calculators will support resizing by the student. Three types of calculators will be available, depending on content area and grade level: basic, four-function; scientific; and graphing. They will be available on practice and training tests beginning November 21, The graphing calculator is also available online at desmos.com.

13. Color and Group Tests for the Student
Students will select their available tests, which will utilize the colors that have been implemented from the ‘test selection tree’ on the Test Administrator Interface
This year, AIR has carried over the color coded tests (which are available to select for TAs) over to the student interface. On the left side of this slide you can see how the tests are color organized in the TA Interface, and on the right side of the screen you can see how the tests are color organized in the student interface. The Practice and Training tests’ organizational color scheme matches between the two interfaces.
The Interim Smarter Balanced Assessments will all be yellow, the Summative Smarter Balanced Assessments will all be blue, and the MSP Science test will be green. Students still need to take care to select the correct test within those colors if more than one test has been selected in the TA Interface.

14. Stimulus Expansion Tool
This year, students may encounter passages/stimuli that have the expandable feature available. This tool can expand and contract the stimuli/passage with the selection of the two faced arrows graphic. The graphic located toward the upper left corner shows a passage/stimuli that is capable of expanding, and the graphic to the lower right of the slide shows that same passage after it has been expanded.

15. Science Collapsing Stimuli
Some science item sets have Collapsing Stimuli on the left side of the screen. This can be two or more different stimuli sections. The first screen contains stimulus Section 1 paired with a set of questions. Once all the questions on this screen are answered, the student will select the Next button to move to a second screen. The student will see the Section 1 stimulus “collapsed” above the Section 2 stimulus and more questions. A student may select the plus symbol to have Section 1 expand if Section 1 information is needed to answer the questions associated with Section 2. Section 1 can be collapsed again by selecting the minus symbol.

16. Item Badges
Item badges mark the item with a small icon to represent a specific task: Item marked for review, Item has some notes associated with it, and/or the Item has been printed or embossed.
We have included item badges this year within the Test Delivery System. Item badges act as status indicators for individual test items. These badges may appear next to the item when an item is marked for review, notes are taken, items have been locked (see next slide) or when test items have been printed or embossed. In the graphic on this slide, the test item has two flags that indicate the test item has been marked for review, and also has test notes.
These Item Badge enhancements are accessible for JAWS users too.
The only item badge that appears on the segment/test review screens this year will be the "Mark for Review"; the rest of the icons will not show up on the segment/test review screens this year.

17. Locking Items
Prevents the student from responding to an item more than once. Once complete the student will not be permitted to return to the item
Available on science tests
Another new feature, which appears as an item badge, is the locking item. A green lock symbol will appear – in the same space that test item badges appear – to indicate that the test item can only be answered once. When the student selects the Next button to move to the next page of items, an “Attention” dialogue box will appear to give a final warning before the test item is locked. Students should select "No" to return to the item and make any last changes. Once the student selects "Yes," their response to the item will be locked. If they return to this item later, the green lock will be red and the answer space will be grayed out. The student will not be able to change their response.
Students will find this enhancement on the spring science tests.

18. Transcriptions Accommodation for Audio Stimuli
Uses the transcriptions provided for closed captioning to show the text on the screen.
The transcriptions will appear by clicking on a button on the audio player. It will open in a new movable window.
The transcription accommodation is intended to overcome two problems:
Deaf and blind students cannot hear the audio or see the closed captions on the screen so they have no way to access this content. The only option for these students is to read the braille interpretation of the audio. Instead of embossing this (which would take time) we can output the content to the Refreshable Braille Display c/o JAWS by placing the text on the screen.
For deaf students who are just learning how to read sign language or possibly for cases where a student cannot make out what sign an interpreter is using they will need some on-screen text to reference. This currently does not exist for audio stimuli, but can with this accommodation.
The transcription accommodation is accessed by clicking on a button in the audio player, which will open a new, movable window.

19. Video Playback Controls
Added all common video playback functionality such as a scrubber, mute/unmute, and full screen.
New option to change the playback rate (slower or faster) is especially helpful for students needing ASL.
AIR has added in additional, common playback features for videos in online tests. These features and functions that are normally associated with video playback, specifically, scrubbing, muting, and full screen viewing, have all been added for assessment video playback. Also, there is a new option of hastening or slowing the video playback rate; this should be especially useful to students who have ASL as a designated support.

20. Mouse Pointers Available Larger and with Different Colors
Large White
Extra Large White
Large Black
Extra Large Black
Large Red
Extra Large Red
Large Green
Extra Large Green
Large Yellow
Extra Large Yellow
This year, students will have the option to have different colored and sized mouse pointers for online tests. Students that are visually impaired, or otherwise in need of this embedded designated support, can choose from the list of appearances for the mouse pointer icon, included on the slide.

21. Generic Resource
Add support for generic item specific resources like graph data, z-tables, mock web pages, the periodic table, or other additional information students may use to answer a question.
Example: A mathematics Claim 4 item assessing Target G: Identify, analyze and synthesize relevant external resources to pose or solve problems.
Generic Resources are available in test items that are designed to allow students to access additional information students can use to answer the question. Text in the item will direct students to use the resource. This is a new feature and very few items utilize this tool yet.

22. Larger Zoom Levels
In addition to the old levels, AIR has added levels 5X, 10X, 15X and 20X
In addition to the previous zoom levels, AIR has added 5X, 10X, 15X and 20X the normal font size. On the left side of this slide is a test page at the normal zoom level of 1x. The right side of the slide has a test page that has been set to 10x the normal zoom. Please note, these levels (from 5x to 20x) will require that the student settings be selected in TIDE, under ‘streamlined interface mode’ in order to adjust the screen. The first 3 levels of zoom can (1x, 1.5x, and 1.75x) still be controlled by the student using the zoom buttons in their test, and do not require any selection in TIDE.

23. Troubleshooting Description What to Do
What should I do if a session ends?
Log in and start a new session. Provide the students with a new session ID.
What should I do if a student gets logged out of a test while a session is still active?
If a student’s test session is interrupted, the student should log back in and rejoin the session.
What should I do if forbidden applications are running?
The secure browser will not allow the student to begin testing if forbidden applications are running. You will see messages advising you which applications must be closed before testing can begin.
What should I do if a student’s test freezes?
Force quit the secure browser and log back in. For instructions, refer to the Test Administration Manual.
This table presents some of the common issues that you or your students may encounter during a test session. Please take a moment to review this information. For more detailed information and additional technical tips, please refer to the Test Administration Manual and the Technical Specifications Manual for Online Testing.

24. Thank You! Further Information School staff contact their DAs or DCs.
DCs and/or DAs contact:
OSPI Assessment Operations for testing protocol or policy decisions
Washington Help Desk, American Institutes for Research for technical questions or issues (Tel ,
Thank you for taking the time to view this training module. For detailed information, consult the Test Administrator Manual located on the WCAP portal.
School staff should refer questions to the your District Administrators or District Test Coordinator.
District Test Coordinators or District Administrators:
Direct questions regarding state policy decisions and testing protocols to the OSPI Assessment Operations team at
Direct technical questions to the American Institutes for Research Washington Help Desk at or

25. Revision Log
Updates to the Module after October 17, 2016 are noted below.
Section
Slide
Description of Change
Revision Date
If updates are needed throughout the school year, they will be outlined on this revision log and communicated in the WAW newsletter.