1. Test Delivery System (TDS) & Online Reporting System (ORS) for ELPA21 Online Testing
Training Webinar
Welcome to today’s webinar on the Test Delivery System (TDS) & Online Reporting System (ORS) . This webinar is designed to help you understand the Test Administrator and Student Interfaces used during online testing, as well as the Online Reporting System (ORS) used to view participation reports. Individual states’ systems may vary. Please consult your state documentation for more information. The presentation is estimated to take about 60 minutes.
Copyright © 2014 American Institutes for Research. All rights reserved.

2. Objectives After viewing this presentation, you should be able to:
Use the TA Interface to start and run a test session
View student test settings and accessibility resources
Monitor the testing process
Pause and stop a test session
Print test session information
Exit and log out of the TA Interface
Navigate the Online Reporting System
View participation reports
After viewing this presentation, you should be able to:
Use the TA Interface to start and run a test session
View student test settings and accessibility resources
Monitor the testing process
Pause and stop a test session
Print test session information
Exit and log out of the TA Interface
Navigate the Online Reporting System
View participation reports
Please note: The navigation instructions that follow are from the viewpoint of a Windows PC user with a two-button mouse. Your steps may vary depending upon the device and operating system you are using.

3. What Is the Secure Browser?
The secure browser is designed to ensure test security by prohibiting students from accessing any other programs or websites during testing.
TAs may access the Teacher Interface through any supported internet browser to administer tests. However, students must use the secure browser to log in to the Student Interface.
The secure browser is designed to ensure test security by prohibiting students from accessing any other programs or websites during testing. Your school’s Technology Coordinator is responsible for ensuring that the secure browser has been correctly installed on all testing devices. If you have questions about the secure browser, contact your Technology Coordinator.
Please note that the iOS secure browser will not be available for testing when the Training tests open on January 11 due to updates that are needed to support ELPA21 testing. This will be update prior to the launch of the Operational tests. A communication will be sent out with additional information on when this update will be made. All other secure browsers will be available when the ELPA21 Training tests go live on January 11. This only affects students testing with the iOS secure browser.
If you have questions about the secure browser, contact your Technology Coordinator.

4. TA Interface: Overview
To access the TA Interface, TAs should first navigate to your state’s portal and select your user role. On the following page, users should select the card for “Operational Test Administration” and log in using their and password.
Once the TA has logged in, he or she will see the TA Interface with the Test Selection window open by default. From the TA Interface, you can access the features you need to create and manage test sessions, look up students, and access help information. We will begin with an overview of the interface.

5. TA Interface: Overview (continued)
When a user first logs in to the TA Interface, the Test Selection window appears automatically. This window closes when the TA starts the session.
After starting a session, the session ID appears at the top of the TA Interface along with a [Stop] button. When students start signing in to the test session, an [Approvals] button also appears next to the session ID. Once the TA approve students for testing, the Test Session table appears in the center of the TA Interface, displaying students’ testing progress.
Additional features are available in the banner at the top of the screen.

6. Create a Test Session
The first step in administering a test is to create a test session. This should be done less than 20 minutes prior to starting the test in order to prevent the system from timing out. The list of students in the session will generate automatically when the students log in to the session.
You create test sessions in the Test Selection window that appears when you log in. To create a testing session, click the test(s) you wish to administer. You may select all available tests listed, for all grade levels and all content areas. Be assured that students will only have access to the tests that the TA has selected for them. 
Once you select your tests, the [Start Session] button in the lower-left corner of the window activates. Click the [Start Session] button. Please note, the exact name of this button may vary by state and session type (practice or operational).The system will automatically generate a session ID. This ID must be provided to students in order for them to log in. The TA may write it on the board or provide it to students using a printed card or similar method. If you do provide students with the information on paper, be sure to collect and destroy it when the session is complete.
You should also note the session ID for your own records. In the event that you are involuntarily logged out of the session due to an inactivity timeout or other event, entering the session ID will allow you to resume the session. If you do not have this information when you try to resume, you will be unable to do so.

7. Student Lookup
If a student is having trouble logging in, use the Student Lookup feature to verify that the student’s login credentials are correct. You can use either the [Quick Search] or [Advanced Search] option to view the information entered in TIDE for the student. With [Quick Search], you simply enter the student’s SSID and click the [Submit SSID] button. [Advanced Search] allows you to narrow your search using several filters, including District/School, Grade, and First and Last Name.
When using either [Quick Search] or [Advanced Search], if the search results in matches, the information will appear in the bottom of the window. If there is no match, you will see an error message. If you see the student you are looking for, click the [Eye] button next to the student’s name. A new window displaying the student’s information will display. Note that the information displayed may vary slightly from what is shown here.
On the next few slides, we will look at what students see when they log in to take a test.

8. Student Login
To log in to the online testing system using the secure browser, students must enter three pieces of identifying information: their first name, their state-assigned student identifier (SSID), and the current session ID.
When entries are complete, students will click the [Sign In] button to log in to the test. The TA may assist students with logging in, if necessary.
The session ID is generated when the Test Administrator creates the test session. It needs to be given to students by the TA when it is time for them to log in to the test. Session IDs should not be generated more than 20 minutes before students are ready to log in.

9. Login Errors Issue Error Message What to Do
Student first name and SSID do not match what is in the system, or student omits 2-letter state abbreviation and/or hyphen from SSID.
Please check that your information is entered correctly. If you need help, ask your TA.
Verify that the student has entered the correct first name and SSID, including the state abbreviation and hyphen, if required. You may need to use the Student Lookup Tool, which is located in the TA Interface, to verify that the student is in the system.
Student enters the session ID incorrectly.
The session is not available for testing.
Verify that the student has entered the correct Session ID with no extra spaces or characters.
Student enters an SSID for an incorrect or expired session.
Session has expired.
Ensure that the student enters the correct Session ID for the current session. If this does not work, verify that your session is open using the TA interface.
If a student is having difficulty logging in, an error message and code will display on the login screen. The most common errors occur when the student’s first name and SSID do not match what is in the system and when SSIDs are entered incorrectly. If the student receives an error message indicating that he or she has entered incorrect information in the first name or SSID fields, the TA should use the Student Lookup Tool in the TA Interface to verify the student’s information.
Another common error occurs when the student enters an incorrect session ID. If a student receives the message “The session is not available for testing”, verify that the session ID was entered correctly, with no extra spaces or characters. The session ID can be found in the TA Interface. If a student receives the error message “Session has expired,” ensure that the student has entered the correct session ID for the current session. If the student has entered the session ID correctly, use the TA Interface to verify that your session is still open.  

10. Student Login and Test Selection
After logging in, students need to complete a few more steps before they begin testing. Students will be asked to view and verify their personal information. If their information is correct, they should click [Yes] to proceed to the “Your Tests” screen. If their information is incorrect, they should click [No] to return to the login page. TAs must then contact their School or District Test Coordinator to have the student information updated in the Test Information Distribution Engine (TIDE) before the student attempts to log in again.

11. Student Login and Test Selection
On the “Your Tests” screen, students will see a list of their assigned tests for this test session. If the tests displayed are incorrect, or the expected test is not listed, students should click the [Back to Login] button to return to the login page, and consult the Test Administrator to resolve the issue. If a test has already been completed, the test selection button will be grayed out. Students should select the correct test and wait for TA approval to proceed.

12. Login Confirmation
After the Test Administrator has approved students for a test session, students will see a screen titled “Is This Your Test?” This screen displays the name of the test and whether or not any accessibility resources have been selected. If the information is correct, they should click [Yes, Start My Test]. If any of the information is incorrect, they should click [No] and then wait to be advised by the TA. Note that the actual settings students see may vary from what is shown on this slide. Be sure to refer to the scripts located in the Test Administration Manual (TAM) to guide students through the login and confirmation process.

13. Sound Check
Be sure that all students taking ELPA21 tests have headphones. After selecting a test requiring audio, students will see a “Sound Check” screen. They will be prompted to click the sound icon and indicate whether the sound was audible by choosing either the [No] or [Yes] button.
If students click [Yes], they will proceed to the test. If they click [No], they will receive a message advising them to tell the Test Administrator that they are having an audio problem. From there, they can click [Try Again] to listen to the sample audio again or click [Logout] to leave the test and work with the TA to adjust their audio settings.

14. Microphone Check
Be sure that all students taking ELPA21 tests have headphones and microphones. After verifying the test audio is functioning, students taking ELPA21 tests will need to verify their microphones are functioning as well. They must click the microphone icon on this screen, record their name, stop the recording, and then play the recorded audio. If the recorded audio is clear, students click [Yes]. If it is not clear, students click [Problem (No)].
If Students click [Yes], they will proceed to the test. If they click [Problem (No)], they will receive a message advising them to tell the Test Administrator about the microphone problem. From there, they can click [Try Again] to record an audio sample again or click [Logout] to leave the test and work with the TA to adjust their microphone settings.

15. Approving Student Entry
Let’s return to the Teacher Administrator Interface, which shows all students in the session who are ready to start their test.
Once the TA starts the test session and students log in, he or she must approve their test settings before they can access their tests. It is very important to pay close attention to the test name prior to approving to be sure that students selected the appropriate test. You can do this by clicking the [Approvals] button. A list of students will display, organized by test name. The TA should review the list to make sure that all students chose the correct content area and test. The TA should also ensure that all of the settings that each student should have are correct. This is done using the [Eye] button in the See Details column. These test settings must be set up by an authorized user in TIDE prior to testing. See the TIDE User Guide for more information.
If no changes are needed, select [Approve All Students] to admit all students to the session. If a student selected an incorrect test, you must deny that student entry to the test session by clicking the [X] button in the Action column.

16. Denying Student Entry
Deny entry to a test session in these circumstances:
The student is not supposed to enter this session.
The student’s demographic information is incorrect.
The student’s required accommodations are incorrect.
Although you can approve all students at the same time, students must be individually denied entry into the test session.
The TA should deny students entry into the session in these circumstances:
• The student is not supposed to enter this session.
• The student’s demographic information is incorrect.
• The student’s required accommodations are incorrect.
Denying the student entry into the test session will not prevent other approved students from beginning their tests.
If the student’s test settings are incorrect, the settings must be updated in TIDE or the TA Interface before the student takes the test. Test Administrators should contact their School or District Test Coordinator to have the settings updated. This will prevent resetting the test for the student later.
Note that no settings can be changed while the student is actively testing. Once a student begins testing, the language option cannot be changed without resetting the test opportunity. Updates to background color or font size will take effect only after the student logs out and resumes testing.

17. Accessibility Resources
Universal tools
Designated supports
Accommodations
The online tests offer several accessibility resources to help students test successfully. These include universal tools, designated supports, and accommodations.
Universal tools available for all students include the ability to:
Access the Test Instructions and Help screen at any time
Navigate among pages using the Back and Next arrow buttons
Save your answers before moving to the next question, if desired
Pause the test
Zoom In and Zoom Out of test pages
Authorized users can use the Test Information Distribution Engine (TIDE) to manage accessibility resources for students.
For more information on managing accessibility resources in TIDE, refer to the TIDE User Guide. For detailed information about individual accessibility resources, refer to the Guidelines on Tools, Supports, and Accommodations for ELPA21 located on the WCAP portal and on the OSPI website at

18. Navigating Through the Test
Four Segments
Listening
Reading
Writing
Speaking
TA approval is required for beginning the test and the Speaking segment.
ELPA21 is administered as a single test with four segments (Listening, Reading, Writing, and Speaking). Students require TA approval to begin the test and to begin the Speaking segment of the test. Students are able to begin the Listening, Reading and Writing segments without TA approval.

19. Test Items: Example of an Interactive Item
Students will encounter several types of items during testing. To answer selected-response items, students must click the desired answer option so that the letter A, B, C, or D becomes shaded. For interactive items, students need to follow the instructions given to know how to indicate their answer. For example, students may be told to click an object to identify the appropriate answer, drag pictures or words in a table, or click on a keypad. If they wish, students may click the [Save] button while working on interactive items to save their work. Regardless of whether they click [Save] or not, their answers will save automatically when they navigate to the next part of the test. After answering all items on a page, the student will click [Next] to go on.

20. Item Tutorial
Students can use the Item Tutorial tool to get more information about a particular item type. Selecting [Tutorial] from the context menu for a question opens a pop-up that will show the student how that type of item works (for example: whether they should select an answer, drag-and-drop answers, or type a response in an answer space).
Please note that this image depicts how ELPA21 items will look, although the item in the screenshot is not an actual ELPA21 item.

21. Pause and Test Timeout Pausing a Test
If the test is paused for more than 20 minutes, students can review or change answers to any question in the current section, including previous pages. Students cannot go back to previous sections.
Test Timeout Due to Inactivity
As a security measure, after 20 minutes of test inactivity, students are logged out and their tests are paused automatically.
Inactivity is determined by whether the student is interacting with the test by selecting answers or using navigation tools.
Students will receive a warning message prior to being logged out and must click [OK] on the pop-up within 30 seconds in order to avoid automatic logout and pausing of their test.
As a security measure, after 20 minutes of test inactivity, students are logged out, and their tests are paused automatically. Inactivity is determined by whether or not the student is interacting with the test by selecting answers or using navigation tools. Students will receive a warning message prior to being logged out and must click [OK] on the pop-up within 20 seconds in order to avoid automatic logout and pausing of their test. If a student’s test is paused, the student can log back in at any time during the testing window to resume testing and change answers.

22. Test End
When students answer the final question on their test, the [End Test] button will appear in the upper-left section of the screen, along with a message advising them that the test has been completed and is ready to be submitted. The [End Test] button does not become visible until the student has selected at least one response to every question on the test. If students click the [Next] button at this point, they will see a pop-up advising them to click the [End Test] button when they have completed reviewing their answers. They may also click the [Back] button to go back and revisit previous items.

23. Test End
When students are ready to end the test, they should click the [End Test] button. A pop-up message will appear allowing them to select [Yes] if they are ready to finish the test and [No] if they are not. If students select [No], they will return to the last item of the test and can revisit previous items. If students click [Yes], they will be taken to the review screen, where they have the choice to review their answers or submit the test.
Students who are ready to submit their tests should click [Submit Test] to finish. They will receive a confirmation pop-up asking if they are sure they want to submit. Clicking [No] will return them to the review screen. Clicking [Yes] will take them to the end screen, which shows a message indicating that the test was successfully submitted and advises the student to log out.

24. Monitoring Student Status
While students are taking their test, their test administrator can monitor their status from this screen. A table shows each student’s name, SSID, Opportunity Number, Test Name, Requests, Student Status, Test Settings, and a Pause Test option.
The Requests column displays a notification when students request a printout. We will discuss this in more detail shortly.
The Test Settings column will display either Standard or Custom. This column displays Custom when a student’s test settings are different from the default settings for that test. Click the [Eye] button to view a student’s test settings.  
The Student Status column indicates the student’s progress through the items in the test. It shows the total number of items completed thus far and the total number of items in the test.

25. Print on Request
The Print on Request feature is available only for students who require it. TAs should contact their School Test Coordinator if a student needs this accommodation. It is a testing impropriety to apply this restricted resource for a student who does not have an IEP or 504 plan documenting his or her need for the accommodation.
Students with this accommodation can request printouts of stimuli and/or items, depending on their settings.
• When a student sends a print request, the [Printer] button will appear in the Requests column of the monitoring screen. Click the button to view the request.
• If you click the [Check] button to approve the print request, a cover sheet containing the student’s name and SSID will display in a new browser window. No test content will ever display on your screen.
• Click [Print] in the new window to complete the print request. The printer dialog box will display. Adjust the print settings as needed.
• Click [Approve] to send the request to the printer.
• If you click the [X] button to deny the print request, nothing will be printed.
Before approving the student’s print request, ensure that it will be sent to a printer that is monitored by staff who have been trained in test security. All printed test items, stimuli, and reading passages must be securely stored and destroyed immediately following a testing session.

26. TA Interface: Approved Requests
The [Approved Requests] button allows the TA to view a list of every print request he or she approved during the current session. To print this list for your own records, click [Print] at the top of the Approved Requests window.

27. Printing Test Session Information
If you wish to print a snapshot of the TA Interface in its current view, click the [Print Session] button. This can be useful for tracking which students did not complete their tests and may need to be scheduled for another session. It may be necessary to set the page layout to landscape or adjust the margins in the Print Preview screen in order for the list to fit on the page. Remember that any printouts containing personally identifiable student information must be securely stored and should be destroyed after use.

28. Pausing and Stopping Sessions
There are two options within the TA Interface to pause or stop testing once it has begun. You can pause an individual student’s test, or stop the entire session. To pause an individual student’s test, click the [Pause] button on the monitoring screen for that student. When prompted, click [OK] to confirm that you want to pause the test. This option would be appropriate if a student becomes ill, for example. In the event of an emergency that requires all students to stop testing, the TA can pause all students’ tests by stopping the session.
If you stop the session, all in-progress tests will be paused. If a session stops, it cannot be resumed. The TA will have to create a new session and give the new session ID to students so that they can resume testing. To stop the entire test session for all students:
• Click the [Stop] button in the upper right corner of the screen. An “Important!” box will appear requesting verification to end the session and log students out.
• Click [OK] to continue.
If you forget to log out before leaving the testing area, the session will close automatically after 30 minutes of inactivity in both the TA and Student computers. The TA would then need to create a new session and provide the new session ID to students in order to resume testing.

29. Logging Out of the TA Interface
To log out of the TA Interface, click the [Log Out] button in the top right corner of the screen. It is preferable to log out only after stopping your active test session, as logging out will cause all in-progress tests to be paused. A confirmation message will appear, asking you to confirm that you want to exit the site and pause all students’ in-progress tests. This scenario also occurs when you navigate to another site from the TA Interface. However, regardless of when or how you log out or navigate away from the TA Interface, student data will NOT be lost. If the TA needs to access another application, we recommend opening it in a separate browser window.
Click [Yes] to proceed. When all students have completed testing, refer to the Test Administration Manual for instructions on destroying any printed testing materials and reporting testing improprieties or irregularities.

30. Troubleshooting Description What to Do
What should I do if a session ends?
Log in and start a new session. Provide the students with a new session ID.
What should I do if a student gets logged out of a test while a session is still active?
If a student’s test session is interrupted, the student should log back in and rejoin the session.
What should I do if forbidden applications are running?
The secure browser will not allow the student to begin testing if forbidden applications are running. You will see messages advising you which applications must be closed before testing can begin.
What should I do if a student’s test freezes?
Force quit the secure browser and log back in. For instructions, refer to the Test Administration Manual.
This table presents some of the common issues that TAs or students may encounter during a test session. Please take a moment to review this information. For more detailed information and additional technical tips, please refer to the Test Administration Manual and the Technical Specifications Manual for Online Testing.

31. Preparing Students
This overview of TDS has been from the perspective of a Windows PC user. Remember that students’ experiences with the test will vary slightly depending upon the computers they are using for testing. Regardless of the type of device they will use, we strongly recommend that all students take the practice and training tests to familiarize themselves with the login process, the testing interface and its features, and the types of items they will encounter during testing. Practice and training tests can be accessed via your state portal.

32. Online Reporting System
Training Module
Next, we will discuss the Online Reporting System (ORS) and how to access participation reports.
Please consult the Online Reporting System User Guide located on your state portal for more detailed information.
Copyright © 2014 American Institutes for Research. All rights reserved.

33. Purpose
Provide timely, relevant reports and guide educators to make valid, actionable interpretations of the data
Provide access to data
Downloadable data files for districts, schools, and teachers
Results for assessments in one system
Participation data
Interactive data
The ORS is designed to provide you with assessment data and tools you need to understand the performance of your students. The system provides interactive data, which allows you to explore the data to understand the results. The near real-time reporting facilitates the speed in distributing the results.
The ORS includes participation reports that enable you to determine which students have completed or need to complete testing. Note that students who are not registered in the Test Information Distribution Engine (TIDE) to take a test are not included in the ORS.
The ORS also has the capability to display score reports or performance reports, but these reports will not be available until after the ELPA21 standard setting.
You may consult the Online Reporting System User Guide for more detailed information.

34. Logging In 1 2 3
To log in to ORS, you must have an authorized address and password, which is the same for TIDE, TDS and ORS. Contact your School Administrator if you do not have a TIDE account.
The ORS is a secure, role-based system. Your access to reports and data in the system depends upon your user role and your district and school associations. Access to the ORS is via the State Assessment Program Portal.
Navigate to the State Assessments Program Portal. Select your user role.
Select ORS. The Login page appears.
Enter your address and password. Click Secure Login.

35. Test Management Center
Plan and Manage Testing
Test Completion Rates
Test Status Report
The Test Management Center drop-down menu provides access to the following report options:
Plan and Manage Testing
Test Completion Rates
Test Status Report

36. Test Management Center: Plan and Manage Testing
The Participation Report provides customized participation reports showing students’ testing activity.
To generate a report:
From the Test Management Center drop-down list, select Participation .
Select the parameters for your report.
Click Generate Report. Alternatively, click Export Report to export the data.

37. Test Management Center: Plan and Manage Testing
Which students have not yet tested?
Which students have started but not yet completed their test?
Which students need to finish tests that are going to expire soon?
Which students have paused tests?
You can filter the participation report to include students who match specific criteria. This slide illustrates some common Plan and Manage Testing cases.

38. Test Management Center: Plan and Manage Testing
This slide displays a sample Plan and Manage Testing report filtered by students who have completed the first opportunity in the selected administration.

39. Test Management Center: Test Completion Rates
The Test Completion Rates section provides reports of the number of students who have started or completed tests by school or district. District-level users can create a report for a specific school or for the whole district. You can also create a report for all tests or for one specific test.
To generate a report:
From the Test Management Center drop-down list, select Test Completion Rates.
Select the parameters for your report.
Click Export Report.

40. Test Management Center: Test Status Report
The Test Status Report section provides a status report that includes all tests for which a student is eligible. The report includes the student’s information, test name, current test status, and any assigned special code, if applicable. District-level users can create a report for a specific school or for the whole district. School-level users can create a report for their own schools.
To generate a report:
From the Test Management Center drop-down list, select Test Status Report.
Select the parameters for your report.
Click Generate Report or Export Report.

41. Upcoming ELPA21 DEI Webinar
Students taking the test in Large Print will have their booklets transcribed in the Data Entry Interface (DEI) for scoring.
A training webinar will be presented to provide an overview of this system.
The date and time are TBD.
There will be an additional training webinar for ELPA21 that provides an overview of the Data Entry System (DEI). The DEI is used for scoring Large Print tests only. The date and time of this webinar are to be determined.

42. Thank You! Further Information Washington Help Desk
American Institutes for Research
Tel
For questions regarding state policy decisions and protocol, please contact OSPI at
Thank you for attending today’s training webinar. If you have general questions or need further information, visit your state portal, or consult your help desk for assistance.
For detailed information, please consult your Test Administration Manual and Online Reporting System User Guide located on your state portal or contact your help desk.