1. Test Administrator Training
Smarter Balanced Assessments
Spring Created by Everett Public Schools

2. Introductions
Download this TA training as close to your training date as possible to capture any updates that may have been added.

3. Smarter Balanced Assessments (SBA) Acronyms
AVA: Assessment Viewing Application (Interim) CAT: Computer Adaptive Test DC: District Coordinator (formerly DAC) GTSA: Guidelines on Tools, Supports, & Accommodations Read the Professional Standards, Incident, Investigation, and Reporting Guidelines ORS: Online Reporting System PT: Performance Task SC: School/Test Coordinator (formerly SAC) TA: Test Administrator (formerly Proctor) TAM: Test Administrator Manual (includes “DFA”) TIDE: Test Information Distribution Engine WCAP: WA Comprehensive Assessment Program
This PPT follows the TAM and the relevant information is in the binder provided, one per school.
This is a list of acronyms for Smarter Balanced (as if we didn’t have enough already) but a couple of new ones to remember are AVA for interims and GTSA for supports and accommodations. The School Coordinator is the designation in TIDE that provides access to adjust Accommodations; change or create rosters, and add TAs. Consider who at your building needs SC access and that request to our department. GTSA is a new acrony m for the guidelines that are now referred to as Tools and Supports (referring to universal and Designated).

4. District Resources
Assessment & Research SBA website for staff and parents resources
FAQs
Links to SBA Resources on WCAP:
Manuals
Assessment Access
Informational and training videos
Assessment calendar
DocuShare
Staff Website – District login required
The C & A department has created quite the extensive website for Smarter Balanced information. We have FAQ’s, most of which were generated from in house questions; links to WCAP with a brief description of each access “card on the portal” as well as informative and training videos. In addition to Practice and Training Scoring guides.
Staff will need to login to view staff specific documents.
There is also a live link in the PPT that will direct you to the training materials reports in DocuShare.

5. SBA Preparation: March Timeline
Read the TAM
Become comfortable with reading and understanding the test directions on pages 38-47
Identify students eligible for assistive technology
Confirm that your log in and password are active
Ensure that all students have had an opportunity to practice item structures and use of tools
SBA, MSP, ELPA21
Review Classroom Activities prior to testing day
Notepad access is item specific - not saved
Global Notes in ELA PT1 are saved for PT2 until the student submits the exam
Prepare for the SBA by reading the TAM, confirming your login and working with students on the practice session, if need be, so they are prepared to take the online assessment.
While we administer the classroom activity the day of the PT, you can certainly review it ahead of time.
Identify any students that may require speech to text and please let me know.

6. WCAP Portal Cards
Using the Chrome browser, EPS has a link to WCAP under Managed Bookmarks.
Having selected the Test Administrators Access card, here are the portal cards in WCAP
Any Portal Card with a Lock requires a WCAP login. Resources is not secure. Forgotten passwords can be retrieved by the user by clicking on any locked portal card and then when it asks for your login, click on “Forgot Your Password”? link.
As a reminder, SBA system is three parts – Summative, Interim (we will touch on that later), and Digital Library.
Digital Library has a different log in and must be reset by the district coordinator.
Please note that a TA can’t use a CB to view the Portal Cards, the Portal system is not caught up to our CB version
I want to take a minute to talk about Training Test Administration Card: The TA can access practice tests for SBA, MSP, and ELPA21 sessions.
It is important to remember that the Training sessions for SBA are grade band 3-5, so a TA can log in and select grade 3 and think that it is a really hard question, actually it may be a grade 5 type problem. There are only 6-8 questions in the training section and the primary purpose is to understand how to use the tools. Practice sessions are grade level specific and about 30 questions and students practice the actual question types. These are not secure so encourage TAs to use overhead projectors and provide instruction with the class on the type of questions and the use of tools.

7. Test Administrator Resources
TA & Test Coordinator User Cards include 4 sections
General Information
User Guides and Manuals
Assessment Resources
Modules
Search Resources
Now let’s talk about WCAP Resources:
Test Administrator & Test Coordinator Resources options in WCAP Portal include 4 sections.
I understand the state is going to be providing filters for the resources, but for now I want to point out two things.
Regardless of how you enter and I’m going to show you that on the next slide, you can switch back and forth on the left sidebar, or
Just type in “Search Resources” and regardless of the section the item is stored in, you will see the resource.
Items are stored differently in each of the four (student & family, administrators, coordinators, and technology) access point. But, all roles can access any of the materials, making the search option a great resource.
For example: TA Assessment Resources has the classroom activities for the practice tests and the Test Coordinator has achievement level descriptor definitions. But a search on “descriptors” will provide the TA with the document.

8. Testing Portal Cards
Having selected the Test Administrators Access card, here are the portal cards in WCAP that are a part of Summative Assessments
There are 3 main areas:
TIDE, you can print a test ticket if one is missing or you have a new student rather than wait for one to be sent up from the office. There is a slide coming up to show you how this is done. (as a side note: the only other time you will need to access TIDE area is to print the THSS materials to calibrate for scoring interim assessments items.
Test administration to begin testing using the TA Interface process.
ORS to view scoring results for your students for all assessments either by Roster or Session ID

9. Security Protocols
Policies, laws, practices and prohibited behaviors are detailed on pages of the GTSA.
State and local laws and policies specify practices to ensure test security of standardized and ethical administration of assessments.
Student monitoring throughout testing.
As with all state assessments, state laws must be adhered to.
This is in the GTSA and serves as a reminder that reviewing and disclosing test questions is a violation of state law.
A complete list of rules and regulations can be found on the websites listed above.
This is part of the new state Professional Standards, Incident, Investigation, and Reporting Guidelines manual.

10. Test Security Room Setting
Before:
Instructional materials related to the content of the assessments are not visible, proper signage, seating
During:
Quiet, proper supervision, using secure browser
Support the student concerned about an item: “Try your best and choose the answer that makes the most sense to you. If you are unsure about how a question works, select Tutorial from the context menu to view a short video.”
After:
No test materials used for instruction, destroy secure materials
Preparing the classroom according to test security guidelines. Refer to pages 14 and 15 in the TAM to review all Before During and After Testing protocols.
Walls are free of materials that would guide student responses. Special care and caution should be taken to remove recently discussed classroom activities.
Desks are placed in an exam layout as opposed to a collaborative setting.
The room is monitored and materials are secured and properly destroyed

11. Tools, Supports & Accommodations
Headsets required for:
ELA CAT listening portion, some PT tasks and for students requiring text-to-speech
Math CAT & PT for students requiring audio glossaries and text-to-speech
Scratch Paper (Make available for all grade levels, use scratch paper log Append. C in GTSA)
Graph paper – Math only –Required to be available for grade 6 and above
Plain or yellow-lined scratch paper – ELA & Math
Review the accommodation one-page sheet
Note: Changes in universal tools, designated supports and accommodations may take up to 24 hours to appear
When the student sees the “audio test” as they log in, this is the indication that a headset is required for this student or within this segment.
Please note that graph paper is required for grades 6 and above and will be distributed, along with scratch paper, to middle and high schools according to your building plan requests. Make the paper available in the classroom, have TAs note on the sign out sheet who they distributed paper to and be sure to collect it after testing.
Refer to the accommodations one page sheet and we will discuss the differences between universal TOOLS, designated SUPPORTS and accommodations options (embedded and non-embedded)
This is only a reference sheet. You must refer to the manual for specific detailed information.

12. Additional Technology Supported in the Classroom
Print on Demand
Student answers one question at a time
TA ensures that the printer is on and monitored and then prints the item
TA (if acting as a scribe) or student enters the responses
TA destroys printed materials except for notes from PT1 which may used on PT2.
If your school has students needing print on demand, Show this slide so the TA will know what to expect.
Explain the print on demand steps. This option should be designated to very few students and remember, the student(s) can’t be left alone so the printer must be near by.
If the case manager/IEP Team marked off Print on Demand it will appear on the student test, because special services uploaded all IEP accommodations in TIDE.
If a student is not regularly using this, you may want to remove it in TIDE.
The print option is under the menu bar for eligible students

13. Summative Assessment Computer Adaptive Test (CAT) Preparation for PT
Two questions are waiting in the queue
TA monitor 12/44
Preparation for PT
Classroom activity that focuses on vocabulary and key contextual topics
Note: Prior to starting PT, all classroom activity student notes must be collected and charts or graphs removed from the room.
Performance Task (PT)
Extended math problem or writing tasks
Students may not use notes from the classroom activity on the PT.
A reminder of the components that make up the summative assessment for both the ELA and MATH.
CAT = computer adaptive meaning the computer has 2 questions in the queue, one if you get it right and 1 if you get it wrong.
One classroom activity – preparation for Performance Tasks in both ELA and Math.
Performance tasks are extended or open-ended problems based on a passage or a prompt.

14. SBA Segments Math ELA Classroom Activity ADD your school Activity
Performance Task (1)
all one segment
CAT 1 & 2
one long segment
ELA
Classroom Activity
ADD your school Activity
Performance Task (1 & 2)
Two (2) segments
Cannot return to segment 1 from 2
CAT 1 & 2
one long segment
So what do the segments look like?
Both content area Performance Tasks start with a classroom activity. Math has 1 PT segment and ELA PT has two segments, the second is a full write, the first is 3-6 questions based on articles.
CAT, while designated as 1 and 2 in Math and ELA is really one long segment so the segment rule we will discuss later does not apply to a CAT

15. End of ELA PT1 Segment
The ELA performance task is presented in segments. When students reach the end of PT1, they will receive a warning message asking them to confirm that they want to move on to the next segment. The warning also advises that they cannot return to change their answers in the current segment once they have moved on.
Students receive a clear message that they are leaving the ELA PT 1 segment (3 to 5 questions) and going into the long write – PT2.
On rare occasion a student may inadvertently submit before finishing Segment 1. Contact the District Assessment Coordinator to see if the incident qualifies for reopening the previous segment.

16. Test Tickets
Describe how test tickets will be distributed at your school
Describe how tickets will be distributed at your school , but explain that if one is missing for a new students, this is how the TA can go into TIDE and print a ticket. There is also a link for TAs to print from TAC using the Cognos report that is much easier for students to read.
Tickets may be printed ahead of time and secured for the next test session and all roles can Print test tickets for individual students or by grade level in TIDE or use Cognos. Or print Pre-ID labels for late arriving student (perhaps for the MSP booklets)
Note: Once you check a box next to the student the Print options become available. Without selecting a student, the Print Options are greyed out.
The TA can view student data in TIDE and see the same view in the TA Interface but cannot make changes.

17. TA Interface
Start a session by logging into WCAP no more than 20 minutes prior to testing
Select the appropriate test(s)
Students are displayed on the TA interface grouped by test.
Approve student access
When more than one test type is open for a grade level in a session, the student will see both test options. The TA approves each student within each test type and should deny access if the student has logged into the wrong test.
Monitor student progress (16/44)
The monitor may indicate 44 but a student may end on question 46 because tests questions and number can vary.
TAs will be automatically logged out (session stops) after 30 minutes of inactivity. Activity includes the students actively clicking next or back.
Remind staff that the session cannot be started more than 20 minutes prior or the students will get an error message as they try to log in that the session does not exist.
A TA can administer tests to students taking different exams. Carefully approve the student to his or her correct exam.
Ensure that all TAs are familiar with:
1. Starting a testing session,
2. Approving students to join the session. Approve all students (wait until the count equals your class size) using approval button to the right of the session ID. If 1 or 2 students need help, approve the rest and let them start testing while you assist the other 2.
3. Students can join a session already in progress or if one or two students aren’t ready, approve them later. Use select test – above to ad during session.
4. TA can add an exam to a session already in progress. Select tests to the right of the session ID.
Note that a student may get to the last question on 43 or 46 (computer adaptive) even though the TA interface still shows 44
If the TA happens to notice that a designation does not appear to be accurate, use the “eye” lookup and if changes need to be made, deny the student, have them log out. Make changes, if you have access, and have the student log back into the same session. Notify the SC to make the changes permanently in TIDE. This will also ensure that the particular test option will appear for the student for all test sessions and SBA tests.
An example of a time you may need to this is if a student is playing with zoom. You can have them logout and you can uncheck the universal option.

18. TA Interface Off-Grade Science Tests Only
Open a test session for the off-grade science level (Gr. 5 or 8).
The student will see both grade level assessments.
Inform the student which grade level they should select.
Approve the student for the appropriate grade level

19. Student Interface
Students log into the Session using their legal first name, as listed in eSchoolPlus, SSID number and session ID.
If students are unable to log in, verify that they are entering their login information correctly.
Assist struggling students with login.
If a student arrives late:
the student can join the session in progress with TA approval
the TA can add another content area or grade level test to the session already in progress, if necessary
Students will only see their grade level exams.
Student login is the same for practice, interim or summative assessments.
Common error messages indicate the student login information didn’t match what is in eSP, or 20 minutes has passed since the session started.
If a message appears “No Test Available” one possibility is the wrong grade level test was selected, G3 Math instead of G5 Math. Or the student finished the test in another school. In the case of a performance task, it may be that the student is “enrolled in TIDE” at another school. If the student’s performance task doesn’t match your buildings task, the student will not be able to test.
Students can join a session already in progress.

20. Common Chromebook (CB) Solutions
If the student is having technical difficulties, try these solutions:
Pause the test, close the secure browser, shut down CB.
Log back into same session. (try this up to 3 times)
Replace the Chromebook
Create work order with IT and note the CB number
Contact the school BOAT
Request help from Help Desk with power issues
Call Assessment & Research Department x4057 or x4054
On rare occasion, during testing, the screen may freeze or a strange icon appears. Student work is automatically saved so power off the device and have the student log back in to the same session.
Another example of a glitch, the student is unable to enter a score into a box. In this situation have them continue and likely the box will be accessible in the review process. Please report the session ID, and Test Question to the SC if the student cannot access the item.
These are the most common steps to take to resolve an issue with the CBs and in this order.
There often is no explaining what the glitch is, but 3 times a charm.
ELPA Training

21. During Testing
Do not display of the TA Interface of students testing on the overhead projector
Access to unauthorized electronics is prohibited
Provide support by saying following the directions verbatim: Support the student concerned about an item: “Try your best and choose the answer that makes the most sense to you. If you are unsure about how a question works, select Tutorial from the context menu to view a short video.”
Monitor student progress in the TA Interface:
Watch for students that may have paused their session
Watch for students that are progressing too quickly
A few reminders of what the TA should be doing during testing.
Be sure the student progress is not displayed on the overhead.
Monitor students and be prepared to respond to students with this verbatim quote from the Directions for Administration
Too fast? Offer a break or remind students to do their best work.

22. Transferring a Test Session
   
Do not log out of original session
Open WCAP portal and select Test Administration
Enter the active session ID when the prompt appears
In the unlikely event that you have problems with your computer or web browser or need to change computers during an active test session, you can transfer the session from one computer, mobile device, or browser to another without stopping the session or interrupting in-progress tests. To transfer a test session to a new device or browser:
  • Do not log out of the session you are currently in or stop the test session.  If you do, you will end the test session and pause all students’ tests.
• Log in to the TA Interface on the new machine or in the new browser. A session ID prompt will appear.
• Enter the active session ID into the text box and click [Enter]. When the session ID is validated, you will be able to continue your test administration activities.
 The test session on the previous computer or browser will close automatically. This will not stop the session or pause student tests.

23. SBA Pause Rules Pausing for less than 20 minutes, the student will:
Return using the same session ID and
Be able to review responses or change answers within any segment
Stopping the test for lunch or for more than 20 minutes, the student:
Performance Tasks:
Will have all highlighted text saved for review
Can continue to add text or change answers within the segment
Cannot return to segment 1 once they begin working in segment 2 (without using the appeal process)
Computer Adaptive Tests (CAT):
Cannot go back and review responses or change previous answers
Will continue where they left an unanswered question
CAT Important reminders for TAs and students:
Because CAT questions cannot be reviewed backwards after 20 minutes, DO NOT release students for lunch with the intention of reviewing later. Also, if all the questions are answered, the test is automatically submitted after a pause of 30 minutes.
What are the Pause rules during testing?
Students should pause the test for a bathroom break.
When the test is being paused for lunch or for more than 20 minutes, we really are stopping the test.
Stopping the test means two different things for PT or a CAT
PT they come back to where they were and have freedom to review within the segment.
CAT they come back to the last question only. Cannot review previous questions.
This happened often enough last year that clearly there is a misunderstanding on the CAT. You can’t go back after 20 minutes, so it doesn’t make any sense to break for lunch with the intention of reviewing after lunch. Even if they pause on the last question, after 20 minutes, the test is automatically submitted.

24. SBA Pause for Lunch CAT PT Pausing After 20 minutes the: Pausing
Student returns to the last unanswered question and cannot go back to review or change PT
Pausing
After 20 minutes:
Student returns to the segment and can review or change answers
Another view of the pausing restrictions:
With the restrictions for pausing for more than 20 minutes for the CAT only, it might make it easier for staff if we have a consistent message and strategy for lunch breaks.
Emphasize with staff the importance of following the Pause Rules for a CAT. Corny but… a CAT has “Paws” Pause rules you must follow.
Even though in a PT, a student can return and review or change a response within the segment, best practice would be to apply the same review strategy before a lunch break.

25. Ending a Session
Quoting from the directions on page 45 & 46 in the TAM, we will remind students what to expect regarding ending a session. You may write the end time on the white board and tell students “At 11:10 we leave for lunch, at 11:00 stop working on any new questions. Review your responses and: PAUSE on the last reviewed and completed item. SUBMIT if the test is finished. When there are approximately ten minutes left in the test session, the TA should give students a brief warning. SAY: We are nearing the end of this test session. Please review any completed or marked for review items now. Do not submit your test unless you have answered all of the questions. If you need additional time let me know. After all students have indicated they have paused or submitted, the TA will stop this session by selecting “Stop Session” on top left.
Ending a session means student work, while saved all along, is saved with additional restrictions on returning to the test:
If you need to stop a session in the middle for a student to return to later, write the stopping time on the board. Allow minutes to review. Be sure all questions have been reviewed and final answers are marked.
CAT - every answer is accepted and cannot be changed, even flagged responses. They return to the last unanswered question when they return.
PT - they can return to the segment and can make changes within the segment.

26. Teacher Stops the Session
Before you “Stop” the Session print session log
Return this session log to ________________
After all students have indicated they have paused or submitted, the TA will stop this session by selecting “Stop” Sign on top right.
Students who need more time will need to log back into another TA session
Select the print icon on the banner tab before you close the session. This will print a report of student progress and completion rates.
Be sure the Session ID is visible or written on the report.
This is also a good practice for the TA to record or log session ID numbers for interim assessments for future reference. Date, session ID, Type of test and the target tested.
SC Note: If the SC is comfortable with running test completion reports, you do not need to require this of the TA

27. End of Session Print the session report before you select Stop Session
10/21/2017
End of Session
Print the session report before you select Stop Session
Return this session log to ________________
After all students have indicated they have completed the review process they should either:
‘pause’ the exam to complete at a later date, or
“end the Exam” and “submit” when finished
TA will stop the session by selecting “Stop” Sign
Students who need more time will need to log back into another TA session
The TA will print the session page before closing the session. This will print a report of student progress and completion rates.
Note that students either pause after review or submit the test to end the session.
Those not finished will enter a new session ID to complete the test.

28. Irregularities/Appeals
Report any classroom anomaly immediately to the SC who will confer with the DC to determine if an irregularity report is needed.
Conditions that may occur that need reporting:
The wrong assessment was administered or started
Accommodations not available
Student was unable to complete the test segment
Technology difficulties
Student inadvertently leaves the segment unfinished
Extended power outage
Report any anomalies to the SC immediately.
Some conditions to consider but it is not limited to these.

29. Document Irregularities
Do what you can to correct the situation, i.e. move the students or take away the cell phone. Continue testing whenever possible.
Document the irregularity on your Test Assurance Security Form
Record the events and provide the SC with specific details of what transpired
The SC is responsible to:
Contact the DC
Complete an irregularity or appeal request
Never invalidate a test booklet.
The TA should Do what can be done to avoid situations in the first place by following the DFAs verbatim, but some behavior is not within our control. Always try to continue testing.
If a cell phone was used by a student, contact SC to verify that secure test content was not transmitted or photocopied.
Record events on your TAs form the SC/DC will decide if an irregularity report is needed.

30. EPS Assessment Schedule
Discuss the school schedule
Elementary Schedule
Middle School Schedule
High School Schedule
Grade 10 ELA (Some students eligible for Math)
Grade 11 ELA and Math
This is our school testing schedules:
Be sure all other staff are aware of the testing days.

31. Participation and Room Scheduling
Who will test where?
Extended-time location:
Add your notes here
Extended testing time:
TAs in an extended testing location will need the test ticket and the content area and specific test the student needs to complete.
Add building specific notes and explain the process.
Slide 31

32. Attendance Procedures:
Add your notes Plan for make-ups at all grade levels including high schools. Testing window ends June 10.
Add building specific notes and the process for calling students and reminding them of the importance of this testing opportunity.

33. Break Procedures
Students are monitored by staff during breaks until testing is completed. Instruct students not to discuss the test.
Dismiss students as a group with supervision, or one at a time during testing. Remind students that there is no talking during the break.
Ensure students do not have access to any electronic devices
Add your staff break, hall monitor plan information here
Add the emergency contact number/plan should a TA need help during the assessment. Have them write the contact information on the back cover of the directions packet
Follow the break procedures in the instructions. In the unlikely event the class has to leave the room for an emergency. Student safety first; follow the emergency procedures.
TA should pause the assessment, if possible, but not at all necessary.

34. Final Checklist… After Testing:
Account for all test tickets
Account for all secured materials distributed (yellow, lined paper; glossaries; graph paper) using the scratch paper log
Process for returning scratch paper to be shred is ________
Sign and return the Test Security Assurance Form
Confirm the completion of daily session reports
Review the school procedure when students finish before the rest of the class.
Anything distributed during testing such as scratch paper needs to be accounted using the scratch log, and returned to the distribution location for shredding.
Carefully complete the Test Security Assurance Form, if there are no irregularities to report, be sure to check N/A.
If you check yes, be sure to write what happened above.

35. Interim Access Points
Interim Blueprints, AVA and THSS guides and training
Administer Secure Interim Assessments
PowerPoint on Scoring and
ELA & Math Exemplar Sets and Training Guides for Calibration
While our focus is SBA training today, I wanted to provide an overview of Interim Assessments:
Interim Asmt. Access Points
First, The interim blueprints and training guides are in the Resource Portal.
AVA. Teachers can now review the interim assessments through the AVA Card (comprehensive and block) and determine which blocks most closely match an area of current instruction.
Hand scoring guides are available to TAs in TIDE to aid teacher on calibrating and scoring the interim assessment.
Print in-class activities from the Classroom Activities portal card.
Interim Assessments for students are administered thru the Test Administration portal card.
The THSS portal card is the access to hand scoring open-ended interim block or comprehensive assessments.
The ORS portal card reports score results. Must administer both the PT and the CAT in a comprehensive assessment to see the score in ORS.
Hand Scoring system
Score Reports
View Interim Assessments before administration
Classroom Activities for Interim Assessments

36. Interim Block Item Number and Target Results by Class
A quick screenshot of how Block scores can be viewed by student or class as displayed here, and why Rostering is important.
Link to DocuShare binder.

37. Online Reporting System
Test Management Center
Participation Reports in Plan and Manage Testing (have/have not completed)
Test completion rates (by school, grade, subject and opportunity)
Summary Statistics (percent proficient, not avail. For IAB)
Retrieve student results (download excel files by district, school, teacher, and roster)
Score Reports
Interim Assessments
Summative
MSP/EOC/HSPE
Online Reporting System to monitor testing and then print score Reports
ORS has two main components.
Test Management and Score Reports. But there is also the ability to manage a roster in ORS (which is connected to TIDE) rather than going back to TIDE. And you can search a SSID and see what tests the students has completed even if new to your district.
Score reports can be generated by rosters (previously referred to as “group data” sorts.) Good Rostering makes it easier for TAs to view the results for their students. Students can be in more than one group. For example, the SC creates a roster group for the 5th grade teacher who provides math instruction to all students.

38. For Assistance Test Administrators: Contact the School Coordinator
Contacts the District Assessment Coordinator
District Assessment Coordinator:
Contacts OSPI
Technical Support:
American Institute of Research - Washington Help Desk