1. Test Administrator Training Smarter Balanced Assessments Spring 2016 - Created by Everett Public Schools 1

2. Introductions 2

3. Smarter Balanced Assessments (SBA) Acronyms AVA:Assessment Viewing Application (Interim) ARMS: Assessment Reporting Mgmt. System CAT:Computer Adaptive Test DC:District Coordinator (formerly DAC) GTSA: Guidelines on Tools, Supports, & Accommodations Guidelines on Test Incidents and Investigations ORS:Online Reporting System PT:Performance Task SC:School/Test Coordinator (formerly SAC) TA:Test Administrator (formerly Proctor) TAM:Test Administrator Manual (includes “DFA”) TIDE:Test Information Distribution Engine WCAP:WA Comprehensive Assessment Program 3

4. District Resources Assessment & Research SBA website for staff and parents resources –FAQs –Links to SBA Resources on WCAP: Manuals Assessment Access – Informational and training videos – Assessment calendar DocuShare: Smarter Balanced Training MaterialsSmarter Balanced Training Materials Staff Website – District login required 4

5. SBA Preparation: March Timeline Read the TAM –Become comfortable with reading and understanding the test directions on pages 38-47 Identify students eligible for assistive technology Confirm that your log in and password are active Ensure that all students have had an opportunity to practice item structures and use of tools –SBA, MSP, ELPA21 Review Classroom Activities prior to testing day 5

6. 6 WCAP Portal Cards

7. TA & Test Coordinator User Cards include 4 sections 1.General Information 2.User Guides and Manuals 3.Assessment Resources 4.Modules Search Resources Test Administrator Resources

8. 8 Testing Portal Cards

9. Security Protocols Policies, laws, practices and prohibited behaviors are detailed on pages 40-41 of the GTSA. State and local laws and policies specify practices to ensure test security of standardized and ethical administration of assessments. Student monitoring throughout testing. 9

10. Test Security Room Setting Before: Instructional materials related to the content of the assessments are not visible, proper signage, seating During: Quiet, proper supervision, using secure browser Support the student concerned about an item: “Try your best and choose the answer that makes the most sense to you. If you are unsure about how a question works, select Tutorial from the context menu to view a short video.” After: No test materials used for instruction, destroy secure materials 10

11. Tools, Supports & Accommodations Headsets required for: –ELA CAT listening portion, some PT tasks and for students requiring text-to-speech –Math CAT & PT for students requiring audio glossaries and text- to-speech Scratch Paper (Make available for all grade levels, use scratch paper log Append. C in GTSA) –Graph paper – Math only –Required to be available for grade 6 and above –Plain or yellow-lined scratch paper – ELA & Math Review the accommodation one-page sheet Note: Changes in universal tools, designated supports and accommodations may take up to 24 hours to appear 11

12. Additional Technology Supported in the Classroom Print on Demand Student answers one question at a time TA ensures that the printer is on and monitored and then prints the item TA (if acting as a scribe) or student enters the responses TA destroys printed materials except for notes from PT1 which may used on PT2.

13. Summative Assessment Computer Adaptive Test (CAT) Classroom Activity –Preparation for PT that focuses on vocabulary and key contextual topics –Note: Prior to starting PT, collect all In Class Activity student notes and remove charts or graphs from around the room. Performance Task (PT) –Extended math problem or writing tasks Students may not use notes from the classroom activity on the PT.

14. SBA Segments Math –Classroom Activity (school specific) –Performance Task (1) school specific all one segment –CAT one long segment 14 ELA –Classroom Activity (school/test specific) –Performance Task (1 & 2) school specific two segments Cannot return to segment 1 from 2 –CAT one long segment

15. End of ELA PT1 Segment 15 Students receive a clear message that they are leaving the ELA PT 1 segment (3 to 5 questions) and going into the long write – PT2. On rare occasion a student may inadvertently submit before finishing Segment 1. Contact the District Assessment Coordinator to see if the incident qualifies for reopening the previous segment.

16. 16 Test Tickets Describe how test tickets will be distributed at your school

17. TA Interface Start a session by logging into WCAP no more than 20 minutes prior to testing Select the appropriate test(s) –Students are displayed on the TA interface grouped by test. Approve student access –When more than one test type is open for a grade level in a session, the student will see both test options. The TA approves each student within each test type and should deny access if the student has logged into the wrong test. Monitor student progress (16/44) –The monitor may indicate 44 but a student may end on question 46 because tests questions and number can vary. TAs will be automatically logged out (session stops) after 30 minutes of inactivity. Activity includes the students actively clicking next or back. 17

18. Student Interface Students log into the Session using their legal first name, as listed in eSchoolPlus, SSID number and session ID. –If students are unable to log in, verify that they are entering their login information correctly. If a student arrives late: –the student can join the session in progress with TA approval –the TA can add another content area or grade level test to the session already in progress, if necessary Students will only see their grade level exams. 18

19. Common Chromebook (CB) Solutions If the student is having technical difficulties, try these solutions: Pause the test, close the secure browser, shut down CB. Log back into same session. (try this up to 3 times) Replace the Chromebook Note the CB number and notify IT (work order) Contact the school BOAT Request help from Help Desk Call Assessment & Research Department x4057 or x4054 On rare occasion, during testing, the screen may freeze or a strange icon appears. Student work is automatically saved so power off the device and have the student log back in to the same session. Another example of a glitch, the student is unable to enter a score into a box. In this situation have them continue and likely the box will be accessible in the review process. Please report the session ID, and Test Question to the SC if the student cannot access the item. 19

20. During Testing Do not display of the TA Interface of students testing on the overhead projector Access to unauthorized electronics is prohibited Provide support by saying following the directions verbatim: Support the student concerned about an item: “Try your best and choose the answer that makes the most sense to you. If you are unsure about how a question works, select Tutorial from the context menu to view a short video.” Monitor student progress in the TA Interface: –Watch for students that may have paused their session –Watch for students that are progressing too quickly

21. Transferring a Test Session 21

22. SBA Pause Rules Pausing for less than 20 minutes, the student will: R eturn using the same session ID and Be able to review responses or change answers within any segment Stopping the test for lunch or for more than 20 minutes, the student: Performance Tasks: Will have all highlighted text saved for review Can continue to add text or change answers within the segment Cannot return to segment 1 once they begin working in segment 2 (without using the appeal process) Computer Adaptive Tests (CAT): Cannot go back and review responses or change previous answers Will continue where they left an unanswered question CAT Important reminders for TAs and students: Because CAT questions cannot be reviewed backwards after 20 minutes, DO NOT release students for lunch with the intention of reviewing later. If all the questions are answered, the test is automatically submitted after a pause of 30 minutes. 22

23. SBA Pause for Lunch CAT Pausing After 20 minutes the: Student returns to the last unanswered question and cannot go back to review or change 23 PT Pausing After 20 minutes: Student returns to the segment and can review or change answers Even though in a PT, a student can return and review or change a response within the segment, best practice would be to apply the same review strategy before a lunch break.

24. Ending a Session Quoting from the directions on page 45 & 46 in the TAM, we will remind students what to expect regarding ending a session. You may write the end time on the white board and tell students “At 11:10 we leave for lunch, at 11:00 we will stop working on any new questions. Review your responses and PAUSE the session if more time is needed and SUBMIT the test if finished. When there are approximately ten minutes left in the test session, the TA should give students a brief warning. SAY: We are nearing the end of this test session. Please review any completed or marked for review items now. Do not submit your test unless you have answered all of the questions. If you need additional time let me know. After all students have indicated they have paused or submitted, the TA will stop this session by selecting “Stop Session” on top left. 24

25. Teacher Stops the Session 25 Before you “Stop the Session” print session log Return this session log to ________________ After all students have indicated they have paused or submitted, the TA will stop this session by selecting “Stop” Sign on top right. Students who need more time will need to log back into another TA session

26. Irregularities/Appeals Report any classroom anomaly immediately to the SC who will confer with the DC to determine if an irregularity report is needed. Conditions that may occur that need reporting: –The wrong assessment was administered or started –Accommodations not available –Student was unable to complete the test segment –Technology difficulties –Student inadvertently leaves the segment unfinished –Extended power outage 26

27. Document Irregularities Do what you can to correct the situation, i.e. move the students or take away the cell phone. Continue testing whenever possible. Document the irregularity on your Test Assurance Security Form Record the events and provide the SC with specific details of what transpired The SC is responsible to: Contact the DC Complete an irregularity or appeal request Never invalidate a test booklet. Slide 27

28. EPS Assessment Schedule Discuss the school schedule Elementary Schedule Middle School Schedule High School Schedule –Grade 10 ELA (Some students eligible for Math) –Grade 11 ELA and Math 28

29. Participation and Room Scheduling Extended-time location: Add your notes here Extended testing time: TAs in an extended testing location will need the test ticket and the content area and specific test the student needs to complete. Who will test where? Slide 29

30. Attendance Procedures: Add your notes Plan for make-ups at all grade levels including high schools. Testing window ends June 10. Slide 30

31. Break Procedures Students are monitored by staff during breaks until testing is completed. Instruct students not to discuss the test. Dismiss students during the test for a Bathroom break, one student at a time Ensure students do not have access to any electronic devices Add your staff break, hall monitor plan information here Add the emergency contact number/plan should a TA need help during the assessment. Have them write the contact information on the back cover of the directions packet Slide 31

32.  Account for all test tickets  Account for all secured materials distributed (yellow, lined paper; glossaries; graph paper) using the scratch paper log  Process for returning scratch paper to be shred is ________  Sign and return the Test Security Assurance Form  Confirm the completion of daily session reports Review the school procedure when students finish before the rest of the class. Final Checklist… After Testing: Slide 32

33. Score Reports View Interim Assessments before administration Interim Blueprints, AVA and THSS guides and training PowerPoint on Scoring and ELA & Math Exemplar Sets and Training Guides for Calibration Classroom Activities for Interim Assessments Administer Secure Interim Assessments Hand Scoring system Interim Access Points

34. Item Number and Target Results by Class Interim Block

35. Test Management Center –Participation Reports in Plan and Manage Testing (have/have not completed) –Test completion rates (by school, grade, subject and opportunity) –Summary Statistics (percent proficient, not avail. For IAB) –Retrieve student results (download excel files by district, school, teacher, and roster) Score Reports –Interim Assessments –Summative –MSP/EOC/HSPE Online Reporting System

36. For Assistance Test Administrators: Contact the School Coordinator School Coordinator: Contacts the District Assessment Coordinator District Assessment Coordinator: Contacts OSPI Technical Support: American Institute of Research - Washington Help Desk wahelpdesk@air.org 1.844.560.7366 36