Test Coordinators Training (Required for DTCs & STCs)

Big Picture Objectives Understand the roles and responsibilities of district and school test coordinators Understand resources available to effectively train test administrators Understand how to use the Test Administration Manual to understand requirements and ensure secure test administration and valid test results Learn about additional resources and tools

Training Overview Training will cover the following topics: Test Coordinator Roles & Responsibilities Test Administrator Training Accessibility Supports Test Security Smarter Balanced Administration OAKS Online Science and Social Sciences Administration ELPA21 Administration -The purpose of these slides is to provide DTCS and STCS with a framework for unpacking the test administration manual and understanding how to use the manual to meet their roles and responsibilities. The training is organized into the following topical modules. -Each training module is designed to take between 5 – 15 minutes to present. Primary source: Test Administration Manual

Training Format Organized into short modules Designed to be delivered to district and school staff Focus on orienting test coordinators to the Test Administration Manual

OAKS System Components Test Information Distribution Engine (TIDE) Student demographic information collected Student test settings entered Test Delivery System (TDS): TA Interface Test sessions created Students approved to test _______________ Student Interface Students log into tests Students take tests Online Reporting System (ORS) Test results reported Item Tracking System (ITS) Test questions created reviewed, and edited Questions assembled into tests Here’s an overview of Oregon’s online testing system—OAKS. The major online assessment components will continue with key improvements, some resulting from lessons learned during the Smarter Balanced Field Test.

District Test Coordinator (DTC)’s Role Test administration and security training Coordinate access to OAKS System and testing data Coordinate testing logistics Coordinate student testing options Investigate and report any test improprieties to ODE DTCs are responsible for the following activities: --ensure that all district and school staff involved in state testing receive training in test administration and security --coordinate and monitor which staff have access to the OAKS System and secure testing data. This involves setting up user accounts with appropriate levels of access --coordinate school-imposed test windows, maintain secure storage and distribution of paper test materials, coordinate with network administrator/IT department to ensure technical requirements are met --coordinate and monitor student test settings in TIDE, ensuring students have access to the correct test formats (e.g., extended, Braille) and accessibility options, and ordering Extended or Kindergarten tests --investigate test improprieties and report to ODE, including follow-up action taken by district and ODE. This last aspect of the DTC’s role will be covered separately in Module 4: Test Security. TAM, Section 1.4: User Roles

School Test Coordinator (STC)’s Role Ensure all TAs in your school are trained Ensure that all students in your school participate in required assessments Coordinate testing logistics and school- imposed test windows for your school Coordinate student testing options for students in your school Support DTCs in investigating test improprieties STCs are responsible for the following activities at the school level in support to the DTC: --ensure that all school staff involved in state testing receive training in test administration and security, including aides, subs, and volunteers --coordinate and monitor student test settings in TIDE, ensuring students have access to the correct test formats (e.g., extended, Braille) and accessibility options --coordinate school-imposed test windows, maintain secure storage and distribution of paper test materials, coordinate with network administrator/IT department to ensure technical requirements are met --support DTCS in investigating test improprieties TAM, Section 1.4: User Roles

Ensuring All Staff Are Trained Ensure that all STCs and TAs: Receive annual training Read and understand the Test Administration Manual Sign assurance of test security form Disseminate ODE-issued testing updates and alerts to staff involved in state testing Respond to questions from staff using Regional Assessment support partners when necessary TAM, Section 1.5: Training Requirements

Test Administrator (TA) Training: Reminder of Requirements Module 2: TA Training Module 3: Accessibility Supports Module 4: Test Security Module 5: Smarter Balanced Module 6: OAKS Online Science and Social Sciences Module 7: ELPA21 Required for all TAs Required for TAs based on the test(s) they will administer TAM, Section 1.5: Training Requirements

TA Training (cont’d) : Reminder of Requirements In addition to Test Administration and Security Training, ensure that: All Braille Interface TAs in your building receive additional ODE-provided training specific to configuring the Braille Interface All Extended Assessment TAs in your building receive additional ODE-provided Qualified Trainer or Qualified Assessor training All Kindergarten Assessment TAs in your building receive separate Kindergarten Assessment Training using ODE-provided modules. TAM, Section 1.5: Training Requirements

Creating District and School Level User Accounts in TIDE One “DTC” allowed per district, with multiple “District Level User” roles permitted DTC creates district- and school-level accounts: District Level Users District Report Viewers School Test Coordinators School Report Viewers Test Administrators Test Technicians TIDE User Guide

Student Test Options: Scenarios and Resources Assigning embedded designated supports and accommodations in TIDE Targeting students up to a higher grade level Allowed for Smarter Balanced Math & ELA and OAKS Online Science & Social Sciences Not allowed for KA, Extended, or ELPA21 OAM, Appendix A; TAM, Appendix B: Student Inclusion; TIDE User Guide

Student Test Options: Scenarios and Resources (Cont’d) Managing test formats and restricting access (Example: Extended vs. Online testing) Managing retests OAKS Online Science & Social Sciences Grade 12 Smarter Balanced retest opportunity Managing parent-requested exemptions Smarter Balanced uses new HB 2655 opt-out process Exemptions for all other assessments must be based on disability or religion TAM, Section 5.3 Parent Requests for Exemption; TAM, Appendix B: Student Inclusion; TIDE User Guide

Essential Skills and Local Performance Assessment Manual: Reminder of Requirements 2015-16 Essential Skills and Local Performance Assessment Manual posted on the Essential Skills homepage October 5th. Required reading for DTCs; recommended resource for educators. Note: Grade 12 opportunity on Smarter Balanced Assessment available for 2015-16.

Statewide Test Schedule http://www.ode.state.or.us/search/page/?id=499 Smarter Balanced Grades 3 – 8 2/9 – 6/10 High School 2/9 – 6/10 OAKS Online Science and Social Sciences 1/5 – 6/10 ELPA21 2/2 – 4/12 Extended Assessment 2/18 – 4/28 Kindergarten Assessment 8/10 – 10/22 PSAT/NMSQT 10/14 or 10/28 NAEP 1/25 – 3/4 TAM, Appendix A: Statewide Test Schedule

School-Level Test Windows: Reminder of Requirements Designed to ensure that testing occurs at the appropriate time in relation to student instruction Provides districts and schools local flexibility to manage resources For Smarter Balanced (grades 3 – 8 and 11) schools must wait until 66% of the school’s annual instructional days have been completed before testing (leaving an approximately 12-week test window) TAM, Section 5.2: School-Level Test Windows

Managing School-Level Test Windows: Resources District-level users may optionally set school-level test windows by grade and subject in TIDE TDS will only list tests for TAs to include in a test session during that test’s school-level test window Here is a mock-up of the new tool Please note that TIDE is still under development for 2015-16, so this is not a final depiction Recommended (but not required) to help districts ensure that the right tests are administered at the right time

Regional ESD Helpdesks: Policy Contacts Derek Brown, Interim Assistant Superintendent of Assessment & Accountability Essential Skills Implementation derek.brown@state.or.us, (503)947-5841 Holly Carter, Interim Director of Assessment Test Security and Administration Policies holly.carter@state.or.us, (503)947-5739 Jon Wiens, Manager of Accountability & Reporting Accountability and Reporting jon.wiens@state.or.us, (503)947-5764 Beth LaDuca, NAEP State Coordinator beth.laduca@state.or.us, (503)947-5836 Brad Lenhardt, Monitoring, Assessment, & Accommodations Specialist Accessibility & Accommodations Alternate Assessment brad.lenhardt@state.or.us, (503)947-5755 Kathleen Vanderwall, Manager of Test Design Test Development kathleen.vanderwall@state.or.us, (503)947-5721 Test Improprieties ode.testsecurity@state.or.us Regional ESD Helpdesks: http://www.ode.state.or.us/go/assessmenthelp

Regional Support Structure ODE will provide information through DTC listserv and Regional ESD helpdesks Regional ESDs are the best source for assessment support The state has been divided into three regions: Willamette ESD, Douglas ESD, and InterMountain ESD Regional ESD contact information online http://www.ode.state.or.us/go/assessmenthelp

Related Reading Requirements by Role User Role Description District Test Coordinator Sections 1 – 14 of the TAM Appendices A – F of TAM The Oregon Accessibility Manual (OAM) School Test Coordinator Sections 1 – 12 of the TAM Appendices A – F of the TAM The OAM

Online Resources ODE staff contact information: http://www.ode.state.or.us/search/staff/ Assessment & Accountability webpage: http://www.ode.state.or.us/search/results/?id=385 Regional ESD Helpdesk contacts: http://www.ode.state.or.us/go/assessmenthelp Test Administration Manual and Best Practices Guide: http:www.ode.state.or.us/go/tam Accommodations Manual and Webpage: http://www.ode.state.or.us/search/page/?=487 Extended Assessment Updates: http://www.ode.state.or.us/search/results/?id=178 Extended Assessment Manual: http://www.ode.state.or.us/search/page/?id=2691 Promising Practices: http://www.ode.state.or.us/search/page/?=2444 Training Modules: http://www.ode.state.or.us/search/page/?id=2744 Test Security Forms: http://www.ode.state.or.us/go/testsecurity