2016-17 DTC Training WebEx Required for All DTCs Tuesday, November 8, 2016 (3:00 – 4:30 p.m. PT) Wednesday, November 9, 2016 (9:00 – 10:30 a.m. PT) Thursday, November 19, 2016 (3:45 – 5:15 p.m. PT)
DTC Training Requirements All District Test Coordinators must: Watch all 2016-17 Training Modules Submit response to 2016-17 Training Survey Participate in ODE-facilitated Webinar Objectives for today’s Webinar: Ensure a common understanding of the test administration requirements of the Oregon Statewide Assessment System Clarify misconceptions identified through Training Survey results Address questions raised by DTCs In addition to reading the Test Administration Manual and signing a DTC Assurance of Test Security form, the DTC training requirement has three parts (read from slide). To confirm, you should all have previously completed steps 1 and 2. By participating in today’s WebEx, you are satisfying the third and final component of the DTC training requirement.
Format and Norms for Today’s Webinar Review questions and correct answers from the Training Survey covering all training modules Discuss common incorrect answers and clarify rules and policies Norms If you would like to speak, please use the raise hand feature and we will unmute you Use chat feature to submit questions to host Please allow the host to respond to all questions
DTC Quiz Reviewing the answers
98% 98% 93% 90% 78%
98% 99% 94%
97% 97% 92%
89% 61% 39%
92% 84% 86% 81% 90% 88% 90% Retain Securely Retain Securely Destroy Immediately 84% Destroy Immediately 86% Retain Securely 81% Destroy Immediately 90% Retain Securely 88% Retain Securely 90% Destroy Immediately
98% 100% 87% 83%
100% 98% 89% 100% 94%
87%
97% 91% 98% 91% 98%
97%
96%
99% 69% 94% 75% 91%
91% True 68% False 88% True
98%
94%
74% 90%
87%
96% Accommodations 18% Designated Supports 78% Universal Supports
New form and common improprieties
Form Link: Accessing the form https://app.smartsheet.com/b/form?EQBCT=24a13544b 66748589270272ce51241e0
Transition to an online Form The purpose behind this change in procedure is to ensure consistent data formatting. eliminate incorrect transcriptions of handwritten forms. provide DTCs with more detailed information about determinations and outcomes. The new form contains all of the same fields as the old form with a streamlined template upload to submit multiple tests for the same type of impropriety
Overview If the person filling out this form is not the DTC, the DTC will be contacted before a determination is made.
This information is located in TIDE under “Plan & Manage Testing” Locating a Results ID This information is located in TIDE under “Plan & Manage Testing”
Incident Information If one or multiple students have multiple tests impacted, an attachment will need to be uploaded.
Additional Test Uploads Link: Add direct link once Cindy posts
Selecting a “District Recommended Outcome” “Pending – Investigation Underway” should only be used when the DTC needs more information before making a determination. If you select this option, ODE will not provide a final determination.
Submitting the form We encourage you to check the “Send me a copy of my responses” box. However, if you don’t, the information you provided is included in the summary report email from ODE with a final determination
After Submission After selecting “Submit”, you will see the following:
Final Determination Within 1- 2 business days, the DTC will receive the following email and report summary from ODE confirming the outcome for all impacted tests or requesting additional follow-up information as applicable: This report summary will serve as final confirmation of the district’s investigation and the ODE approved outcome. If a district requires a formal letter of final determination in addition to this report summary, the DTC will submit a request via email to ode.testsecurity@ode.state.or.us.
2015-16 Improprieties Summary Initiator Total Tests Adult 484 Student 396 Resolution Total Tests Reopen Test 2 Destroy invalid test--student allowed to retest 7 Destroy invalid test 12 Test Reset 66 Invalidation 380 No Impact 412
2015-16 Improprieties Summary Type Total Tests Accidental Submission 2 Breach of student confidentiality 15 Data entered after administration window 11 IEP Violation 138 Improperly Administered 4 Mishandling of Secure Materials 33 No impropriety 3 Non allowable resource (notes/homework, text book, Dictionary) 60 Non allowable resource (other computer, gaming device, iPad, iPod, or other electronic device) 23 Non-allowable resource (calculator) Non-allowable resource (cell phone) 122 Non-allowable resource (other) 8 Non-secure Environment 32 Review of secure test item 1 Secure materials mishandled Student cheated 22 Student Coaching 41 Student given wrong SSID Student given wrong test 19 Student retested without parental permission 17 Student tested outside of testing window 10 Student tested under wrong ID 12 Students did not receive directions 5 Students Talking 125 TTS Incorrectly Set 40 Untrained TA 20 Wrong Test 31 Wrong test settings 21
Requirements & Resources Training Requirements & Resources
Training Requirements Review Ensure that all STCs and TAs: Receive annual training Read and understand the Test Administration Manual Sign assurance of test security form Ensure that all non-TAs with access to the secure test environment or materials: Understand the importance of maintaining security One of the most important roles of the DTC is to ensure that all STCs and TAs are trained annually. In addition to using the ODE-provided training modules, STCs and TAs must read the required sections of the current TAM and OAM as well as submit the correct completed Assurance of Test Security form. Once trained, STCs can assist the DTC in training TAs within their school. Please note that any individual who will be interacting with students during administration of an Oregon Statewide Assessment is considered a TA and must complete the training. To protect the security and validity of the assessments, DTCs are also responsible for ensuring that all non-TAs understand the importance of maintaining security and have submitted a signed Non-TA Assurance of Test Security form. This includes any person with access to the secure test environment or materials but will not be interacting with students during administration of a test, such as front office or technology staff. TAM, Section 1.5: Training Requirements
Required Modules Module 2: TA Training Module 3: Accessibility Supports Module 4: Test Security Module 5: Smarter Balanced Module 6: OAKS Online Science and Social Sciences Module 7: ELPA21 Required for all TAs Required for TAs based on the test(s) they will administer Here is a quick overview of the training modules that TAs are required to review. Modules 2, 3, and 4 are required for all TAs. Modules 5, 6, and 7 are specific to the test the TA will administer. For example, a TA who is only administering ELPA21 is required to review Modules 2, 3, 4, and 7 but does not need to review Modules 5 or 6. Test administration and security training modules: http://www.ode.state.or.us/search/page/?id=2744
TIDE Users TIDE User Guide, p. 4
Facilitation Guides Provide a high level summary of required module training topics Connects required modules to supplemental resources Clarifies opportunities in required modules where local information may be added Will be posted as PDF on ODE website but available in Word by request
Facilitation Guides
TIDE Training To support users in the transition to the new Test Information Distribution Engine (TIDE), ODE and AIR have scheduled two optional webinars focusing on how to use the newly-redesigned TIDE: Tuesday, November 15 from 9 a.m. to 10 a.m. PT Thursday, November 17 from 3:00 p.m. to 4:00 p.m. PT The same material will be covered in both trainings. These webinars are open to any TIDE user role and will be recorded and posted to the ODE website.
New ODE Website Launching Late December All URL links will be updated in manuals and user guides Access to old site is anticipated to be discontinued in January
Congratulations! You have successfully completed your 2016-17 DTC training requirements Next steps: Local training of STCs and TAs Monitor weekly AA Updates for updates related to assessment and accountability, distributing to staff as appropriate OAKS Online test window opens Jan. 10 ELPA21 test window opens Jan. 10 Smarter Balanced test window opens Feb. 7 Extended Assessment test window opens Feb. 16 Happy testing!