Georgia Milestones Assessment System Spring & Summer eDIRECT Test Setup Training March 6, 2018 & March 13, 2018

Introductions GaDOE DRC Sandy Greene, Ed.D., Director, Assessment Joe Blessing, Assessment Specialist Mary Nesbit-McBride, Ph.D., Assessment Specialist Robert McLeod, Ed.D., Assessment Specialist Chris Shealy, Director, Technology Services DRC Anu Tummala, Program Management Michelle Gronemeyer, Program Management Evan Gedlinske, Program Management Stuart Bowlus, Program Management Missy Shealy, Program Management Phil Peterson, Customer Care

Training opportunities Available on eDIRECT: https://ga.drcedirect.com General Information/Documents/ http://gadoe.org/milestones Georgia Milestones Presentations (Found under Resources) Links to registration and recording March 6, 2018 (9 AM – 12 noon) https://attendee.gotowebinar.com/register/3987212176022513666 March 13, 2018 – Live Repeat (1-4 PM) https://attendee.gotowebinar.com/register/ 8710549202204075778

Training Videos QuickStart Videos and Guides eDIRECT Student Setup Test Sessions Monitor Student Progress Accommodations Report Delivery Online Presentations Testing Irregularities Multiple Student Upload Can be found off the EOG Resources or EOC Resources pages. http://www.gadoe.org/Curriculum-Instruction-and-Assessment/Assessment/Pages/Milestones_Training.aspx

Secure Practice Test with Response Transmission Agenda User administration Assigning New Permissions Additional Materials Test Setup Student Management Test Session Management Tracking Status Secure Practice Test with Response Transmission

eDIRECT DRC INSIGHT Testing Site Manager System Overview Portal for interacting with DRC Documents and Reports Test Sessions and Status DRC INSIGHT Test Engine Online Tools Training Secure Browser Testing Site Manager Content and Response Caching Readiness Tools

Upcoming Training – Spring/Summer 2018 Spring Training 2/13 10:00 am INSIGHT Installation/eDIRECT Training https://attendee.gotowebinar.com/register/4997649068297320194 2/20 1:00 pm INSIGHT Installation/eDIRECT Training (Live Repeat) https://attendee.gotowebinar.com/register/6406864534315580418  2/27 10:00 am End-of-Grade/End-of-Course Spring Pre-administration Webinars https://attendee.gotowebinar.com/register/3438226020274949889 3/1 1:00 pm End-of-Grade/End-of-Course Spring Pre-administration Webinars (Live Repeat) https://attendee.gotowebinar.com/register/3839772064785290241  3/6 9:00 am eDIRECT Test Setup Training https://attendee.gotowebinar.com/register/3987212176022513666 3/13 1:00 pm eDIRECT Test Setup Training (Live Repeat) https://attendee.gotowebinar.com/register/8710549202204075778 5/30 10:00 am Milestones Post Assessment Central Office Services Training https://attendee.gotowebinar.com/register/3379926615252206338

Key Dates– Spring/Summer 2018 EOG EOC Key Dates 2017-2018 Year Round Practice Test Ends 4/6 Secure practice Test With Response Transmission 3/6 Availability of DRC eDIRECT Test Setup for spring test session creation, etc. 3/16 3/30 Spring materials deliveries begin 4/9-5/18 4/23-6/1 Spring Testing Window 5/14-7/20 6/18-7/20 Summer EOG Retest and EOC Summer Main Window 4/9-4/20 Summer EOC Enrollment Counts 3/26 4/9 Additional Materials Ordering 4/23 5/21 Availability of DRC eDIRECT for summer test session creation, etc. 4/25 5/30 Summer paper materials delivery begin 6/22 7/11 Final reports Electronic Summary Reports 6/27 7/13 Electronic ISRs and Class Rosters 7/20 7/31 Paper reports delivered no later than… Summer Availability of DRC eDIRECT Test Setup for sessions creation etc. 5 days 10 days ELA, Math 5 days Science and Social Studies Summer Preliminary Reports (business days from receipt of scorable test documents) 8/7 8/8 Summer Electronic Final Reports

Scoring and Reporting Timelines Important Note: Failure to follow protocols and/or notify GaDOE and DRC of local testing windows will impact (delay) reporting dates. Enrollment Guide: https://ga.drcedirect.com/Documents/Unsecure/Doc.aspx?id=d0f70d32-aa65-43e2-b75a-4b5f7e2fbbc3

Assigning Permissions for New Administration

User Administration, Edit

User Administration, Edit View/Edit Reset Inactivate

Edit User, Permissions

Edit User, Permissions

Edit User, Permission Sets System Test Coordinator School Test Coordinator School Technology Coordinator

Edit User, Mass assign permissions

eDIRECT Permissions

Additional Materials

Additional Materials

Testing Software

Testing Software Secure Browser Version 8 TSM Version 9.2 Released last fall If you previously installed the Secure Browser with Auto-Update selected, it will automatically update to the new version on the next launch of the software TSM Version 9.2 If you have enabled auto updates in the TSM, this software will update without having to uninstall and reinstall You must be using the latest TSM and Secure Browser software Includes practice testing and operational testing

INSIGHT Portal Page The system will not allow a student to successfully log into a test if they choose the incorrect Test Sign In link.

Student Management

Source Data loaded to eDIRECT PreID Submitted to GaDOE Data loaded to eDIRECT Students marked for online testing have been placed into Online Test Sessions Based on Course and Teacher Students marked for paper testing have been placed into Paper Test Sessions

Students – Manage Students Must select a school in order to Add Student(s) View/Edit

Students – Add/View/Edit Student Detail

Students – Add/View/Edit Accommodations Step 1: Activate/Assign Accommodation Prior to Student Login Activate Accommodation and Form Prior to Student Use Assign Form Prior to Login for Transcribing – No Student Interaction NEW FOR SPRING 2018 – Activate Accommodation and Form Prior to Student Use IMPORTANT -- Be sure to enter accommodations before printing test tickets! Some accommodations require specific test forms, which are assigned when students are placed into test sessions and reassigned when accommodations are entered. If you enter accommodations after printing test tickets, be sure to check if the password has been regenerated and reprint as needed.

Students – Add/View/Edit Accommodations Step 2: Enter the Accommodations type and select the basis of the Accommodation Code accommodation type Determine basis of accommodation IMPORTANT -- Be sure to enter accommodations before printing test tickets! Some accommodations require specific test forms, which are assigned when students are placed into test sessions and reassigned when accommodations are entered. If you enter accommodations after printing test tickets, be sure to check if the password has been regenerated and reprint as needed.

Students – Add/View/Edit Demographics

Students – Add/View/Edit Testing Codes EOC Only PTNA – Present, Test Not Attempted GAVS – Georgia Virtual School

Students – Multiple Student Upload

Students – Multiple Student Upload Newly submitted records will be matched against existing records based on System Code, Last Name, Date of Birth and GTID Existing records will be updated with latest information Students with teacher updates will be removed from existing test sessions and added to new test sessions if the students have not started testing New records will be added to eDIRECT Students marked for online testing will be placed into Online Test Sessions Based on Course and Teacher Students marked for paper testing will be placed into Paper Test Sessions Recommended method for bulk changes to testing mode or Test Session placement

Students – Reminder! Be sure that any updates you make to students in eDIRECT (one-by-one or via Multiple Student Upload) are also made in your local student information system!

Test Session Management

Test Sessions – Online and Paper Can be used for grouping students for administration Used for grouping students for reporting Test session naming convention: <Teacher Last Name>, <Teacher First Name>  When created by Pre-ID submission or Multiple Student upload Example: JOHNSON, BRENDA Session names can be edited through the end of the Test Setup window Session name assigned at time of final reporting will be used to group reports Will be unique by District, School, Assessment (grade and content area) Do not need to test in physical location to which student is assigned

Test Sessions – Paper Used to manage class-level reporting for paper-and-pencil testers Similar to online test sessions Students loaded to paper test sessions based on Pre-ID file Student Answer Documents with Pre-ID Label will match back to eDIRECT record Student Answer Documents with District/School Attempt to match based on System Code, Last name, GTID, and DOB. If match is found, linked to eDIRECT record. If no match found, create a new eDIRECT record. New records placed in “Undetermined” paper test session Students in Paper “Undetermined” sessions can be moved to new or existing sessions Through the end of the Test Setup window

Test Sessions – Paper Sample Checklist Prior to Testing Verify that all Paper Test Takers whose answer documents will be scanned are in a Paper Test Session Paper Test Takers who will have responses transcribed into an online form will need to be in an Online Test session and assigned the Large Print/Marks Answers in Test Booklet (Transcription form only) or the Braille (Transcription form only) online form. Once in a Paper Test Session, information on the Student Details, Accommodations, Demographics, and Testing Codes tabs can be managed in eDIRECT

Test Sessions – Paper Sample Checklist During Testing System discretion – any Irregularities approved by DOE can be entered into eDIRECT on the Testing Codes tab; no need to wait for answer documents As needed, make ongoing changes in Student Detail, Accommodations coding, Demographics, and Testing Codes. Note that any information from the answer document with the exception of District Code, Last Name, First Name, GTID and DOB will overwrite any existing information in eDIRECT; no exact match on this latter information will result in the creation of a new Student Profile assigned to the “Undetermined” Test Session

Test Sessions – Paper Sample Checklist – continued After Testing Account for ALL answer documents and separate scorable from nonscorable Verify a Pre-ID label is affixed to page 1 of each answer document and that it matches the student name printed in the top left-hand corner of page 1 For students who do not have a Pre-ID label: 1) verify they have an existing Student Profile and 2) are in a Paper Test Session in eDIRECT, 3) have demographic information bubbled on the answer document and 4) have a School/District label affixed in the Student Label space on page 1 of the answer document If it is the district’s decision for the answer document to be the source of all information in the student data record, be sure all necessary entries are complete Return answer documents following guidance in the Test Coordinator’s Manual

Test Sessions – Paper Sample Checklist – continued After Scanning and Posting of Preliminary Reports Verify all Paper Test takers have results posted in eDIRECT taking care to look for mismatches between an exiting Student Profile and information incorrectly entered on the answer document. Check to see if there are students in the “Undetermined” Test Session; they can be moved to the Test Session from which they are to be grouped for reporting Check for any Paper Test Takers with a scoring designation of LCE; make corrections in the Irregularity fields on the Testing Codes tab.

Test Sessions View/Edit Export Details Copy Edit/Print Ticket Print All Delete

Test Sessions – Add Test Session Add Selected Remove Selected Add All Remove All

Test Sessions – View/Edit Add Selected Remove Selected Add All Remove All 43

Test Sessions – Edit/Print Test Ticket Currently if a student submits prematurely from a test, the System Test Coordinator can unlock the test ticket to allow the student back in. Use Print Selected to print individual tickets (or Print All to print all) 44

Test Sessions – Export Student Details Session, Content Area and Assessment filters can be used to refine number of students exported Use the Export Student Detail button to export a CSV list of all students who are in a all test sessions currently listed (for a school) Use the Export Student Detail feature to export a CSV list of students who are in a specific test session. 45

Test Sessions – Export Student Details Export Student Details will provide a means to check testing codes and coding of accommodations

Test Sessions – Test Tickets and Test Rosters Each Test Ticket contains the student’s username and password for the test session. Note that the student will have a separate Test Ticket for each section of the test. Test tickets will print one per page and can be used as a sheet of scratch paper. Usernames and passwords are NOT case sensitive The Student Test Roster contains a list of students and their: usernames/ passwords form numbers assigned online accommodations Note that Username is always “Student First Initial – Student Last Name – Number” and Password is always “Four Character Word – Four Digit Number”, and are printed in ALL CAPS

Special Scenarios Student was going to test on paper but will now test online Move the student to an existing or new online test session for the assessment(s) that they will be taking Securely destroy the unused PreID label Return the unused test materials See School and System Test Coordinator’s Manual for more details Student was going to test online, but will now test on paper Move the student to an existing or new paper test session for the assessment(s) that they will be taking Hand-grid the student’s paper answer document, ensuring that last name, date of birth and GTID match the student’s online information Place a District/School Label on the answer document

eDIRECT Test Session Quick Reference Online Paper Naming Conventions Pre-ID Submission or Multiple Student Upload – Teacher Last Name, Teacher First Name Manual entry – local decision Scanned paper answer document with no preassigned session - Undetermined Session name can be edited at any time regardless of means of entry Moving Student(s) to Another Session Prior to logging in to a Session – YES After logging in to a Session – NO Students can be moved to another Session at any time prior to closing eDIRECT for final reporting Changing Testing Mode To Online from Paper Prior to testing remove student from paper session add to a new or existing Online Test Session To Paper from Online Prior to logging in to an Online Test Session remove the student from the online session add to a new or exiting Paper Test Session Suggested that Multiple Student Upload be used for substantial numbers of additions, updates, or corrections

Tracking Status During Testing

Tracking Status During Testing eDIRECT provides a number of ways to help you track the progress of students in testing. During online testing windows, we recommend checking the status daily and again once all planned testing is complete.

Tracking Status for Online Testing Pay special attention to students whose Status = “In Progress” Could represent students who exited the test using “Pause/Exit” rather than “Review/End Test > End Test > Submit”. “In Progress” tests are processed, scored and reported as Completed tests at the end of the state testing window only. Ensure that any tests that require invalidation are coded correctly.

Tracking Status for Online Testing Log into eDIRECT https://ga.drcedirect.com From the top navigation pane, select Manage Test Sessions under the Test Management group.

Tracking Status for Online Testing Choose Administration > school (if required) > Status Summary Tab > Show Sessions This shows all students who are in the system.

Tracking Status for Online Testing The Session Summary will show the total number of Sessions in Progress. The Student Summary will show the number of Students in Progress for each course.

Tracking Status for Online Testing The Student Summary by Test Session will show the number of students in progress with School, Session, and Assessment listed.

Tracking Status for Online Testing Student sessions are “In Progress” will be Locked overnight. In Progress or Locked sessions will not be sent for preliminary reporting. Locked sessions will need to be Unlocked to end tests correctly. Attempt to review and resolve “In Progress” sessions before students leave for the day, where possible.

Tracking Status for Online Testing Additionally, if you are using response caching, confirm that all responses have been cleared from each TSM Daily during active testing Once again at the end of your test window Refer to the DRC INSIGHT Technology User Guide for more information. This guide can be found on eDIRECT under General Information – Documents.

Tracking Status for Online Testing Number of questions attempted for students in Completed status Test Management > Manage Test Sessions > Edit/Print Test Ticket Hovering over Completed status will provide the number of questions attempted Practice questions are included in the count; Multi-Part items count as one.

Student Status Dashboard Requires the “Test Setup – View Student Status” permission Allows users to view the testing status of students Allows users to filter to a school level site and administration for which they have access Dashboard will automatically update Results displayed will also dynamically update as filters are added/removed

Student Status Dashboard Access the dashboard via Student Management, click Student Status Dashboard Enter at least 3 characters (school name or school code) Select the administration

Tracking Status for Paper Answer Documents

Tracking Status for Paper Answer Documents Provides systems and schools with the following information: Quantity of answer documents sent to systems by DRC Quantity of answer documents received by DRC Quantity of answer documents checked in as “used” View this data after returning materials to DRC Reports are updated daily Systems will be responsible for reporting any discrepancies between what they returned and what DRC checked in as used

LCE Roster

Secure Practice Test with Response Transmission October 2 – April 6

Secure Practice Test with Response Transmission – Test Setup The Secure Practice Test with Response Transmission will be its own unique administration – no longer combined with EOG or EOC spring administrations. Students included in the Spring Pre-ID file have been loaded into the system Additional Students may be added through Multiple Student Uploads or manually added Test sessions will not be created through the Multiple Student Upload process District can either create test sessions by class or create a single test session for all students at a school. Students will need individual test tickets for each test, just like for operational testing.

Secure Practice Test with Response Transmission – Test Setup

Secure Practice Test with Response Transmission – INSIGHT Setup INSIGHT should be setup the same for the Practice Test as it will be for the main administration including: Software on the student machines TSMs Configurations in the Central Office Services – Device Toolkit

Secure Practice Test with Response Transmission – Test Content Students will login through the Secure Practice Test (EOG & EOC) System/School will give student test tickets Students will take the same test items as Secure Practice Test One assessment for each EOC course One assessment for each EOG grade, with items from each content area (Select English Language Arts in the Content Area drop-down for EOG grades 3-8 practice tests) Systems/Schools will not receive reports

Secure Practice Test with Response Transmission – Test Sign In

Secure Practice Test with Response Transmission – Test Tickets Standard Practice Ticket (No Response Transmission) Generic information Print for all students for assessment In eDIRECT Documents Available year-round Practice Ticket (Response Transmission) Unique ticket per student Printed from eDIRECT Test Sessions Available October 2 – April 6 For an individual student to take an assessment multiple times, the test ticket must be regenerated

Secure Practice Test with Response Transmission – Planning Assign accommodations, place students in test sessions, and print/distribute test tickets. Ensure that INSIGHT is installed and configured as it will be for operational testing. Consider factors such as competing network activity. The peripheral activities on the network can have a devastating impact on the testing experience. Plan for a number of concurrent testers that does not exceed planned number of concurrent testers for operational testing, and is supportable based on network considerations, TSM specifications, etc. Stagger student start times. One approach would be to have some students start at 5 minutes before the hour, some on the hour, and some 5 minutes after the hour. This will help reduce the load on the local network and TSMs.

Secure Practice Test with Response Transmission – What to Watch Bandwidth usage Wireless performance, if applicable Guest network usage Other network usage Video streaming Bandwidth use at others schools while other schools are testing Personal devices

Non-Participants School Test Coordinators should collect by subject or grade level content non-participants. This list should be forwarded to the District Test Coordinator for the CCRPI Non- Participation Collection. Medical Emergency – Documentation on file locally Illness Other Unknown Opt-out EOC Course Not Completed* EOC Course Not Taken for Core Credit* EOC Administered Previously* Direct questions on the definition of non-participant and the above categories to your district’s Accountability Specialist. *Probable rewording for 2018 CCRPI Reporting

Upcoming in 2018-2019 Move from TSM to Central Office Services (COS) for Content Caching Updates Content Caching with centralized controls for multiple programs and increase scalability Available June 2018 with full implementation in August 2018 Training May 30, 2018 https://attendee.gotowebinar.com/register/3379926615252206338 Response Caching/Local Caching update – Summer 2018 New INSIGHT Browser release July 21, 2018 Move to Georgia Milestones testing 100% online

eDIRECT: https://ga.drcedirect.com Thank you! eDIRECT User Guide eDIRECT: https://ga.drcedirect.com Found under General Information/ Documents DRC Georgia Customer Care Hours of Operation: 7 am – 8 pm EST Phone: (866) 282-2249 Email: gahelpdesk@datarecognitioncorp.com

Questions?