1. OFFICE OF COLLEGE AND CAREER READINESS Missouri Department of Elementary and Secondary Education February 2015 Grade-Level Assessments Training for District and School Test Coordinators Spring 2015 (Updated February 20, 2015) 1

2. Office of Civil Rights Non-Discrimination Statement The Department of Elementary and Secondary Education does not discriminate on the basis of race, color, religion, gender, national origin, age, or disability in its programs and activities. Inquiries related to Department programs and to the location of services, activities, and facilities that are accessible by persons with disabilities may be directed to the Jefferson State Office Building, Office of the General Counsel, Coordinator – Civil Rights Compliance (Title VI/Title IX/504/ADA/Age Act), 6th Floor, 205 Jefferson Street, P.O. Box 480, Jefferson City, MO 65102- 0480; telephone number 573-526-4757 or TTY 800-735- 2966; email civilrights@dese.mo.gov. 2

3. Navigation Tools  This training, the presentation PowerPoint, and other training resources are available on DESE’s website at http://dese.mo.gov/college-career- readiness/assessment/grade-level http://dese.mo.gov/college-career- readiness/assessment/grade-level  User Tools  Pause  Skip  Full Screen  Panel Version  Volume Control 3

4. Training Audience and Objective  This training is intended for District and School Test Coordinators (DTCs and STCs).  Training objectives:  To provide updates on the MAP Grade-Level Assessments  To provide standardized training for administration of summative MAP Grade-Level Assessments  This training does not replace a thorough review of all the manuals associated with Grade-Level Assessments. 4

5. Agenda  Overview of Spring 2015 Grade-Level MAP Assessments  Purpose of the Test Administration Manual (TAM)  Review of Important Dates  Resources  Test Administration Policies  Scheduling the Tests  Steps in Preparing for, Administering, and Closing Assessments  Accommodated Test Forms 5

6. Overview of the Spring 2015 Grade- Level Assessments 6  Content Areas and Grade Levels  English language arts and Mathematics Grades 3 through 8  Science Grades 5 and 8

7. Overview of the Spring 2015 Grade- Level Assessments (cont.) 7  Administered online  CTB/McGraw-Hill – Missouri’s vendor for MAP Grade-Level Assessment  DRC – CTB’s subcontractor providing the assessment platform  eDIRECT  INSIGHT

8. Overview of the Spring 2015 Grade- Level Assessments (cont.) 8  English language arts and Mathematics  Grades 3, 4, 6, and 7 – Single component (two sessions)  Selected Response Items  Constructed Response (Short Text) Items  Technology Enhanced Items  Grades 5 & 8 – Two components  Component 1 – Selected response items, constructed response items and technology enhanced items (two sessions)  Component 2 – Performance Task  Science (Grades 5 and 8)  Session 1 – Constructed Response Items  Session 2 – Selected Response Items  Session 3 – Performance Event

9. Purpose of the Test Administration Manual (TAM)  The Test Administration Manual (TAM) provides detailed instructions to the DTC and the STC for managing administration of the Grade-Level Assessments.  Grade-Level Assessment Manuals are available on the DESE website at http://dese.mo.gov/college-career- readiness/assessment/grade-levelhttp://dese.mo.gov/college-career- readiness/assessment/grade-level and on eDIRECT at https://mo.drcedirect.com/ https://mo.drcedirect.com/  DTCs should contact CTB or DESE about any issues that arise which are not specifically addressed in this training or in the manuals. 9

10. Review of Important Dates Important Dates for Testing January 7, 2015DTCs receive welcome email and login information to eDIRECT January 12, 2015-February 20, 2015Window for DTCs to provide grade- level/content area testing windows, purchase order numbers, and Large Print and Braille orders January 30, 2015Deadline to submit precode to DESE March 5, 2015Student precode data available in eDIRECT March 5, 2015 through beginning of testingIndicate all students’ accommodations and designated supports in eDIRECT March 30, 2015-May 22, 2015Statewide Spring 2015 Testing Window May 26, 2015Deadline for DTCs to schedule pickup of Braille, Large Print, and paper/pencil testing materials 10

11. Training and Resources 11  DESE Training  Test Administration Manual  CTB/DRC Training  eDIRECT  INSIGHT  Manuals  DESE website  http://dese.mo.gov/college-career- readiness/assessment/grade-level  Missouri eDIRECT Portal  https://mo.drcedirect.com/

12. Training and Resources (cont.) 12 To access Trainings and Manuals:

13. Test Administration Policies – General Rules of Online Testing 13  Each component or session of a test is presented as a separate test  Students may not return to a test once it has been completed and submitted.  Within each component of a test, there may be segments  Students must confirm that they have completed a segment before continuing  Students may not return to a segment once it has been completed and submitted  Students may mark items for review and return to those items within a segment  Science assessments (all sessions) and ELA and Math Performance Task  Students may mark items for review and return to those items within a test session

14. Test Administration Policies – Pause Rules 14  Short Break (up to 20 minutes)  No need to log back in  Count-down timer displays  Longer Break  Requires student to log back in

15. Test Administration Policies – Pause Rules (cont.) 15  ELA and Mathematics Non-PT Test Component and Science Assessments (all sessions)  Student can review and change responses in the same session (or segment within a session, if the session includes multiple segments)  Highlights and sticky notes will be saved  ELA/Mathematics Performance Tasks  Student can review and change responses Within the entire Mathematics PE Within the Part of the ELA PT on which the student was working at the time of the pause  Highlights and sticky notes will be saved within the session or part

16. Test Administration Policies – Test Timeout 16  Test Timeout  Students automatically logged out after 20 minutes of inactivity

17. Building a Testing Schedule 17  Statewide Testing Window  March 30 th -May 22 nd  Districts can complete assessments any time during the statewide window  District Grade-Level/Content Windows  DTC designates one window for each grade/content area  Grade/content windows can overlap  Considerations  Computer lab space/device availability  Report turnaround time  Make-ups

18. Building a Testing Schedule (cont.) 18 Non-PT Test Component English Language Arts (grades 3-8)90 minutes* Mathematics (grades 3-5)90 minutes* Mathematics (grades 6-8)120 minutes* * May be divided into two sessions Performance Task (Grades 5 & 8) English Language ArtsClassroom Activity – 30 minutes PT Part 1 – 60 minutes PT Part 2 – 60 minutes MathematicsClassroom Activity – 30 minutes Performance Task – 60 minutes English Language Arts and Mathematics Timing Guidelines

19. Building a Testing Schedule (cont.) 19  English Language Arts and Mathematics Sequencing Non-PT Test Component Classroom Activity Performance Task

20. Building a Testing Schedule (cont.) 20 Grade-Level Science Assessment (Grades 5 & 8) Session 1 (constructed-response items)45-55 minutes Session 2 (selected-response items)20-25 minutes Session 3 (performance event)45-65 minutes Science Timing Guidelines

21. Building a Testing Schedule (cont.) 21 Need more information??  More detailed timing information and guidelines are included in the TAM.

22. Preparing for Testing – Enter Testing Windows and Order Accommodated Test Forms 22 By February 20 th :  Enter testing windows in eDIRECT  Order Braille and Large Print test forms  Provide P.O. for billing purposes (enter number in eDIRECT and fax P.O. to CTB)

23. Preparing for Testing – Enter Testing Windows and Order Accommodated Test Forms (cont.) 23 Need to change your testing window??  The DTC can contact the MAP Service Line to adjust a testing window  Any adjustments to the end date of the testing window MUST be made prior to 8:00 p.m. on the end date designated in eDIRECT  A grade level/content area window CANNOT be reopened once it has closed

24. Preparing for Testing – Adding District Personnel to eDIRECT 24  STCs  Test Examiners  Other district personnel

25. Preparing for Testing - Technology 25  Secure Browser for student testing – INSIGHT  Device certification  Load simulations  Statewide Readiness Test (SRT)  February 10 th through 27th

26. Preparing for Testing – Who is Tested? 26  ALL students, including but not limited to:  MoVIP students  Homebound students  Students with IEPs/IAP/504 plans  Exceptions:  MAP-A eligible students  ELLs in the U.S. 12 cumulative months or fewer may be exempt from the ELA assessment  Accelerated mathematics students who are taking Mathematics End-of-Course Assessments do NOT take the Mathematics Grade-Level Assessments

27. Preparing for Testing – Designated Supports and Accommodations 27  Universal Tools  Available to all students  Embedded and non-embedded  Designated Supports  Can be provided to any student  Determined by a team of educators  Locally documented  Reflective of supports provided to the student in daily instruction/local assessment  Accommodations  Require IEP or 504 plan  DESE Resources  http://dese.mo.gov/college-career-readiness/assessment/grade-level (Resources tab) http://dese.mo.gov/college-career-readiness/assessment/grade-level  http://dese.mo.gov/communications/webinar/new-form-d http://dese.mo.gov/communications/webinar/new-form-d

28. Preparing for Testing – Designated Supports and Accommodations (cont.) 28  Set in eDIRECT before students begin testing:  Designated Supports  Accommodations

29. Preparing for Testing – Designated Supports and Accommodations (cont.) 29  Supports/Accommodations that require special planning  Use of a translator  Use of a scribe  Separate setting  Read-alouds  Paper/pencil and Braille/Large Print assessments

30. Preparing for Testing – Other Special Circumstances 30  Homebound students  Students in out-of-district placement:  Must be tested  May be tested using a paper/pencil test form or may test online using a district-provided device with INSIGHT installed

31. Preparing for Testing – Practice Tests and Tutorials 31  Online Tools Training (OTT)  Practice tests for all content areas  Available through eDIRECT and INSIGHT

32. Preparing for Testing – Practice Tests and Tutorials (cont.) 32  Tutorials  Video presentations of all available tools for each content area  Available in eDIRECT and INSIGHT

33. Preparing for Testing – Practice Tests and Tutorials (cont.) 33  The “Help” function

34. Preparing for Testing – Communicating with Parents 34  Notify parents of testing windows  Provide general information about testing  Identify resources for parents to become familiar with item types and tools within the system

35. Preparing for Testing – The Test Environment 35  Computer lab or testing room should be arranged to discourage students from viewing other students’ computer screens or devices  Any materials that may cue students to assessment process or content must be removed from the testing room

36. Preparing for Testing – Classroom Activities 36  Grades 5 and 8 ELA and Math  One 30-minute Classroom Activity per Performance Task  Precedes performance task  All students MUST participate in the Classroom Activity before they take the Performance Task  Designed to be an introduction  Classroom activity is NOT an assessment

37. Preparing for Testing – Classroom Activities (cont.) 37  Materials available through eDIRECT (Documents menu)  May be administered by classroom teacher/Test Examiner

38. Administering the Tests – Test Tickets 38  Each student will have a test ticket for each test session  Student test tickets should be printed and distributed to Test Examiners  Test tickets must be kept secure before testing and securely destroyed after testing  Test tickets indicate TTS or VSL accommodations

39. Administering the Tests – Test Tickets (cont.) 39  Test tickets are printed from the Test Setup menu in eDIRECT

40. Administering the Tests – Required and Permitted Materials 40  Required Materials  Workstation with Internet access, mouse and keyboard, or tablet device  External keyboard recommended with tablet device  Test ticket  Headphones  Permitted Materials  Scratch or unlabeled grid or graph paper and pencil Scratch paper especially recommended for ELA Performance Task Test Examiner must retain in secure location between Part 1 and Part 2  Physical calculator (for items that allow calculator use – grades 6-8 only)  English dictionary and/or thesaurus (during ELA Performance Task only)  List of tools available within the system (available in Appendix E of the TAM)

41. Administering the Tests – Required and Permitted Materials (cont.) 41  Calculator Policy  Calculators cannot have stored equations or functions  Calculators cannot have Internet connectivity  Students cannot use a calculator on a laptop or other electronic device  No calculators with QWERTY keyboards are allowed

42. Administering the Tests – Prohibited Materials 42  Electronic devices  Cell phones  Electronic music players  Digital cameras  Handheld scanners  Portable gaming devices  Any device that can connect to the Internet

43. Administering the Tests – Starting a Test Session 43  Students are grouped into “test sessions” according to the precode file  It is not necessary for students that are grouped in a “session” in the precode file to take tests at the same time or in the same location  The student’s test session begins when the student logs into the test

44. Administering the Tests – Starting a Test Session (cont.) 44  Test Examiners must follow instructions in the TAM  Directions for the Test Examiner stand out from regular text  Consider printing administration sessions of the TAM  Test Examiners should confirm that students have the correct Test Tickets  Test Examiners should guide students through the login process and ensure that demographic information is correct

45. Administering the Tests – Managing Test Sessions 45  During Test Sessions, Test Examiners:  Must adhere strictly to the script Test Examiners may pronounce one word in a sentence for a student upon request  Should maintain a natural classroom environment  Should monitor student progress

46. Administering the Tests – Managing Test Sessions (cont.) 46  Moving a Student During an Assessment  Pause and Exit the assessment  Escort the student to new location  Log the student into the assessment at the new workstation

47. Administering the Tests – Ending a Test Session 47  Scenario 1 – Students have finished a test component  Students press “End Test” to submit the test  Once a test has been submitted, a student can no longer log into that test component  Test Examiners must collect any scratch, grid, or unlabeled graph paper  Scenario 2 – Administration of a test component will continue during another test session  Students press “Pause”, then “Exit” to pause the test until the next test session  Test Examiners must collect any scratch, grid, or unlabeled graph paper

48. Administering the Tests – Marking Testing Codes 48  Testing codes in eDIRECT:  Absent Student is absent for all test sessions and will not make up any part of the assessment  Teacher Invalidation Student is determined to have cheated on the assessment

49. Administering the Tests – Handling Student Transfers 49 IF…THEN… The student transfers from one building to another within the district during the district’s testing window… …the DTC moves the student to the appropriate new student group and the student is tested in the new building The student transfers into the district before the district’s testing window is closed AND The student was not tested in his/her previous district… …the receiving district should test the student

50. Administering the Tests – Handling Student Transfers (cont.) 50  Questions about unique transfer situations???  Contact DESE Accountability Data at 573-526-4886

51. After Testing – Closing Out Tests and Returning Testing Materials 51  After all testing is completed, the DTC/STC  Ensures that all tests/responses are submitted  Ensures that student absences are marked correctly in the system  Closes the district’s testing window for the grade level/content area if testing is complete before the designated end of the window  Securely destroys any scratch paper used by students during the assessments  Returns any accommodated testing materials to CTB

52. After Testing – Accessing and Printing Student Reports 52  Individual Student Reports available in Missouri Online Reporting System accessible through eDIRECT secure login  Mathematics and ELA reports available 10 business days after the district’s grade level/content area window closes  Science reports available by July 1  Parents must be notified that reports are available within 15 days after they are posted

53. Accommodated Test Forms – Paper/Pencil Edition 53  Paper/Pencil test form  Barcoded PDF of complete test form (must be recorded on Test Book Accountability Form)  DTC downloads, prints, and provides to Test Examiner  Classroom activity may differ  No charge to district if required by student’s IEP

54. Accommodated Test Forms – Paper/Pencil Edition (cont.) 54  Administration Instructions – Chapter 5 of the TAM  Required materials  Transcribing Student Responses  Test Security  Returning Paper/Pencil Materials  If the district ordered Braille or Large Print assessments, boxes and shipping labels from the kit may be used to return Paper/Pencil materials (all accommodated materials can be returned together)  If the district did NOT order any Braille or Large Print assessments, the DTC must contact the MAP Service Line to request return boxes and a shipping label  Schedule a pick-up at http://programs.ctb.com/MAPhttp://programs.ctb.com/MAP

55. Accommodated Test Forms – Braille/Large Print 55  DTCs/STCs Distribute Braille/Large Print Materials  Record materials on Test Book Accountability Form  Classroom Activity may differ  Test Examiners administer using script in eDIRECT  Additional time may be required  Make sure all permitted/required tools are provided or accessible  Student may respond by pointing to responses or giving verbal response, or using a Braille writer  DTC or Test Examiner transcribes student responses into INSIGHT

56. Accommodated Test Forms – Braille/Large Print (cont.) 56  DTC must return all materials to CTB  Schedule pick-up at http://programs.ctb.com/MAP  Return boxes and labels provided with Braille/Large Print testing materials  All personnel must follow test security guidelines before, during, and after testing

57. Accommodated Test Forms – Test Book Accountability 57  Ensure barcodes for all Braille, Large Print, and downloaded Paper/Pencil test forms are recorded  Account for return of all testing materials  Keep a copy of the Test Book Accountability Form for district records  Fax to CTB at 888-282-0526

58. Odds & Ends 58  Quality Assurance  Federal regulations require quality assurance monitoring of state assessment programs  Plan district-wide quality assurance activities  Complete self-monitoring quality assurance forms. http://dese.mo.gov/sites/default/files/asmt-gleoc-qa- 2015.pdf  Assist in any external quality assurance visits by DESE  Contact DESE Assessment to report any testing irregularities or concerns – 573-751-3545

59. Odds & Ends (cont.) 59  Secure destruction of testing materials:  Printed Manuals DTC should securely destroy following testing  Contaminated Materials Must be securely destroyed at the district level Do NOT return to CTB

60. Questions? 60  DTC is the spokesperson for the district  Questions about policies/procedures  Contact DESE Assessment at 573-751-3545 or assessment@dese.mo.gov  Questions about eDIRECT or INSIGHT  Contact CTB at 800-544-9868 or MAPHelpDesk@ctb.com MAPHelpDesk@ctb.com  CTB fax: 888-282-0526

61. Conclusion 61 Thank you for your participation!