End-of-Course Assessment Test Coordinator’s Manual Phase I 2008/ Pat Johnson Sherri Sampson Paula Young

Fall/WinterNov. 3, 2008–January 31, 2009 SpringApril 15, 2009–May 22, 2009 SummerJune 16, 2009–August 31, 2009 Results for students assessed during the summer window will be included in the following year’s accountability calculations. 2 First Year Operational EOC TEST WINDOWS

Subsequent Years Fall administration October 1 – January 31 Spring administration March 1 – June 15 Early Summer administration June 16 – August 31 Results for students assessed during the summer window will be included in the following year’s accountability calculations. 3

Events and Dates All dates are arranged around the district’s testing week ◦ Fall ◦ Spring ◦ Summer 4

One-Week Testing Window Districts choose one week for each content inside the EOC administration window Make-up days are included in the one week period Content window is set for the district – NOT per building 5

Testing Windows Districts can enroll in any/all administration windows 6

Agenda Schedule of Important Dates for the 2008/2009 Testing Program Guidelines for Testing Invalidation Procedures Overview of Test Coordinator’s Roles Handling of Student Barcode Labels Testing Materials Additional Material Order Securing Testing Materials Collecting, Packing and Shipping Testing Materials 7

Course Level Expectations EOC assessments use CLEs (Course-Level Expectations) MAP assessments use (Grade-Level Expectations) When the content of the CLEs are covered, the test can be administered regardless of student grade level. 8

EOC and MAP Some similarity to MAP Some distinct differences Those differences are notated in the manuals by a “NOTE” that is set apart. Missouri educators are highly involved. 9

EOC in Two Versions Paper/Pencil version Online version 10

Phase I has Two Sessions Session I: ◦ Selected-response items ◦ Uses separate answer sheet Session II: ◦ Performance Events/Writing Prompt ◦ Write directly in the test book 11

Selected Response Items 47 items in Session I Algebra I, Biology and English II Includes both operational and embedded field test items A stem (question) 3 distracters (incorrect answers) 1 correct answer 12

Phase IFall/WinterSpring 2009Summer 2009 Algebra I Session I 35 operational + 12 EFT, taking about 1 minute each 35 operational + 12 EFT, taking about 1 minute each 35 operational + 12 EFT, taking about 1 minute each Algebra I Session II2 PE, taking about 30 minutes each Biology Session I 35 operational + 12 EFT, taking about 1 minute each 35 operational + 12 EFT, taking about 1 minute each 35 operational + 12 EFT, taking about 1 minute each Biology Session II 2 PE scenarios with approximately 5 – 10 separate items per scenario, taking about 30 minutes for each scenario English II Session I35 operational + 12 EFT, taking about 1 minute each 35 operational + 12 EFT, taking about 1 minute each 35 operational + 12 EFT, taking about 1 minute each English II Session II1 Writing Task, taking about 30 minutes Snapshot of Phase I 13

How long do the tests take? Session I and Session II can each fit into a 55 minute class period. However, the tests are not strictly timed and schedules should be flexible to enable students to complete each session. 14

DTC/STC DTC (District Test Coordinators) STC (School Test Coordinators) May have interchangeable roles 15

Prepare Well-rested students Upbeat, excited, positive attitudes Classrooms free of cueing materials Correct pencils – No. 2, non-mechanical Minimum, a four-function calculators for Algebra I assessments Metric rulers for Biology PE Dictionaries, Grammar Handbooks, Thesauruses for English II -- Session II only 16

Who to Call? Page 1 Riverside Publishing Company Customer Service :00 A.M. to 6:00 P.M. CST Monday through Friday 17 The DTC can also questions to Riverside Publishing Company at:

Special Populations Page 4 IEP Students IAP/504 Students 18 Students Not Tested MAP-Alternate (MAP-A) Some ELL students

Students who move during testing Don’t send test books to the new district Mark the “No Longer Enrolled in District” bubble on the SIS under Status Codes. 19

Other students who may take the EOC’s Page 6 Other students who may take the EOC’s Page 6 Foreign Exchange Students Homebound Students Homeschooled Students MoVIP 20

MoVIP Page 6 MoVIP students are required to participate in EOC assessments. All inquiries go to MoVIP at

Students Who Are Absent from either Session Bubble appropriate absences Return with scorable materials OR Re-enroll the student in the next semester’s testing window 22

Large Print and Braille Books Page 7 Transcribe on to regular answer sheet or test book Mark SIS appropriately Return to Riverside Scoring Services with the unused non-scorable testing materials. 23

Use of Translators Page 7 Yes for Algebra I and Biology No for English II assessments ELL students can give responses orally or in writing in their native language for all assessments 24

Invalidation Procedures Page 8 Check the chart Some procedures have changed from the past Mark SIS appropriately 25

Invalidation: Check the Chart Page 8 Cheating Reading English II Signing Paraphrasing Read to students in their native language Using bilingual dictionary for English II 26

Invalidations Procedures IfThen 27 Student is discovered cheating Bubble in “Teacher Invalidation” under Status Codes on the SIS. This is the only time the “Teacher Invalidation” bubble is used. This code applies to all content assessments. Refer to the directions following this table for notifying DESE. An Examiner reads any part of the English II test to a student. Bubble in “04 Oral Reading – invalidates test.” This code applies to both Session I and II of the English II assessments. An Examiner signs any part of the English II test to a student. Bubble in “05 Signing of assessment- invalidates test.” This code applies to both Sessions I and II of the English II assessments. An Examiner paraphrases the test questions in any content area. Bubble in the “06 Paraphrasing – invalidates test.” This code applies to all content assessments. An Examiner reads any part of the English II test to a student in the student’s native language. Bubble in “11 Oral reading in native language –invalidates test.” This code applies to both Session I and II of the English II assessments. A student uses a bilingual dictionary for any part of the English II test Bubble in “43 Use of bilingual dictionary – invalidates test.” This code applies to both Session I and II of the English II assessments.

What Districts Must Do Page 8 Agreement between STC & Examiner Superintendent sends letter and saves copy Invalidated sheet or book must be returned with scorable materials Remember student’s behavior does not invalidate 28

Electronic Devices Page 10 Yes to Calculators – students can use at minimum, a four-function calculator for Algebra I – both sessions No to cell/mobile phones, electronic music players, digital cameras, handheld scanners, gaming devises, etc. 29

Test Coordinator’s Roles Page 11 &12 20 point checklist for DTC 14 point checklist for STC Examiners have their own manual per content 30

DTC Responsibilities Page 11 Communicating with RPC (Riverside Publishing Company) – one point of contact Accounting/bookkeeping work such as receiving, checking, Test Book Accountability Form and security barcode verification numbers Responsible for test security 31

DTC Responsibilities (con’t) Page 11 &12 Distributing & collecting both secure and non-secure materials Ordering additional materials if/when needed Training STC and Examiners Working with out-of-district schools before the testing period Assembling materials after testing for UPS 32

STC Responsibilities Page 11 &12 Receiving/checking - Test Book Accountability Form and security barcode verification numbers Training Examiners Keeping secure materials SECURE Communicating with DTC Assembling materials after testing for DTC 33

Security of Test books Test book security is very important Tests should be stored and secured away from classrooms. 34

Student Barcode Labels Page 13 Included in shipment 2 2 barcodes for each student for each content being tested 35

Student Barcode Labels (con’t) Page 13 Information on barcode labels came from MOSIS pre-code system Check for accuracy & completeness ◦ Student Name ◦ MOSIS ID ◦ Date of Birth ◦ School Name ◦ District Name ◦ Grade 36

Difference in Procedures Page 13 Do not use both the student bar code label and the Student Information Sheet The student barcode label will override the biographic information bubbled on the SIS This procedure is the opposite of the MAP procedure 37

Difference Noted 38

How to use Barcode Labels Page 13 If/Then chart gives explicit instructions RPC will not print additional barcode labels District is responsible for SIS for the students who do not receive labels or whose information incorrect. 39

IFTHEN 40 The student barcode biographic information is accurate. Any student barcode biographic information is inaccurate Before testing, a student barcode label is already affixed to a Session I answer sheet and some of the biographic information on the label is subsequently determined to be inaccurate. A Session I assessment is in progress or completed and a student barcode label is already affixed to a Session I answer sheet, but some of the biographic information on the label is subsequently determined to be inaccurate. Before testing, a student barcode label is already affixed to a Session II test book and some of the biographic information on the label is subsequently determined to be inaccurate. A Session II assessment is in progress or completed and a student barcode label is already affixed to a Session II test book, but some of the biographic information on the label is subsequently determined to be inaccurate Student barcode labels are not provided for a student Affix the first student barcode label to the designated area on the Session I answer sheet. Affix the second student barcode label to the SIS of the Session II test book. (See picture on pages 15 and 16 for the correct placement of the student barcode label.) Do not use the student barcode label. Instead, manually complete all sections of the SIS for both Session I and Session II. Securely destroy the incorrect Session I answer sheet. Then fill in all the SIS information on a new Session I answer sheet. Transcribe answers to a new, unused Session I answer sheet. Then fill in all the SIS information on the new answer sheet. Securely destroy the old Session I answer sheet. Mark “DO NOT SCORE” on the front of the Session II test book. Then return that test book to Riverside Publishing with other secure non-scorable materials. Then fill in all the SIS information on a new Session II test book. Mark “DO NOT SCORE” on the front of the original Session II test book. Transcribe answers verbatim to a new, unused Session II test book. Fill in all the SIS information on the new Session II test book. Return the test book that is labeled “DO NOT SCORE” to Riverside Publishing with other secure non- scorable materials. 1.Acquire the student’s missing information for using in completing the SIS. Students MUST have a MOSIS ID. 2.Fill in all biographic information on the SIS and leave the student barcode area blank.

41

Closer look of the SIS 42

Status Codes 43

District Team Decision – Delayed This is a new bubble designed for students who are not yet ready to take the EOC assessment for which they were enrolled. 44

District Procedure PRIOR to the testing window(s), the district should have their “delay” procedure clearly in place The procedure should: ◦ include decision parameters ◦ include who is on the team to make the decision ◦ be in writing 45

Bubble and Document If the district believes a particular student is not ready to take the EOC assessment for which he/she was enrolled, the district team makes the decision based upon the qualifications outlined in procedures. The STC bubbles in the “District Team Decision – Delayed” on the student’s SIS. The district keeps documentation about the decision to delay testing. 46

Some new accommodations Accommodation Codes are listed on pages 40, 41 and 42 in Test Coordinator’s Manual and also included in the Examiners’ Manuals. 47

Students with Disabilities Page 42 NOTE: Oral reading of the English II test results in the LOSS (Lowest Obtainable Scale Score). Exception: Students identified as blind/visually impaired (who do not read Braille) may use the oral reading accommodation if it is their primary instructional method. Page 42 48

Note for Students with Disabilities Page 42 NOTE 2: Paraphrasing test questions invalidates all EOC assessment student scores for accountability purposes. NOTE: Use of magnifying equipment, amplification equipment, graph paper and testing with the teacher facing the student are not listed as accommodations because these are not required to be reported as accommodations for the EOC assessments. 49

Accommodation Codes 50

Test Window 51

Form Number Fall and summer forms will be tracked by Riverside Publishing and DESE. The spring window has the largest number of forms and therefore, students are asked to bubble in the number on their form. 52

Which Form? 53

SIS for Session I includes: Accommodation Codes (indicated on Session I SIS only) Test window Form Status codes 54

55

Session II SIS (con’t) Page 16 Does not have accommodation codes listed Accommodation codes bubbled in on only Session I SIS are for both Session I and II Does not indicate test window or form Does have Status Codes 56

Step1: Receive Testing Materials Page Shipment 1, Non-Secure Materials ◦ Packaged by school before being sent to district office address ◦ Arrives about 2-3 weeks before district’s one- week testing window Shipment 2, Secure Materials ◦ Arrives approximately 2 weeks before the district test window 57

District Non-secured Materials Includes: Page 17 District Packing List Copy of School Packing Lists (for shipment 2 of secure materials) Test Coordinator’s Manual Test Examiners’ Manuals District Return Kit (One folder per district) 58

District Return Kit Page 17 District Return Kit Page 17 The return kit includes 14 items and instructions for those items: Pre-code labels Building ID sheets Packing forms Test Accountability Form Return labels and more 59

United Parcel Service Authorized Return Service The label will be provided to the district. This label must be used on return packages. The district will call UPS to pickup the testing material. 60 What is UPS A.R.S.?

School Materials Page 17 Packing Lists included Test Coordinator’s Manual Test Examiners’ Manuals Session I Answer Sheets Algebra I reference sheets NOTE: A five percent overage of the original enrollment will be included with the school testing materials in Shipment 1 and 2. 61

Includes both District and School Materials Arrives approximately 2 weeks before the district test window 62 Secure Materials Page 17

School Materials Page 17 School Packing List Student Barcode Labels Session I Test Books (Selected Response) Session II Scorable Test Books (Performance Event/Writing Task) 63

Step 2: Inventory Materials Page 19 Shipment 1- Non-Secure Materials Check the packing list -- do you have the quantities and type of materials needed? Do you have the forms and shipping labels? SAVE the boxes! 64

Step 3: Distribute Testing Materials Page 20 Every test book has a unique security barcode number Inventory test books before and after test administration Ensure 100% rate of return Do not share test books among schools 65

Do Not Share Test Books In order to preserve the sequential integrity of the security barcodes, do not share test books among schools. If a test book is loaned to a school and later determined to be missing, the original school will be responsible for the missing test book. 66

Session I Selected Response Non-Scorable Test Books Each content has separate test books. Answers go on separate answer sheets, not in test books. ALL Session I selected response test books (both used and unused) must be accounted for and returned to Riverside Publishing Company. 67

Session I Answer Sheets Page 20 Answer sheets are machine scored MUST be handled carefully – must not be folded, clipped, stapled, taped, or torn DTC or STC should remove any stray marks Destroy any unused Session I answer sheets 68

Session II Scannable Test Books Page 21 One test book per content area consisting of performance events or a writing task. Students will write their answers in the test book. To-be-scored Session II test books go to ARC (Assessment Resource Center) All unused or non-scorable Session II test books must be accounted for and returned to RPC (Riverside Publishing Company) 69

Test Book Accountability Form Page 22 DTC 1. Make one copy for each STC 2. Confirm test book count but do not open shrink wrap 3. Verify security barcode range of bundles 4. Use Test Book Accountability Form to record number of books on packing list 5. Report discrepancies to Riverside Customer Service at

STC Pretest Administration Page Open the shrink-wrap. 2. Verify that test books are in sequential security barcode order (e.g., , ). 3. Verify that security barcode numbers printed on the test books match the numbers listed on the packing list (located in Box 1 of the school’s shipment). 4. Complete the Test Book Accountability Form documenting any security barcode discrepancies and notify DTC. 5. Return a copy of the completed Accountability form to DTC and retain a copy. 71

Post-Test Administration for DTC Page 22 Verify that all Test Book Accountability Forms for all buildings have been completed and signed. Document any missing test books on Test Book Accountability Form and attach an explanation letter on district letterhead. FAX Test Book Accountability Form to Riverside Publishing – Do NOT return Test Book Accountability Forms with testing materials. 72

Return Packing Forms Page DTC completes the Return Packing Forms for each scorable district shipment. ◦ make corrections to preprinted information ◦ Record the total number of scorable materials Send ◦ scorable Session I answer sheets to RPC ◦ scorable Session II test books to ARC 73

Yellow Riverside Return Packing Form Place form on the top of all the scorable Session I answer sheets in Box 1. On the yellow Session I Scorable Document Return Label, the DTC will place an “X” in the box labeled “Check if this box contains the Riverside Return Packing Form” and affix the label to the outside of Box 1. Page 23 74

Orange ARC Return Packing Form Place form on the top of all the scorable Session II test books in Box 1. On the orange Session II Scorable Document Return Label, the DTC will place an “X” in the box labeled “Check if this box contains the ARC Return Packing Form” and will affix the label to the outside of Box 1. Page 23 75

Building Identification Sheets Two Building ID Sheets must be completed for each building:  One Building ID Sheet goes with Session I answer sheets to Riverside Scoring Services. One Building ID Sheet goes with Session II test books to ARC. School identification information has been pre-coded on the form. Do NOT make changes on the preprinted form. If incorrect, use one of the blank sheets provided. Page 23 76

Group Identification Sheets Page 23 At minimum, two Group ID Sheets (GIS) per content area, per school, must be completed. Additional GIS may be used to break down test groups for scoring and reporting purposes Each group will have two GISs ◦ One will go to RPC ◦ One will go to ARC 77

GIS (con’t) Page 23 The information on the GIS must be identical for Session I and Session II groups. All scorable test materials packed under under a single GIS must be of the same content area and session. Please note that the GIS is a scannable document and cannot be photocopied. DTC can provide additional GIS. 78

Contaminated Test Books or Answer Sheets Page 24 Contact with any fluids resulting from a student health issue (e.g., blood) Contact with any potentially hazardous material 79

Securing Testing Materials DTC responsibility Page 25 Appropriate amount of testing materials are available If not – additional materials must be requested one week prior to testing window STC uses overage before requesting additional materials Security: keep in a locked room or cabinet ◦ no discussion of items ◦ no photocopying ◦ no accessibility to personnel not responsible for testing 80

Securing Testing Materials STC Responsibilities Page 26 Security of materials in your building Ensures that each Examiner has the Test Examiner’s Manual and appropriate number of test books The appropriate quantity of Session I answer sheets per content area Provide required ancillary testing materials 81

Ancillary Testing Materials Page 26 Examiner ensures that any ancillary testing materials or tools are provided such as: Algebra: - Graph paper - Calculator - Ruler- Reference sheet Biology: - Scratch paper - Ruler English II - Scratch paper 82

Step 4: Collect Testing Materials Page 26 Examiner’s Responsibilities Session I - Test Books: Collect test books, count and compare numbers Return test books to STC in separate bundles by content area Separate used and unused Contact STC regarding contaminated test books Page 28 83

Examiner’s Responsibilities Page 26 Session I - Answer Sheets: Collect answer sheets Verify SIS Return to STC Return any unused answer sheets, graph paper, scratch paper or draft paper to STC to be destroyed 84

Examiner’s Responsibilities Page 28 Session II - Test Books Collect test books Verify barcode labels and verify SIS Return all test books to STC, separate used and unused Collect all graph, scratch, and draft paper Reference Sheets and return to STC for shredding Return Test Examiner’s Manual to STC (to be destroyed) 85

STC’s Responsibilities Page 29 Session I - Test Books: Collect test books from Examiners Count and compare numbers on Test Book Accountability Form Separate used and unused Return tests to DTC in separate bundles by content area Contact DTC regarding contaminated test books 86

STC’s Responsibilities Page 29 Session I - Answer Sheets Collect scorable answer sheets and separate by content area Complete Group ID Sheet (GIS) and put on top of Session I answer sheets Verify SIS Verify Building ID Sheet – goes on top of GIS Return to DTC Securely shred all unused answer sheets, graph paper, scratch paper or draft paper 87

STC Responsibilities Page 30 Session II - Test Books Collect all test books, separate scorable and non-scorable Erase all stray marks on the coding tracks Verify SIS Verify Building ID Sheet and destroy unused ones Return to DTC 88

DTC Responsibilities Page % Return Rate Fax Test Book Accountability Form to Riverside Publishing and retain a copy for your records Verify that the Group ID Sheets are the same for Session I and Session II scorables Ship materials 89

STEP 5: Return Materials to DTC Page 31 STC returns Shipment 1 Scorable Session I Answer Sheets to DTC Reuse original shipping boxes Place appropriate answer sheets with GIS Put Building ID Sheet on top Do not tape closed Give boxes to DTC 90

STEP 5: Packing & Shipping Testing Materials Page 31 DTC’s Responsibilities Return Shipment 1 Scorable Session I Answer Sheets Collect packed boxes Complete the Riverside Return Packing Form Use Riverside yellow Session I Scorable Document Return Label Securely store until shipped 91

STEP 5: Packing & Shipping Testing Materials Page 31 Make sure all scorable materials are separated from all non-scorable materials Check that no used Session I selected-response answer sheets are left inside the Session I test books Make sure that all the necessary Group ID sheets and Building ID Sheets are completed and that the Return Packing Form is on top of all the scorable materials in the first box 92

After Testing TCM Page Return Shipment 1 must be ready for pickup promptly after all buildings have completed testing. Page 32

Arranging for Pickup of Return Shipment 1 to Riverside Publishing Page 33 Scorable Session I Answer Sheets go to Riverside Publishing via UPS using the A.R.S. (Authorized Return Service) labels. Riverside is responsible for all shipping costs; however, the DTC is responsible for making shipping arrangements with UPS. 94

Shipping scorable Session I selected-response answer sheets: Page 33 Package materials by content area and by building Retain the bottom tracking number for district records because neither UPS nor Riverside Publishing can track the district’s shipment without the tracking number 95

Return Shipment 2 to DTC Page 34 Session II Scorable Test Books STC’s Responsibilities Prepare boxes Place the test books for the corresponding content area or class under the appropriate GIS Do not tape boxes closed, as the DTC will need to inspect and verify materials Place a Building ID Sheet on top of all GISs and Session II test books in Box 1 Count & record the total number of boxes 96

Return Shipment 2 Page 34 Session II Scorable Test Books DTC’s Responsibilities Collect all packed shipping boxes from the STCs Complete the ARC Return Packing Form Place the ARC Return Packing Form on top of the materials in Box 1 of the scorable Session II test books Affix orange label Securely store until UPS pickup 97

Package scorable Session II test book one school and one content at a time, 98 page 35

Secure Non-Scorable Page 37 The DTC is to verify that all secure non- scorable materials for all content areas are returned from the schools STCs have been instructed to organize the materials into related stacks. Materials are not required to be in numerical order upon returning to Riverside Scoring Service. Return Shipment 3 must be ready for pickup promptly after all buildings have completed testing. 99

Shipment 3 Secure, Non-Scorable Page Organize into relevant piles as shown

Return Shipment 3 Secure, Non-Scorable Materials Page 37 All Session I test and Session II unused test books for all content areas are considered secure non-scorable materials and must be returned to Riverside Scoring Service The DTC is to verify that all secure non- scorable materials for all content areas are returned from the schools Materials are not required to be in numerical order 101

Return Shipment 3 (con’t) Page 37 Return Shipment 3 must be ready for pickup promptly after all buildings have completed testing. 102

Non-Scorable materials Packing Diagram Page See page 39 for shipping instructions.

Shipping the secure non-scorable materials: Page 39 Prepare boxes Affix one white Non-Scorable Document Return Label to the box Seal with heavy-duty packing tape Write district name and address on the label Place one white Non-Scorable Document Return Label on each box Total the number of boxes (e.g. Box 1 of 3, etc.) 104

Shipping secure non-scorables Page 39 Do not include the number of boxes of secure scorable materials in the total for the number of secure non-scorable materials Arrange for UPS pickup 105

Very Important Page 39 Retain the bottom tracking number for district records. Neither UPS nor Riverside Publishing can track the district’s shipment without the tracking number. 106

For District Training This PowerPoint is available on the following website: Follow the MAP link 107