1. End-of-Course Assessment Test Coordinators Manual Training Phase I and Phase II 2009/2010 1

2. Agenda EOC General Information and Changes Testing Windows & Test Formats Online Test Examiners Manual Questions 2

3. End-of-Course Assessments Required Tests English II Algebra I Biology Government 3

4. End-of-Course Assessments Phase I Assessments Include: English II, Algebra I, and Biology Were the first group of EOC tests created Became operational in Spring 2009 Required for AYP, APR and/or NCLB 4

5. End-of-Course Assessments Phase I Assessments ~ Session II Points are not the same for each content area English II writing prompt is worth 4 points Algebra I PE is worth 4 points Biology PE is worth 20 points 5

6. End-of-Course Assessments Phase II Assessments Include:English I, Algebra II, Geometry, American History, and Government Were the second group of EOC tests created Become operational October 13, 2009 6

7. End-of-Course Assessments Phase II Assessments Government is the only required Phase II Assessment Government is required for APR 7

8. End-of-Course Assessments Phase II Assessments Have selected response (SR) items only English I has 52 items – 7 passages with 6 or 8 items each All other Phase II Assessments have 50 items each. All are worth 40 points 8

9. End-of-Course Assessments Scoring EOC SR Items for both Phase I and Phase II Assessments are officially scored by Riverside Publishing immediately after testing Official SR scores are returned to the district within 5 business days from receipt of tests 9

10. End-of-Course Assessments Scoring EOC WPs and PEs are officially scored by the Assessment Resource Center (ARC) at a later time Unscored WP and PE items are scanned and electronic copies are returned to the district for local scoring 5 business days from receipt of tests 10

11. End-of-Course Assessments Scoring EOC Session I official scores and locally scored Session II results can be included in a students final grade DESE highly recommends that EOC Assessments be used as 10-25% of the students final grades The percentage is a district-level decision 11

12. End-of-Course Assessments Scoring EOC Riverside Publishing sends two e-mails with attachments to the DTC – one for training and one for scoring Task Scoring Workshop and Teacher Interface have URLs, user names, and passwords 12

13. End-of-Course Assessments Scoring EOC User names and passwords for Task Scoring Workshop and Teacher Interface allow teachers access to secure materials For security reasons, the passwords are not forwarded to the STC or teachers until district testing is complete 13

14. End-of-Course Assessments EOC score results Official scores for PEs and WPs arrive in the district in August Both Session I & II are combined into a Scale Score for Student Reports Official state scores will be used for AYP and APR Crystal Reports have breakdown of Session I and Session II scores Teachers will be able to compare their scored Session II assessments to the official state-scored Session II 14

15. End-of-Course Assessments EOC score results AdvancedProficientBasicBelow Basic Subject Raw Score Cut Score Raw Score Cut Score Raw Score Cut Score Raw Score Cut Score Algebra I31-39225-25022-30200-22413-21177-1990-12100-176 Biology45-55225-25032-44200-22418-31177-1990-17100-176 English II33-39225-25024-32200-22415-23180-1990-14100-179 15

16. End-of-Course Assessments Level Not Determined (LND) For EOC Assessments, a district will receive a Level Not Determined (LND) for a student if that student NEVER participates in a required EOC Assessment (English II, Algebra I, Biology, Government) before they graduate beginning with the graduating class of 2011 EOC Assessments are not a graduation requirement 16

17. End-of-Course Assessments Lowest Obtainable Scale Score (LOSS) Students who participate in an EOC Assessment receive scores A student receives the Lowest Obtainable Scale Score (LOSS) if a students test is invalidated for cheating or paraphrasing in any content area because they have participated in the test 17

18. End-of-Course Assessments Individualized Education Program (IEP) Students who have an IEP with accommodations can be accommodated during testing 18

19. End-of-Course Assessments Changes and Updates The Not Enrolled bubble is used for a student who begins any session of an EOC Assessment and moves either out of the district or from building to building within a district before finishing the entire assessment The sending school should keep documentation on file about the students move In the manuals EOC Assessments will be categorized as Phase I and Phase II 19

20. End-of-Course Assessments Changes and Updates Dictionaries, thesauruses, and grammar handbooks can be used with the writing prompt for English II, Session II When students are taking the online version of the test, do not mark a student as absent until the END of the districts testing window English II will not have a stand alone field test this year - however, the Phase II GIS has a bubble for an English II field test so please disregard 20

21. Agenda EOC General Information and Changes Testing Windows & Test Formats Online Test Examiners Manual Questions 21

22. EOC TESTING WINDOWS for SJSD Fall/Winter 11/30 – 12/4 Biology and English II 12/7 – 12/11 Algebra I and Government Spring 4/19 – 4/23 Biology and English II 4/26 – 4/30 Algebra I and Government Summer 22

23. EOC in Two Versions Paper/Pencil version Online version 23

24. End-of-Course Assessments All Phase I Assessments Two sessions: Session I - Selected Response Items Session II - Performance Events (PE) or Writing Prompts (WP) 24

25. End-of-Course Assessments Phase I, Session I Assessments Have 47 selected response (multiple choice) items Present students with a question followed by four response options Are worth 35 points total 25

26. End-of-Course Assessments Phase I, Session II Assessments Require students to work through more complicated items Make allowances for more than one approach to a correct answer Allow insight into a students ability to apply knowledge and understanding to real-life situations 26

27. Session II Performance Events for Algebra I and Biology Assesses students applied knowledge Algebra I PE assesses CLEs with a Level 3 DOK from the Algebraic Relationships strand Biology PE assesses the Inquiry strand 27

28. Session II Writing Prompt for English II On-demand writing proficiency Scored holistically, using a four-point scoring guide The prompt may be persuasive, descriptive, expository, or narrative 28

29. Phase IFall/WinterSpring 2010Summer 2010 Algebra I Session I 35 operational + 12 EFT 35 operational + 12 EFT, 35 operational + 12 EFT, Algebra I Session II2 PE, taking about 30 minutes each Biology Session I 35 operational + 12 EFT 35 operational + 12 EFT 35 operational + 12 EFT Biology Session II 2 PE scenarios with approximately 6 – 12 separate items per scenario, taking about 30 minutes for each scenario English II Session I35 operational + 12 EFT 35 operational + 12 EFT 35 operational + 12 EFT English II Session II1 Writing Task Snapshot of Phase I 29

30. Snapshot of Phase II Phase IIFall/WinterSpring 2010Summer 2010 American Government 40 operational + 10 EFT American History40 operational + 10 EFT English I40 operational + 10 EFT Integrated Math 240 operational + 10 EFT Integrated Math 340 operational + 10 EFT Geometry40 operational + 10 EFT Algebra 240 operational + 10 EFT 30

31. Agenda EOC General Information and Changes Testing Windows & Test Formats Online Test Examiners Manual Questions 31

32. Purpose of Test Coordinators Manual Detailed instructions for: Preparing for online testing Delivering of online tests Administering of online tests 32

33. Test Coordinators District Test Coordinator (DTC) – the point person for testing in a school district School Test Coordinator (STC) – the point person for testing in a particular building These are sometimes the same person and/or they may have interchangeable roles 33

34. Breakdown of EOC Assessments Guidelines for Testing: Prepare Notify parents in advance so that students will be well- rested Pre-read the manual Inclusions of Special Populations Make-up Sessions Use of Translators Invalidation Procedures Accommodations and Status Codes 34

35. Special Populations IEP students must take all EOC Assessments administered by the district or portions of each content-area assessment as determined by the IEP team IAP/504 Students 35 Students Not Tested MAP-Alternate (MAP-A) ELL students who have been in the US for 12 months or fewer (cumulative time) may be exempt from the English II assessment

36. Students who move before or during testing (p. 5) If a student was enrolled to take an EOC Assessment but moved prior to test administration, the sending school should keep documentation on file about the students move The receiving district tests the student in any applicable EOC Assessment The Not Enrolled bubble is used for a student who begins any session of an EOC Assessment and moves before finishing the entire assessment, either out of the district or from building to building within a district. The sending school should keep documentation on file about the students move. 36

37. Students Who Are Absent During Testing Districts should make every attempt to have all students take the entire test. If a student is absent and unable to take the test during the testing window, the school should keep documentation on file about the students absence and use the following procedures : 1. If a student is absent and unable to take the test at a later test window, fill in the Absent bubble 2. If a student is absent and the district will assess the student during the next testing window, fill in the District Team Decision – Delayed bubble 3. The districts may re-enroll the student in the next semesters testing window. 37

38. Use of Translators Translators must be trained in test administration No for English I and English II assessments Yes for all other Phase I and Phase II tests Native language responses are acceptable from ELL students – transcribe appropriately 38

39. Invalidation Procedures Check the chart (Page 7) Mark appropriately 39

40. Test Invalidation Reasons 40 Neither student behavior nor the judgment of student effort can invalidate test.

41. What Districts Must Do When Invalidating A Test Agreement on Invalidation (between STC and Examiner) Information STC must provide to DTC The Letter to DESE from the Superintendent A Copy of the letter for the District 41

42. Accommodations and Status Codes (Pages 22 - 23) Student accommodations are recorded for the entire assessment Accommodation Code definitions can be found in the EOC manual and on the DESE website. Check the appropriate box for the corresponding test. Status code definitions can be found in the Test Examiners Manuals. 42

43. Electronic Devices Yes to Calculators – at minimum, students can use, a four-function calculator for Algebra I – both sessions (nothing with Internet access of a Qwerty keypad) No to cell/mobile phones, electronic music players, digital cameras, handheld scanners, gaming devices, any portable device that can be connected to the internet, etc. 43

44. Testing Periods – Phase I Suggested Times Algebra I Session I = 90 – 100 minutes Session II = 60 – 70 minutes Biology Session I = 55 – 60 minutes Session II = 65 – 70 minutes English II Session I = 90 – 110 minutes Session I = 90 - 100 minutes

45. Testing Periods – Phase II Suggested Times Government – 60 - 80 minutes American History – 60 - 80 minutes English I - 90 - 110 minutes Algebra II – 90 - 100 minutes Geometry – 90 - 100 minutes

46. DTC Responsibilities The District Test Coordinator (DTC) is responsible for training ALL School Test Coordinators (STCs) on EOC Assessment processes. Communicating with RPC (Riverside Publishing Company) – one point of contact for the district Responsible for test security Ordering additional materials if/when needed 46

47. STC Responsibilities Ensure EOC Browser is on each workstation for test delivery Input students who were not included in the MOSIS precode file to the online testing system Verify/edit student demographic information for pre- imported students Contact District Assessment Office if any students need to be transferred View/set student classes, testing statuses, and accommodations 47

48. District Team Decision – Delayed This is a bubble designed for students who are not yet ready to take the EOC assessment for which they were enrolled. PRIOR to the testing window(s), the district should have their delay procedure clearly in place The procedure should: include decision parameters include who is on the team to make the decision be in writing 48

49. Bubble and Document If the district believes a particular student is not ready to take the EOC assessment for which he/she was enrolled, the district team makes the decision based upon the qualifications in the procedure. The STC bubbles in the District Team Decision – Delayed The district keeps documentation about the decision to delay testing. 49

50. Post Test Administration Task Scoring Workshop The Task Scoring Workshop is an Internet-based tool that provides training on how to score the Session II portion of the Phase I Missouri End-of-Course assessments. Through this system, teachers have access to scoring rubrics, anchor papers, annotations and practice papers that allow them to practice the scoring process independently. Once Riverside has received a districts testing materials, an e-mail will be sent to the DTC with the Task Scoring Workshop URL, user IDs, and passwords. The e-mail will be sent from mo.coordinator@hmhpub.com with the subject line of MO EOC: Task Scoring Workshop. The DTC is responsible for distributing the information to their teachers. Please note that this information should not be distributed until all testing has been completed for a subject area. 50

51. Post Test Administration Teacher Interface The Teacher Interface is the system through which teachers are able to view students selected response raw scores and view, print, and locally score the unscored, scanned copies of their students performance events. Teachers are able to include these scores in the students final grades. However, the official state scoring of the Session II items will not occur until a later time. Teacher Interface does not provide export files of raw scores, nor does it allow for batch printing of the performance events/writing prompts. Within 5 business days of Riverside receiving a districts testing materials, an e-mail will be sent to the DTC with the Teacher Interface URL, user IDs, and passwords. The e-mail will be sent from noreply@hmco.com with the subject line of the DTCs name followed by MO EOC Teacher Interface. DTCs and STCs will have access to a performance event summary report for their buildings. Teachers will have access to their class roster page with the selected response raw scores and performance event images. 51

52. Accommodation Codes List for English Language Learners (ELL) The following slide are the only accommodations allowed for ELL students. Oral reading, oral reading in native language, or the use of a bilingual dictionary during the English II assessment will result in the LOSS (Lowest Obtainable Scale Score). 52

53. 53

54. Accommodations List for Students with Disabilities Has changed since last year! 54

55. Note 1 for Students with Disabilities NOTE 1: Oral reading, oral reading in native language or signing any English assessment will result in the LOSS (Lowest Obtainable Scale Score). The use of a bilingual dictionary during the English I or English II, Session I assessment will result in the LOSS. Students identified as blind/visually impaired (who do not read Braille) may use the oral reading accommodation if it is their primary instructional method. 55

56. Note 2 for Students with Disabilities Paraphrasing test questions invalidates all EOC Assessment student scores for accountability purposes. 56 Note 3 for Students with Disabilities Use of magnifying equipment, amplification equipment, graph paper and testing with the teacher facing the student are not listed as accommodations because these are not required to be reported as accommodations for the EOC Assessments.

57. Examiners Manual Phase I & II Directions for Administering Online Assessments English II (Pages 34-37) Biology (Pages 38-41) Algebra I (Pages 42-47) Government (Pages 54-55) 57

58. Test Materials Student Materials Computer workstation with EOC Browser Scratch, graph or draft paper (not provided) At minimum four-function calculators for Algebra I (not provided and not required) Algebra I reference sheet (for Algebra I Sessions I and II) Dictionary, thesaurus, grammar handbook (for English II Session II only – not provided) 58

59. Prepare for Test Administration Organize the classroom Plan seating arrangements/computer usage Eliminate distractions under your control Use a Do Not Disturb sign (not provided) on your door Remove or cover any maps, charts, or other materials that relate to the content and processes of the test. Make testing arrangements for students who do not finish testing in the allotted time frame. 59

60. Electronic Devices At minimum, students may use a four-function calculator during the Algebra I (Session I and Session II) Assessment. Other electronic devices must not be accessible during the testing session. Such items include, but are not limited to: cellular/mobile phones electronic music players digital cameras handheld scanners portable gaming devices any portable device that can connect to the Internet 60

61. Administer the Tests Specific directions for each content area are in the Examiners manual. The following symbol is used throughout the specific directions: 61

62. Agenda EOC General Information and Changes Testing Windows & Test Formats Online Test Examiners Manual Questions 62

63. Re-Read the Manuals 63 Who Calls Riverside? The district should have one point of contact – the DTC! What If We Still Have Questions After Today?