1. 2013 STAR Order Management October 17, 2012 Start Time 9 a.m. Presenters: Michael McDaniel and Mark Hansen 2013 STAR Order Management || Slide 1 October 2012

2. Objectives District STAR coordinators will identify: Which materials to order How to order test materials When to order test materials October 2012 2013 STAR Order Management || Slide 2

3. Agenda Reminders for 2013 ordering 25-day testing window Ordering braille versions Eligibility for tests  CMA  CAPA  STS What needs to be ordered?  Discussed by grade Eligibility for end-of-course (EOC) California Standards Tests (CSTs)  Mathematics  Science  World History October 2012 2013 STAR Order Management || Slide 3

4. Agenda, continued Eligibility for EOC California Modified Assessment (CMA)  Mathematics (Algebra I and Geometry) Eligibility for EOC Standards-based Tests in Spanish (STS)  Mathematics (Algebra I and Geometry) Ordering materials  Overview of process  Ordering options –Online ordering –Batch file submission October 2012 2013 STAR Order Management || Slide 4

5. What’s New Date for ungraded programs  The date used for determining the testing grade of a student in an ungraded program has changed; for 2012–13, it is November 1, 2012 (Education Code [EC] Section 48000 [a][2]). Supplemental ordering  District STAR coordinators will receive an e-mail confirming a supplemental order and listing the materials and quantities ordered. October 2012 2013 STAR Order Management || Slide 5

6. District Preparation Checklist  Obtain school calendars  Including nonpublic, nonsectarian schools (NPS)  Obtain warehouse calendar  Identify dependent charter schools  Identify NPSs providing special education services  Collect order quantities from test site coordinators  Identify materials needed for home/hospital students October 2012 2013 STAR Order Management || Slide 6

7. Site Preparation Checklist: Give to District STAR Coordinator  School calendar(s)  Quantity and type of test booklets required  CST –Grade-level tests  ELA (grades 2–11)  Mathematics (grades 2–7)  Science (grades 5 and 8); Life Science (grade 10)  History–Social Science (grades 8 and 11)  Based on individualized education programs (IEPs) –CMA  ELA (grades 3–11)  Mathematics (grades 3–7)  Science (grades 5 and 8); Life Science (grade 10)  Algebra I (grades 7–11)  Geometry (grades 8–11) October 2012 2013 STAR Order Management || Slide 7

8. Site Preparation Checklist: Give to District STAR Coordinator  CAPA  Special versions  Large print  Braille  Based on mathematics department chair input –CST for EOC mathematics  Algebra I (grades 7–11)  Other EOC mathematics (grades 8–11) –CMA for EOC Mathematics  Algebra I (grades 7–11)  Geometry (grades 8–11) –STS for EOC Mathematics  Algebra I (grades 7–11)  Geometry (grades 8–11) October 2012 2013 STAR Order Management || Slide 8

9. Site Preparation Checklist: Give to District Coordinator (cont.)  Based on science department chair input –CST for EOC science  Grades 9–11  Based on history–social science department chair input –CST for EOC World History  Grades 9–11  Based on English learner status –STS  Grades 2–11  Number of additional DFAs needed for CST, CMA, and STS:  CMA DFAs calculated 1 per 10 students  CST/STS DFAs calculated 1 per 20 students October 2012 2013 STAR Order Management || Slide 9

10. General Rules for Ordering Do NOT over-order  Districts are sent 5% overage  Schools are sent 10% overage Be realistic with quantities  Especially large print, braille –These materials are expensive!  Mobile populations (county offices) –Average prior-year orders, then use “Supplemental Order” process if necessary October 2012 2013 STAR Order Management || Slide 10

11. California Modified Assessment Who Takes the CMA? CMA participation is an IEP team decision based on:  Previous participation in the CSTs or CAPA  Progress based on multiple measures and objective evidence (Previous performance on the CMA may be used as objective evidence to document academic achievement within the year covered by the student's IEP)  Response to appropriate grade-level instruction  Not precluded from attempting to complete requirements for a regular high school diploma  Parents are informed that achievement will be measured based on modified achievement standards See the complete CMA participation criteria at http://www.cde.ca.gov/ta/tg/sr/participcriteria.asp October 2012 2013 STAR Order Management || Slide 11

12. California Modified Assessment Who Takes the CMA? (cont.) Reminders:  The IEP team must annually decide whether the student takes the CMA. The IEP team may continue to designate the CMA for a student who previously scored proficient or advanced if the team determines that the student still meets the SBE-adopted criteria.  Students may take the CMA for some subjects and CST for other subjects  Students may NOT take a combination of CAPA and CMA. October 2012 2013 STAR Order Management || Slide 12

13. California Alternate Performance Assessment Who Takes the CAPA? Student must have an IEP. Student’s IEP must specify CAPA and whether the student should take the grade-assigned CAPA level or CAPA Level I. Note: Student counts by CAPA level are not necessary during the ordering process. October 2012 2013 STAR Order Management || Slide 13

14. What needs to be ordered? CAPA Examiner’s Manual: One for each examiner  Can be used for several students  All CAPA levels covered  One version per school district Answer documents  One per student taking the CAPA  All CAPA levels covered  10% double-rated (use overage) –Will be discussed in the Pre-Test Workshop October 2012 2013 STAR Order Management || Slide 14

15. CAPA Manipulatives Not ordered through ETS School districts need to assemble manipulatives Dependent upon  CAPA version –Assigned by ETS (available in early December)  CAPA level –Determined by IEP team  Designate Level I or grade-level Manipulatives list indicates the following:  Single-use items  Multi-use items October 2012 2013 STAR Order Management || Slide 15

16. Standards-based Tests in Spanish Who takes the STS? Available in grades 2–11  Spanish-speaking English learners (EL) –Required to take the STS if they:  Are receiving instruction in Spanish OR  Will have attended school in the U.S. or one of its territories less than 12 cumulative months on the first day of testing (regardless of whether they receive instruction in English or Spanish) –At the option of the school district:  Any other Spanish-speaking English learners –Note : Students take the STS in addition to the CST and/or CMA October 2012 2013 STAR Order Management || Slide 16

17. What Needs to Be Ordered, by Grade October 2012 2013 STAR Order Management || Slide 17

18. What needs to be ordered? Grade 2 CST grade-level test booklet for each student to be tested  Contains: –CST for English–Language Arts –CST for Mathematics STS grade-level test booklet for each eligible student  Contains: –STS for Reading/Language Arts –STS for Mathematics October 2012 2013 STAR Order Management || Slide 18

19. What needs to be ordered? Grade 3 CST grade-level test booklet for each student to be tested with one or more CST  CST test booklet contains: –CST for English–Language Arts –CST for Mathematics CMA test booklet for each eligible student  Contains: –CMA for English–Language Arts –CMA for Mathematics STS grade-level test booklet for each eligible student  Contains: –STS for Reading/Language Arts –STS for Mathematics October 2012 2013 STAR Order Management || Slide 19

20. What needs to be ordered? Grade 4 CST grade-level test booklet for each student to be tested with one or more CST  Contains: –CST for English–Language Arts –CST for Mathematics CMA grade-level test booklet for each eligible student  Contains: –CMA for English–Language Arts –CMA for Mathematics STS grade-level test booklet for each eligible student  Contains: –STS for Reading/Language Arts –STS for Mathematics October 2012 2013 STAR Order Management || Slide 20

21. What needs to be ordered? Grade 4 (cont.) CST for Writing test booklet for all students taking the CST for ELA CMA for Writing test booklet for all students taking the CMA for ELA Note: There is no writing test for the STS October 2012 2013 STAR Order Management || Slide 21

22. What needs to be ordered? Grade 5 CST grade-level test booklet for each student to be tested with one or more CST  Contains: –CST for English–Language Arts –CST for Mathematics –CST for Science CMA grade-level test booklet for each eligible student  Contains: –CMA for English–Language Arts –CMA for Mathematics –CMA for Science STS grade-level test booklet for each eligible student  Contains: –STS for Reading/Language Arts –STS for Mathematics October 2012 2013 STAR Order Management || Slide 22

23. What needs to be ordered? Grade 6 CST grade-level test booklet for each student to be tested with one or more CST  Contains: –CST for English–Language Arts –CST for Mathematics CMA grade-level test booklet for each eligible student  Contains: –CMA for English–Language Arts –CMA for Mathematics STS grade-level test booklet for each eligible student  Contains: –STS for Reading/Language Arts –STS for Mathematics October 2012 2013 STAR Order Management || Slide 23

24. What needs to be ordered? Grade 7 CST grade-level test booklet for each student to be tested with one or more CST  Contains: –CST for English–Language Arts –CST for Mathematics  For students not completing an Algebra I course CMA grade-level test booklet for each eligible student  Contains: –CMA for English–Language Arts –CMA for Mathematics  For students not completing an Algebra I course CST or CMA Algebra I test booklet  For students completing a standards-aligned Algebra I course October 2012 2013 STAR Order Management || Slide 24

25. What needs to be ordered? Grade 7 (cont.) STS grade-level test booklet for each eligible student  Contains: –STS for Reading/Language Arts –STS for Mathematics (grade-level) Algebra I STS test booklet  For students completing a standards-aligned Algebra I course CST for Writing test booklet for all students taking the CST for ELA CMA for Writing test booklet for all students taking the CMA for ELA Note: There is no writing test for the STS. October 2012 2013 STAR Order Management || Slide 25

26. What needs to be ordered? Grade 8 CST grade-level test booklet for each student to be tested  Contains: –CST for English–Language Arts –CST for Science –CST for History–Social Science CMA grade-level test booklet for each eligible student  Contains: –CMA for English–Language Arts –CMA for Science October 2012 2013 STAR Order Management || Slide 26

27. What needs to be ordered? Grade 8 (cont.) EOC CST or CMA mathematics test booklet  All grade 8 students MUST take a mathematics test  Test booklet contains one of the following: –CST or CMA for Algebra I –CST for General Mathematics –CST or CMA for Geometry –CST for other EOC mathematics  Courses aligned with the CST or CMA blueprint October 2012 2013 STAR Order Management || Slide 27

28. What needs to be ordered? Grade 8 (cont.) STS grade-level test booklet for each eligible student  Contains: –STS for Reading/Language Arts EOC mathematics STS test booklet  Contains –STS for Algebra I or STS for Geometry  Courses aligned with STS blueprint October 2012 2013 STAR Order Management || Slide 28

29. What needs to be ordered? Grade 9 CST grade-level test booklet for each student to be tested  Contains: –CST for English–Language Arts CMA grade-level test booklet for each eligible student  Contains: –CMA for English–Language Arts EOC mathematics CST or CMA test booklet  All grade 9 students MUST take a mathematics test  Contains one of the following: –CST or CMA for Algebra I or Geometry –CST for General Mathematics –CST for other EOC mathematics  Courses aligned with the CST or CMA blueprint October 2012 2013 STAR Order Management || Slide 29

30. What needs to be ordered? Grade 9 (cont.) EOC science CST test booklet  Contains one of the following: –Biology, or Earth Science, or Physics, etc.  Courses aligned with the CST blueprint CST for EOC World History test booklet  Course aligned with the CST blueprint STS grade-level test booklet for each eligible student  Contains: –STS for Reading/Language Arts EOC mathematics STS test booklet for each eligible student  Contains: –STS for Algebra I or STS for Geometry  Courses aligned with the STS blueprint October 2012 2013 STAR Order Management || Slide 30

31. What needs to be ordered? Grade 10 CST grade-level test booklet for each student to be tested  Contains: –CST for English–Language Arts –CST for Life Science CMA grade-level test booklet for each eligible student  Contains: –CMA for English–Language Arts –CMA for Life Science EOC mathematics CST or CMA test booklet  Contains one of the following: –CST or CMA for Algebra I or Geometry –CST for Algebra II, or CST for Integrated Mathematics 3, and so forth  Courses aligned with the CST or CMA blueprint October 2012 2013 STAR Order Management || Slide 31

32. What needs to be ordered? Grade 10 (cont.) EOC science CST test booklet  Contains one of the following: –Earth Science, or Biology, or Physics, etc.  Courses aligned with the CST blueprint CST for EOC World History test booklet  Course aligned with the CST blueprint STS grade-level test booklet for each eligible student  Contains: –STS for Reading/Language Arts EOC mathematics STS test booklet for each eligible student Contains: –STS for Algebra I or STS for Geometry  Courses aligned with the STS blueprint October 2012 2013 STAR Order Management || Slide 32

33. What needs to be ordered? Grade 11 CST grade-level test booklet for each student to be tested  Contains: –CST for English–Language Arts –CST for U.S. History CMA grade-level test booklet for each eligible student  Contains: –CMA for English–Language Arts EOC for mathematics CST or CMA test booklet  Contains one of the following: –CST or CMA for Algebra I or Geometry –CST for Algebra II, or CST for Integrated Mathematics 3, and so forth  Courses aligned with the CST or CMA blueprint October 2012 2013 STAR Order Management || Slide 33

34. What needs to be ordered? Grade 11 (cont.) EOC science CST test booklet  Contains one of the following: –Earth Science or Biology or Physics, and so forth  Courses aligned with the CST blueprint CST for EOC World History test booklet  Course aligned with the CST blueprint STS grade-level test booklet for each eligible student  Contains: –STS for Reading/Language Arts STS for EOC mathematics test booklet for each eligible student Contains: –STS for Algebra I or STS for Geometry  Courses aligned with the ST S blueprint EAP Essay test booklet October 2012 2013 STAR Order Management || Slide 34

35. Who Takes CST or CMA for EOC Mathematics? Grades 2–9  ALL students take a mathematics test Grades 10 and 11  Students may take no mathematics test if –They are in the first year of a multiyear Algebra I course; or –They are taking a Business Mathematics course or a general mathematics course; or –They are taking no mathematics course (unless they are eligible to take the CST for Summative High School Mathematics). Determine which mathematics test will be administered in grades 7–11  Review state blueprints available at: http://www.cde.ca.gov/ta/tg/sr/resources.asp  Review curriculum  Review guidelines in the Order Management Manual  CMA students in grades 8 and 9 should take the CMA for Algebra I, Geometry, an EOC mathematics CST, or the CST for General Mathematics October 2012 2013 STAR Order Management || Slide 35

36. Who takes the STS for EOC Mathematics? The STS for Algebra I is available for students in grades 7–11 The STS for Geometry is available for students in grades 8–11 Eligibility requirements are as follows:  Completing the course or completed it in the summer of 2012  Same EOC rules as CST/CMA  Must be Spanish-speaking English learners (EL) October 2012 2013 STAR Order Management || Slide 36

37. Which Students Take the CST for General Mathematics? Students in grades 8 or 9 only who are  Not taking a mathematics course; or  Taking any mathematics course prior to Algebra I (e.g. Pre-Algebra, Algebra Readiness, Business mathematics, and so forth); or  Not in the last year of a multiyear Algebra I course October 2012 2013 STAR Order Management || Slide 37

38. Which Students Take Algebra I? Students in grades 7–11 who completed an Algebra I course in the 2012 summer session or will complete it during the 2012–13. Grade 7 students not completing an Algebra I course take the grade 7 mathematics test. October 2012 2013 STAR Order Management || Slide 38

39. Which Students Take Summative High School Mathematics? Students in grades 9–11, if:  They completed Algebra I, Algebra II, and Geometry courses in previous years and completed an advanced mathematics course in the 2012 summer session or will complete it during the 2012–13 school year; or  They completed a course aligned with the Integrated Mathematics 3 test blueprint in a previous year and completed an advanced mathematics course in the 2012 summer session or will complete it during the 2012–13 school year; or  They completed Algebra I, Algebra II, and Geometry courses in previous years and are taking no mathematics course this year; or  They completed a course aligned with the Integrated Mathematics 3 test blueprint in a previous year and are taking no mathematics course this year ; or  They are in grade ten or grade eleven and took the CST for Summative High School Mathematics in a previous year; those students retake the CST for Summative High School Mathematics (whether or not they are taking a mathematics class). October 2012 2013 STAR Order Management || Slide 39

40. EOC Mathematics—Example 1 Carol  2012 –Grade 9 student –Previously completed Algebra I and Geometry courses and took an Algebra II course in 2012 –Took the CST for Algebra II  2013 –Grade 10 student –Not studying mathematics –Takes CST for Summative High School Mathematics October 2012 2013 STAR Order Management || Slide 40

41. EOC Mathematics—Example 2 Robert  2012 –Grade 9 student –Took a Geometry course (but has not taken Algebra II) –Took the CST for Geometry  2013 –Grade 10 student –Not studying mathematics –Takes no mathematics test October 2012 2013 STAR Order Management || Slide 41

42. EOC Mathematics—Example 3 Juan  2012 –Grade 10 student –Took an advanced mathematics course –Took the CST for Summative High School Mathematics  2013 –Grade 11 student –Not studying mathematics –Takes the CST for Summative High School Mathematics October 2012 2013 STAR Order Management || Slide 42

43. EOC Mathematics—Example 4 Juliet  2012 –Grade 10 student –Took an advanced mathematics course –Took the CST for Summative High School Mathematics  2013 –Grade 11 student –Studying Calculus –Takes the CST for Summative High School Mathematics October 2012 2013 STAR Order Management || Slide 43

44. Which Students Take End-of-Course Science? Students in grades 9–11  Completed a California standards-aligned science course in the 2012 summer session or will complete it during the 2012 – 2013 school year. –Review state blueprints –Review curriculum –Determine which, if any EOC science CST students in each course will take All students in grade 10 take the Life Science test  Test printed in the grade 10 test booklet (both CST and CMA)  Grade 10 students will also take an EOC science CST if taking a standards-aligned science course. October 2012 2013 STAR Order Management || Slide 44

45. Which Students Take End-of-Course World History? Students in grades 9–11  Completed the World History course in the 2012 summer session or will complete it during the 2012–13 school year All students in grade 11 will take the CST for U.S. History  The test is printed in the grade 11 test booklet  Grade 11 students will also take the CST for World History if they meet the criteria above October 2012 2013 STAR Order Management || Slide 45

46. EAP Essay Grade 11  Order for all students  Must be taken in conjunction with additional ELA multiple-choice questions to achieve an exemption from the CSU and participating California Community Colleges.  Order entered on the Early Assessment Program administration (EP01)  Approve order separately October 2012 2013 STAR Order Management || Slide 46

47. 15-minute break for everyone! October 2012 2013 STAR Order Management || Slide 47

48. Test Administrations Multiple-choice  Up to 8 administrations allowed MC01 – MC08  Each administration should have different date for “First day of testing”  Each administration’s order needs to be approved separately –Enter orders for ALL administrations before starting approval process –Report for 2013 provides list of schools without orders –Report generated when each order approved Writing Application (grades 4 and 7) CST and CMA  Administration WA01 –March 5 with makeup on March 6 if in session on March 6  Administration WA02 –May 7 with makeup on May 8 ONLY if not in session on March 6  Enter and approve order separately from multiple-choice Early Assessment Program (EAP) Essay  Administration EP01 –March 5 through March 29  Enter and approve order separately from multiple choice October 2012 2013 STAR Order Management || Slide 48

49. Ordering Procedures 1.Set up test administration dates See the Webcast “2010 STAR Test Administration Setup” Manual posted on www.startest.org/sms.html Or, call your STAR TAC Representative 2.Confirm “Profile” information Primary Shipping Address Secondary Shipping Address (optional) –Can be used for Supplemental Order delivery Report Shipping Address (optional) –Used to deliver Reports in summer 2013 –Address must be set up before June 1, 2013 October 2012 2013 STAR Order Management || Slide 49

50. Ordering Procedures 1.Enter order quantities for each Multiple-Choice, Writing Application, and Early Assessment Program administration. Screen entry or Produce file containing order quantities and upload 2.Approve order for each administration. October 2012 2013 STAR Order Management || Slide 50

51. Supplemental Orders District STAR coordinators will receive an e-mail confirming a supplemental order and listing the materials and quantities ordered.  An e-mail will automatically be generated and sent to the designated district STAR Coordinator once the supplemental order has been approved October 2012 2013 STAR Order Management || Slide 51

52. Software Demonstration 1.Verify Profile 2.Enter order online 3.Approve order October 2012 2013 STAR Order Management || Slide 52

53. October 2012 2013 STAR Order Management || Slide 53

54. October 2012 2013 STAR Order Management || Slide 54

55. October 2012 2013 STAR Order Management || Slide 55

56. October 2012 2013 STAR Order Management || Slide 56

57. October 2012 2013 STAR Order Management || Slide 57

58. October 2012 2013 STAR Order Management || Slide 58

59. October 2012 2013 STAR Order Management || Slide 59

60. October 2012 2013 STAR Order Management || Slide 60

61. October 2012 2013 STAR Order Management || Slide 61

62. October 2012 2013 STAR Order Management || Slide 62

63. October 2012 2013 STAR Order Management || Slide 63

64. School district cannot approve order when errors still exist. October 2012 2013 STAR Order Management || Slide 64

65. October 2012 2013 STAR Order Management || Slide 65

66. October 2012 2013 STAR Order Management || Slide 66

67. Book count warnings Schools with no orders School district can still approve order when warnings exist. October 2012 2013 STAR Order Management || Slide 67

68. October 2012 2013 STAR Order Management || Slide 68

69. October 2012 2013 STAR Order Management || Slide 69

70. 2013 STAR Order Management || Slide 70 October 2012

71. 2013 STAR Order Management || Slide 71

72. 2013 STAR Order Management | Slide 1 October 2012 2013 STAR Order Management || Slide 72

73. STAR Order Management File upload option October 2012 2013 STAR Order Management || Slide 73

74. Order File Upload Format Included in Order Management Manual Fixed-length field; text file only Orders for one administration only per file October 2012 2013 STAR Order Management || Slide 74

75. Sample File October 2012 2012 STAR Order Management || Slide 75 October 2010

76. Sample E-Mail October 2012 2013 STAR Order Management || Slide 76

77. Review and Approve Review orders using  Online screens and/or  Printouts generated by the STAR Management System Adjust orders where necessary using  Online entry to adjust quantities Approve orders  All orders entered through “file upload” need to be approved by the district STAR coordinator October 2012 2013 STAR Order Management || Slide 77

78. In Conclusion October 2012 2013 STAR Order Management || Slide 78

79. Excessive Materials Ordered Charges 90% of the value of materials ordered minus value of materials used Be careful ordering!  Do not over-order  Large-print and braille materials are very expensive No excessive order charges for EAP Essay test books ETS will invoice approximately December 2012 October 2012 2013 STAR Order Management || Slide 79

80. Excessive Materials Ordered Charges Value of materials ordered ($x)  Does not include overages  Order quantities will be adjusted based on number of Pre-ID records Value of materials used ($y) If (x-y) ≤ 10%(x) then no charges will apply If (x-y) > 10%(x) then charges will apply October 2012 2013 STAR Order Management || Slide 80

81. Excessive Materials Ordered Charges Example 1 Value of materials ordered = $5,000 Value of materials used = $4,600 Difference between ordered and used = $400 10% of materials ordered = $500 Difference ($400) is less than 10% of materials ordered ($500)  No charges will apply October 2012 2013 STAR Order Management || Slide 81

82. Excessive Materials Ordered Charges Example 2 Value of materials ordered = $5,000 Value of materials used = $4,100 Difference between ordered and used = $900 10% of materials ordered = $500 Difference ($900) is greater than 10% of materials ordered ($500)  Charge will apply  Charge will be $900 – $500 = $400 October 2012 2013 STAR Order Management || Slide 82

83. Review Set up test administration dates  NPS schedules may be different from district schedules Enter order quantities for each administration  Multiple-choice  Writing (CST and CMA, grades 4 and 7)  EAP Essay Approve orders  Every administration October 2012 2013 STAR Order Management || Slide 83

84. Timetable Gather data from sites immediately Enter orders: Now through December 1, 2012 Orders reviewed by ETS throughout December and January Adjustments to initial orders up until “Order Sent for Packaging” date If required, place supplemental orders after “Order Sent for Packaging” date Track order status October 2012 2013 STAR Order Management || Slide 84

85. Questions? October 2012 2013 STAR Order Management || Slide 85

86. More Questions? For STAR technical questions: STAR TAC—800-955-2954 For STAR policies: CDE—916-445-8765 For accountability questions: CDE Academic Accountability Unit—916-319-0863 October 2012 2013 STAR Order Management || Slide 86

87. Next Webcast 2013 STAR Pre-ID Workshop Webcast November 14, 2012 October 2012 2013 STAR Order Management || Slide 87