1. Before we begin, please make yourself comfortable and complete the STAR Pre-Test Quiz

2. Standardized Testing and Reporting (STAR) Program Pre-Test Workshop January 2012

3. 2012 STAR Pre-Test Workshop || Slide 3 Objectives STAR coordinators will: Follow correct, current, STAR procedures Ensure all materials are handled securely and appropriately Provide training and monitoring Handout (H) Page 1

4. Agenda Registration and take quiz Introductions Objectives and agenda New for STAR 2012 STAR coordinator responsibilities Writing tests California Standards Tests (CSTs) California Modified Assessment (CMA) Standards-based Tests in Spanish (STS) Multiple-choice tests California Alternate Performance Assessment (CAPA) After testing Summary Early Assessment Program (EAP) tests 2012 STAR Pre-Test Workshop || Slide 4 H 1

5. New for STAR 2012 Testing window: 25 days Answer documents  Front: SEID added  Back: NPS moved  CAPA (shading of “5”) for Level I ONLY Writing tests  Reading aloud prompt now accommodation  Writing test can only be given in 1 d ay CMA  Braille for all  Grades 8–11 if Pre-ID, receive both CST and CMA Pre-ID answer documents Coordinator Manual (M) Pages 2−3 2012 STAR Pre-Test Workshop || Slide 5 H 1

6. New for 2012 District home, hospital, independent study has a school code  If district has a program  Use new district CDS code http://www.cde.ca.gov/ds/sp/cl/documents/ calpadsupdflash41.doc Security Audits Mark Discrimination Analysis 2012 STAR Pre-Test Workshop || Slide 6

7. District STAR Coordinator Responsibilities Handle testing materials  Ensure test security  Receive, inventory, store, distribute, track, collect, and return materials Coordinate testing schedule Coordinate collection of demographic data  Pre-ID (preferred)  Or hand-mark answer documents  Complete the Demographic Fields Form (if needed) Train and oversee site coordinators  Ensure examiners are trained Quiz (Q) 1 2012 STAR Pre-Test Workshop || Slide 7 M 10, 13, 30−32 H 2

8. STAR Site Coordinator Responsibilities Train Examiners Ensure examiners sign affidavits Prevent errors Keep secure Verify materials are marked correctly to ensure correct student scores Guarantee correct enrollment counts Return materials promptly 2012 STAR Pre-Test Workshop || Slide 8 M 10 H 2

9. Site Coordinators Train Examiners Read and sign affidavits MAKE SURE CORRECT TESTS ARE GIVEN  CST and/or CMA  STS  Correct math test for grade 7 if Algebra  Correct EOC for grades 8−11  CAPA Students who are not testing may not stay in the classroom where a test is being administered If students need to be taken to another room to finish testing, BE SURE THEY ARE ESCORTED BY AN ADULT. Do not allow students to walk to another room with test materials by themselves. 2012 STAR Pre-Test Workshop || Slide 9

10. Site Coordinators Train Examiners (Cont.) Examiners CANNOT:  Review test questions before, during, or after testing  Check students’ answers including (among others): 1.Advise students of wrong answer or to check an answer; or 2.Withhold answer docs until students demonstrate they have the right answers 2012 STAR Pre-Test Workshop || Slide 10

11. Site Coordinators Train Examiners (Cont.) Examiners shall monitor students during testing to make sure students are  On correct part  Do not go on to other parts or back to a previously completed part  Do not skip a question on their answer document (so that they are off by one or more). 2012 STAR Pre-Test Workshop || Slide 11

12. Site Coordinators Train Examiners (Cont.) Examiners shall ensure there is enough time to complete a part before beginning the part 2012 STAR Pre-Test Workshop || Slide 12

13. Security Audits At randomly-selected schools and district offices Before, during, or after testing Are materials secure, accounted for, and when not in use locked-up Are correct administrative procedures being followed:  Materials have been removed or covered  Students are not being coached through the exams  Only appropriate accommodations and or modifications are being provided, et. al. 2012 STAR Pre-Test Workshop || Slide 13

14. Site Coordinator video, General, first part about security only 2012 STAR Pre-Test Workshop || Slide 14

15. Writing Tests Writing tests are required CST and CMA Grades 4 and 7 Examiners need to ensure correct test (CST or CMA) given  Check IEPs to determine whether CST or CMA  See bottom of response booklet an d DFA H 3 M 33–37, 54–59 2012 STAR Pre-Test Workshop || Slide 15

16. Writing Tests When?  March 6 (makeup March 7)  May 1 (makeup May 2) Only if not in session March 6 H 3 2012 STAR Pre-Test Workshop || Slide 16

17. Writing Tests Prompt and passage may be read aloud  If specified in IEP or Section 504 plan  As an accommodation if regularly during classroom instruction and assessments  Mark Z on back of answer document Accommodation of extended time is limited to 1 day only No additional pages may be inserted 2012 STAR Pre-Test Workshop || Slide 17

18. After Writing Testing If the student used a word processor:  Mark Section A3, “Accommodations and Modifications,” D or T  If A3 is not marked, the test will not be scored  Place print-out inside Writing Response Booklet Return all materials with either the scorables (student was given test) or nonscorables Return by  Sites: one day after testing  Districts: two days after testing H 3 M 36–37, 57–59 Q 2 ? 2012 STAR Pre-Test Workshop || Slide 18

19. STAR Program Multiple-Choice Tests CSTs  Most students take CSTs  Grades 2–11 unless taking CMA or CAPA CMA  Grades 3–11; varies by grade and content area  Must have IEP and meet eligibility criteria STS  For Spanish-speaking English learners  Grades 2–11  Must also take CST and/or CMA M 4 2012 STAR Pre-Test Workshop || Slide 19

20. California Standards Tests (CSTs) Grades 2–11 Unless taking CMA or CAPA Subjects tested:  English–Language Arts (ELA): all grades; writing for grades 4 and 7  Mathematics: grades 2–7 and end-of- course (EOC) grades 7–11; Note: Rulers used for Grade 2 CST only  Science: grades 5, 8, 10, and EOC 9–11  History–Social Science: grades 8, 11, and EOC 9–11 M 38–40, 60–62 H 4 2012 STAR Pre-Test Workshop || Slide 20

21. Who Takes Which CST for Mathematics? Grades 2–6: Grade-level test required Note: Rulers used for grade 2 CST ONLY Grade 7: Grade-Level mathematics test or Algebra I required H 4 M 16–17, 85 2012 STAR Pre-Test Workshop || Slide 21

22. Who Takes Which CST for Mathematics? Grades 8: One of the following is required:  Algebra I; or  Geometry; or  CST for General Mathematics (if no math course or completing a course for which there is not an EOC mathematics CST) H 4 M 16–17, 85 Q 6 2012 STAR Pre-Test Workshop || Slide 22

23. Q 3 Who Takes Which CST for Mathematics? Grades 9: One of the following is required:  CST for General Mathematics (if no math course or completing a course for which there is not an EOC mathematics CST); or  EOC mathematics CST; or  CST for Summative High School Mathematics Grades 10–11: One of the following is required:  EOC mathematics CST; or  CST for Summative High School Mathematics  No assessment required if not taking a mathematics course unless eligible to take Summative High School Mathematics H 4 M 16–17, 85 2012 STAR Pre-Test Workshop || Slide 23

24. Summative High School Mathematics Students in grades 9–11 will take the CST for Summative High School Mathematics based on:  Math courses taken last summer; or  Math courses to be completed in 2012; or  Previously took the CST for Summative High School Mathematics. M 16−17 H 4 Q 3 ? 2012 STAR Pre-Test Workshop || Slide 24

25. Mark Correct Mathematics Test Taken...... or student will not receive a SCORE. Also include correct version number. H 4 2012 STAR Pre-Test Workshop || Slide 25

26. Site Coordinator video, CST HS video through math only 2012 STAR Pre-Test Workshop || Slide 26

27. CST for Science Required grade-level science  Grades 5, 8, 10: all students shall take the grade-level test  Found in grade-level test booklets: no need to order separately  Students in grade 10 shall also take an end-of-course science  If enrolled in standards-based science course  EOC test booklets must be ordered separately H 4 M 16, 18–19 2012 STAR Pre-Test Workshop || Slide 27

28. CST for Science Grades 9–11 EOC  Completed a California standards-aligned science course in the 2011 summer session or will complete it during 2011–12 school year  Review state blueprints  Review curriculum  Determine which, if any, EOC science CST students in each course will take  Mark correct EOC test and version number on the answer document H 4 2012 STAR Pre-Test Workshop || Slide 28

29. Who Takes the CMA? Students:  Have an IEP  Meet the SBE-adopted eligibility criteria  Enrolled in grades 3–11  May take the CMA for some subjects, CST for other subjects  Must take grade-level CSTs when a CMA is not offered  May have previously taken the CMA, regardless of score  Not eligible to take the CAPA IEP specifies the CMA, subject(s), and variations and/or accommodations No additional modifications are allowed Examiners should check the student’s IEPs to see whether and which CMA test the student should take H 5 M 14 2012 STAR Pre-Test Workshop || Slide 29

30. CMA Tests for 2012 CMA for ELA in grades 3–11 CMA for Writing in grades 4 and 7 CMA for Mathematics in grades 3–7 CMA for Algebra I (EOC for grades 7–11) CMA for Geometry (EOC for grades 8–11) Note: If CMA students in grades 8 or 9 are NOT taking Algebra I or Geometry, the IEP should designate the math test accordingly. There is no CMA General Math. CMA for Science in grades 5 and 8 CMA for Life Science in grade 10 H 6 M 16, 18 2012 STAR Pre-Test Workshop || Slide 30

31. CMA Materials 2012 CMA booklets for grade 3  Separate scorable test booklet  If no CST taken, return CST test booklet with nonscorables CMA for Grades 4–7  CST and CMA in same answer document  Grade 5 ONLY allows calculator (if written into the IEP) If both CST and CMA taken, must mark Section 7c for CMA tests taken M 21, 39 2012 STAR Pre-Test Workshop || Slide 31

32. CMA Materials for 2012 Grades 8−11 If Pre-ID’d:  For grades 8–11 if at least one CMA test is pre-identified for a student, the student will receive both the CMA and the CST pre-identified answer documents If NOT Pre-ID’d:  Answer documents sent based on test booklets ordered M 21, 39 2012 STAR Pre-Test Workshop || Slide 32

33. CMA Materials for 2012 Grades 8−11 CMA for grades 8 and 11  Must order both CST and CMA grade-level test booklets for each student taking one or more CMA exams  All students must take the CST History/Social Science in grade 8 and U.S. History in grade 11 CMA for grades 9 and 10  Order the grade-level CMA test booklets for only the CMA tests to be administered  Order CST only if needed  Students in grades 9 and 10 may take only CMA (ELA, Algebra I, Geometry, grade 10 Life Science) ? 2012 STAR Pre-Test Workshop || Slide 33

34. CST/CMA Answer Document Right side of inside of answer doc grades 4−7 CMA section has: Different subject icons from CST Alternate row shading for the response bubbles Three options choices Fewer number of questions H 7 M 128 2012 STAR Pre-Test Workshop || Slide 34

35. CMA Grade 7 Answer Document Mathematics Section Grade 7 mathematics and Algebra I have different numbers of questions 2012 STAR Pre-Test Workshop || Slide 35

36. BREAK 2012 STAR Pre-Test Workshop || Slide 36

37. STS STS for Reading/Language Arts (RLA) in grades 2–11 STS for Mathematics in grades 2–7  Rulers for grades 2 and 5 STS for Algebra I (EOC for grades 7–11) STS for Geometry (EOC for grades 8–11) Students in grades 8 and 9 who are not taking Algebra I or Geometry courses take NO STS mathematics, but do take CST or CMA mathematics. H 8 M 16 Q 6 2012 STAR Pre-Test Workshop || Slide 37

38. Who Takes the STS? Required for Spanish-speaking English learners (ELs), grades 2–11, who either:  Receive instruction in Spanish; or  Have been enrolled in a school in the U.S. less than 12 cumulative months. Not to be administered to English-only, I-FEP, or R-FEP students H 8 M 15, 16 2012 STAR Pre-Test Workshop || Slide 38

39. Who Takes the STS? Optionally — Districts may also administer to other Spanish-speaking ELs in grades 2–11 Students taking the STS must also take CSTs or the CMA Students who take CAPA do NOT take STS H 8 M 15, 16 2012 STAR Pre-Test Workshop || Slide 39

40. Site Coordinator video, STS Elementary 2012 STAR Pre-Test Workshop || Slide 40

41. Multiple-Choice Tests Receive delivery District 10–20 days before testing School 5–10 days before testing Return for scoring Dist. 5 days after testing School 2 days after testing Order Materials Pre-ID Train Site Coordinators and Examiners Inventory Prepare materials Distribute and track materials Ensure correct Master File and SGID Pack with complete labels Early H 9 2012 STAR Pre-Test Workshop || Slide 41 Test Extended Pre-ID

42. Multiple-Choice Tests M 41 Receive delivery District 10–20 days before testing School 5–10 days before testing Test Extended Pre-I D Order Materials Pre-ID Train Site Coordinators and Examiners Inventory Prepare materials Distribute and track materials Ensure correct Master File and SGID Pack with complete labels Early Receive boxes: All boxes may not come in single delivery Before signing receipt, check number of boxes H 9 2012 STAR Pre-Test Workshop || Slide 42 Return for scoring Dist. 5 days after testing School 2 days after testing

43. Multiple-Choice Tests M 63 Receive delivery District 10–20 days before testing School 5–10 days before testing Order Materials Pre-ID Train Site Coordinators and Examiners Inventory Prepare materials Distribute and track materials Ensure correct Master File and SGID Pack with complete labels Early H 9 2012 STAR Pre-Test Workshop || Slide 43 Test Extended Pre-ID Return for scoring Dist. 5 days after testing School 2 days after testing Prep answer documents 2012 only No copying Ensure correct NPS code

44. Test Extended Pre-I D Multiple-Choice Tests M 64 Receive delivery District 10–20 days before testing School 5–10 days before testing Return for scoring Dist. 5 days after testing School 2 days after testing Order Materials Pre-ID Train Site Coordinators and Examiners Inventory Prepare materials Distribute and track materials Ensure correct Master File and SGID Pack with complete labels Early Give correct test to student Give breaks only at end of part Mark correct math, science tests, versions DFA: translate only “T” H 9 2012 STAR Pre-Test Workshop || Slide 44

45. Multiple-Choice Answer Documents Rearranged SEID  Pre-ID takes precedence over hand-marking  Correctable with data corrections NPS School Code moved to back H 11 2012 STAR Pre-Test Workshop || Slide 45

46. During Multiple-Choice Testing Use Directions for Administration (DFAs) correctly  Read ALL “SAY” boxes exactly as written  ONLY Translate boxes with “T” (NO CST/CMA/STS questions, prompts, or passages may be translated)  Grades 9−11 in single DFA for each test: CST, CMA, STS H 11 2012 STAR Pre-Test Workshop || Slide 46

47. During Multiple-Choice Testing Give correct test booklets and answer documents to students whose names are on answer documents Give breaks only at end of a part as indicated by stop sign Answer documents  Correctly mark test  Correctly mark version # District STAR Coordinator must contact the STAR Program Office if testing irregularities occur H 11 2012 STAR Pre-Test Workshop || Slide 47

48. Performance-based, one-on-one test For students with significant cognitive disabilities unable to take the CSTs even with accommodations and/or modifications or the CMA with accommodations Student must have an IEP IEP specifies CAPA and level Do not take STS Answer document:  Use only 2012 answer document  Ensure correct CAPA Level is marked in 7a CAPA M 14, 16 H 12 2012 STAR Pre-Test Workshop || Slide 48

49. CAPA Observers Districts must double-rate at a minimum of ten percent (10%) of the CAPA students per level, per site (including NPS) Double ratings are randomly selected Observers must mark Observer and BOTH examiners and observers must sign the answer document M 51, 143 Q 7 H 12 2012 STAR Pre-Test Workshop || Slide 49

50. Preparing To Administer the CAPA Observer’s Answer Doc 1 – Name, etc. 3 – Date of Birth 5 – Name 6 – Gender 7a – CAPA Level 7b – Grade 11 – Student ID 12a – SSID Use blank from overage. Observers must mark sections H 12 2012 STAR Pre-Test Workshop || Slide 50

51. 2012 STAR Pre-Test Workshop || Slide 51 Site Coordinator video, CAPA

52. Return for scoring Dist. 5 days after testing School 2 days after testing Pack with complete labels M 24−27, 36, 67, 70 After Testing M 24–27, 36, 67, 70 Receive delivery District 10–20 days before testing School 5–10 days before testing Order Materials Pre-ID Train Site Coordinators and Examiners Inventory Prepare materials Distribute and track materials Ensure correct Master File and SGID Pack with complete labels Early Paperwork Back of answer document Void, transcribe SGID Master File Pack: scorables vs. nonscorables Attach correct labels 2012 STAR Pre-Test Workshop || Slide 52 Test Extended Pre-ID

53. After Testing Answer Documents Train examiners to  Erase NOTHING in answer circles 2012 STAR Pre-Test Workshop || Slide 53

54. After Testing Answer Documents Avoid teaching students in second and third grade to mark through answer circles to eliminate answers. Such marks MAY NOT be erased by adults ? 2012 STAR Pre-Test Workshop || Slide 54

55. Mark Discrimination Analysis An automated process completed at the time of test booklet (grades two and three) and answer document scanning Identifies erasures to determine if the response has changed from:  Correct to wrong, or  Wrong to wrong, or  Wrong to correct, or From the analyses a report is produced and forward to the CDE who in turn requests districts to conduct an investigation based on the analyses  Wrong left wrong, or  Correct left correct, or  No response 2012 STAR Pre-Test Workshop || Slide 55

56. After Testing Answer Documents: Ethnicity/Race If not in Pre-ID,  Mark Yes or No for #8 Hispanic or Latino  If No, mark one or more for #9  If No and #9 blank, counted as two or more races 2012 STAR Pre-Test Workshop || Slide 56

57. After Testing Complete Back of Answer Document A1 DO NOT complete without CDE notification A2 Special Conditions A3 Accommodations and Modifications  Part a: mark “IEP” and/or “Section 504 plan” to indicate which program/plan student has, whether used accommodations or modifications or not. Note: IEP is required to take CMA.  Part b, mark codes for all accommodations student used as specified in IEP and/or 504 plan A4 English Learner Test Variations  For each test, what was actually used M 66 2012 STAR Pre-Test Workshop || Slide 57

58. Disability Code, 16a If not in Pre-ID, mark after testing Required  000 if no IEP  Code from IEP  For CMA and CAPA Note: 000 not valid for CMA or CAPA If 16a is not marked or marked 000 and IEP (A3a) is marked and CMA or CAPA taken, district data file defaults to 999— unknown disability—and must be corrected M 124 ? H 13 2012 STAR Pre-Test Workshop || Slide 58

59. Transcribe  Braille and large print (or not processed)  In Section A3 on the back of the answer document mark “G” or “H”  Damaged answer documents  Write VOID on any answer document(s), with marks, not to be scored; return with nonscorables H 14 2012 STAR Pre-Test Workshop || Slide 59 After Testing

60. School Grade Identification Sheet (SGID) Complete for each set of answer documents or test booklets Check counts to be accurate Place on answer documents for correct  Grade  School (school code machine-marked ) Pre-printed M 26, 93 Q 8 H 15 2012 STAR Pre-Test Workshop || Slide 60

61. After Testing Master File Sheets Return with each school and district Check counts to be accurate Required with scorables if materials were ordered:  Write “0” (zero), no blanks  If not tested, note that school did not test M 60, 67, 95 Q 9 H 16 2012 STAR Pre-Test Workshop || Slide 61

62. After Testing Which Answer Documents to Return Return answer documents for students with special conditions identified in box A2 Must return CST and/or CMA answer documents only if test taken  Students taking CMA in grades 8 or 11 must return CST answer document If no CST, CMA, CAPA, or STS test taken, securely destroy Pre-ID answer documents ? Q 5 2012 STAR Pre-Test Workshop || Slide 62

63. After Testing What to Return Must return the secure CST and STS DFAs for grade 2 with nonscorables Return used grades 2 and 3 test booklets with scorables Must return all CAPA Examiner’s Manuals with nonscorables Must return all grade 4−11 test booklets and unused grades 2, 3 test booklets with nonscorables 2012 STAR Pre-Test Workshop || Slide 63

64. After Testing Pack and Return Return all documents within an administration in same shipment Separate scorables (with SGID) from nonscorables: make sure grade on answer documents matches grade on SGID. M 42−45, 65−70 2012 STAR Pre-Test Workshop || Slide 64

65. After Testing Pack and Return NPS documents  Under SGID with 0000001 code  With district materials Return Home/Hospital/Independent Study with student’s school or district program code, NOT NPS M 42, 43 2012 STAR Pre-Test Workshop || Slide 65

66. Late Material Return Contact STAR TAC Indicate school and district with returns If late scorables: Depending on stage of processing at scoring center, there may be a fee to process Late returns are considered a breach of security 2012 STAR Pre-Test Workshop || Slide 66

67. Site Coordinator video, Multiple- choice video 2012 STAR Pre-Test Workshop || Slide 67

68. Summary What’s New? Responsibilities, including training Writing tests CSTs CMA STS Multiple-choice tests CAPA After testing 2012 STAR Pre-Test Workshop || Slide 68

69. Questions Quiz Answers 1. D 2. A 3. C 4. C 5. C 6. A 7. D 8. B 9. B 2012 STAR Pre-Test Workshop || Slide 69

70. For more information, go to: http://www.cde.ca.gov/ta/tg/sr/ http://www.startest.org/ Or call the STAR Technical Assistance Center 800-955-2954 2012 STAR Pre-Test Workshop || Slide 70