Before we begin, please make yourself comfortable and complete the STAR Pre-Test Quiz

Standardized Testing and Reporting (STAR) Program Pre-Test Workshop January 2012

2012 STAR Pre-Test Workshop || Slide 3 Objectives STAR coordinators will: Follow correct, current, STAR procedures Ensure all materials are handled securely and appropriately Provide training and monitoring Handout (H) Page 1

Agenda Registration and take quiz Introductions Objectives and agenda New for STAR 2012 STAR coordinator responsibilities Writing tests California Standards Tests (CSTs) California Modified Assessment (CMA) Standards-based Tests in Spanish (STS) Multiple-choice tests California Alternate Performance Assessment (CAPA) After testing Summary Early Assessment Program (EAP) tests 2012 STAR Pre-Test Workshop || Slide 4 H 1

New for STAR 2012 Testing window: 25 days Answer documents  Front: SEID added  Back: NPS moved  CAPA (shading of “5”) for Level I ONLY Writing tests  Reading aloud prompt now accommodation  Writing test can only be given in 1 d ay CMA  Braille for all  Grades 8–11 if Pre-ID, receive both CST and CMA Pre-ID answer documents Coordinator Manual (M) Pages 2− STAR Pre-Test Workshop || Slide 5 H 1

New for 2012 District home, hospital, independent study has a school code  If district has a program  Use new district CDS code calpadsupdflash41.doc Security Audits Mark Discrimination Analysis 2012 STAR Pre-Test Workshop || Slide 6

District STAR Coordinator Responsibilities Handle testing materials  Ensure test security  Receive, inventory, store, distribute, track, collect, and return materials Coordinate testing schedule Coordinate collection of demographic data  Pre-ID (preferred)  Or hand-mark answer documents  Complete the Demographic Fields Form (if needed) Train and oversee site coordinators  Ensure examiners are trained Quiz (Q) STAR Pre-Test Workshop || Slide 7 M 10, 13, 30−32 H 2

STAR Site Coordinator Responsibilities Train Examiners Ensure examiners sign affidavits Prevent errors Keep secure Verify materials are marked correctly to ensure correct student scores Guarantee correct enrollment counts Return materials promptly 2012 STAR Pre-Test Workshop || Slide 8 M 10 H 2

Site Coordinators Train Examiners Read and sign affidavits MAKE SURE CORRECT TESTS ARE GIVEN  CST and/or CMA  STS  Correct math test for grade 7 if Algebra  Correct EOC for grades 8−11  CAPA Students who are not testing may not stay in the classroom where a test is being administered If students need to be taken to another room to finish testing, BE SURE THEY ARE ESCORTED BY AN ADULT. Do not allow students to walk to another room with test materials by themselves STAR Pre-Test Workshop || Slide 9

Site Coordinators Train Examiners (Cont.) Examiners CANNOT:  Review test questions before, during, or after testing  Check students’ answers including (among others): 1.Advise students of wrong answer or to check an answer; or 2.Withhold answer docs until students demonstrate they have the right answers 2012 STAR Pre-Test Workshop || Slide 10

Site Coordinators Train Examiners (Cont.) Examiners shall monitor students during testing to make sure students are  On correct part  Do not go on to other parts or back to a previously completed part  Do not skip a question on their answer document (so that they are off by one or more) STAR Pre-Test Workshop || Slide 11

Site Coordinators Train Examiners (Cont.) Examiners shall ensure there is enough time to complete a part before beginning the part 2012 STAR Pre-Test Workshop || Slide 12

Security Audits At randomly-selected schools and district offices Before, during, or after testing Are materials secure, accounted for, and when not in use locked-up Are correct administrative procedures being followed:  Materials have been removed or covered  Students are not being coached through the exams  Only appropriate accommodations and or modifications are being provided, et. al STAR Pre-Test Workshop || Slide 13

Site Coordinator video, General, first part about security only 2012 STAR Pre-Test Workshop || Slide 14

Writing Tests Writing tests are required CST and CMA Grades 4 and 7 Examiners need to ensure correct test (CST or CMA) given  Check IEPs to determine whether CST or CMA  See bottom of response booklet an d DFA H 3 M 33–37, 54– STAR Pre-Test Workshop || Slide 15

Writing Tests When?  March 6 (makeup March 7)  May 1 (makeup May 2) Only if not in session March 6 H STAR Pre-Test Workshop || Slide 16

Writing Tests Prompt and passage may be read aloud  If specified in IEP or Section 504 plan  As an accommodation if regularly during classroom instruction and assessments  Mark Z on back of answer document Accommodation of extended time is limited to 1 day only No additional pages may be inserted 2012 STAR Pre-Test Workshop || Slide 17

After Writing Testing If the student used a word processor:  Mark Section A3, “Accommodations and Modifications,” D or T  If A3 is not marked, the test will not be scored  Place print-out inside Writing Response Booklet Return all materials with either the scorables (student was given test) or nonscorables Return by  Sites: one day after testing  Districts: two days after testing H 3 M 36–37, 57–59 Q 2 ? 2012 STAR Pre-Test Workshop || Slide 18

STAR Program Multiple-Choice Tests CSTs  Most students take CSTs  Grades 2–11 unless taking CMA or CAPA CMA  Grades 3–11; varies by grade and content area  Must have IEP and meet eligibility criteria STS  For Spanish-speaking English learners  Grades 2–11  Must also take CST and/or CMA M STAR Pre-Test Workshop || Slide 19

California Standards Tests (CSTs) Grades 2–11 Unless taking CMA or CAPA Subjects tested:  English–Language Arts (ELA): all grades; writing for grades 4 and 7  Mathematics: grades 2–7 and end-of- course (EOC) grades 7–11; Note: Rulers used for Grade 2 CST only  Science: grades 5, 8, 10, and EOC 9–11  History–Social Science: grades 8, 11, and EOC 9–11 M 38–40, 60–62 H STAR Pre-Test Workshop || Slide 20

Who Takes Which CST for Mathematics? Grades 2–6: Grade-level test required Note: Rulers used for grade 2 CST ONLY Grade 7: Grade-Level mathematics test or Algebra I required H 4 M 16–17, STAR Pre-Test Workshop || Slide 21

Who Takes Which CST for Mathematics? Grades 8: One of the following is required:  Algebra I; or  Geometry; or  CST for General Mathematics (if no math course or completing a course for which there is not an EOC mathematics CST) H 4 M 16–17, 85 Q STAR Pre-Test Workshop || Slide 22

Q 3 Who Takes Which CST for Mathematics? Grades 9: One of the following is required:  CST for General Mathematics (if no math course or completing a course for which there is not an EOC mathematics CST); or  EOC mathematics CST; or  CST for Summative High School Mathematics Grades 10–11: One of the following is required:  EOC mathematics CST; or  CST for Summative High School Mathematics  No assessment required if not taking a mathematics course unless eligible to take Summative High School Mathematics H 4 M 16–17, STAR Pre-Test Workshop || Slide 23

Summative High School Mathematics Students in grades 9–11 will take the CST for Summative High School Mathematics based on:  Math courses taken last summer; or  Math courses to be completed in 2012; or  Previously took the CST for Summative High School Mathematics. M 16−17 H 4 Q 3 ? 2012 STAR Pre-Test Workshop || Slide 24

Mark Correct Mathematics Test Taken or student will not receive a SCORE. Also include correct version number. H STAR Pre-Test Workshop || Slide 25

Site Coordinator video, CST HS video through math only 2012 STAR Pre-Test Workshop || Slide 26

CST for Science Required grade-level science  Grades 5, 8, 10: all students shall take the grade-level test  Found in grade-level test booklets: no need to order separately  Students in grade 10 shall also take an end-of-course science  If enrolled in standards-based science course  EOC test booklets must be ordered separately H 4 M 16, 18– STAR Pre-Test Workshop || Slide 27

CST for Science Grades 9–11 EOC  Completed a California standards-aligned science course in the 2011 summer session or will complete it during 2011–12 school year  Review state blueprints  Review curriculum  Determine which, if any, EOC science CST students in each course will take  Mark correct EOC test and version number on the answer document H STAR Pre-Test Workshop || Slide 28

Who Takes the CMA? Students:  Have an IEP  Meet the SBE-adopted eligibility criteria  Enrolled in grades 3–11  May take the CMA for some subjects, CST for other subjects  Must take grade-level CSTs when a CMA is not offered  May have previously taken the CMA, regardless of score  Not eligible to take the CAPA IEP specifies the CMA, subject(s), and variations and/or accommodations No additional modifications are allowed Examiners should check the student’s IEPs to see whether and which CMA test the student should take H 5 M STAR Pre-Test Workshop || Slide 29

CMA Tests for 2012 CMA for ELA in grades 3–11 CMA for Writing in grades 4 and 7 CMA for Mathematics in grades 3–7 CMA for Algebra I (EOC for grades 7–11) CMA for Geometry (EOC for grades 8–11) Note: If CMA students in grades 8 or 9 are NOT taking Algebra I or Geometry, the IEP should designate the math test accordingly. There is no CMA General Math. CMA for Science in grades 5 and 8 CMA for Life Science in grade 10 H 6 M 16, STAR Pre-Test Workshop || Slide 30

CMA Materials 2012 CMA booklets for grade 3  Separate scorable test booklet  If no CST taken, return CST test booklet with nonscorables CMA for Grades 4–7  CST and CMA in same answer document  Grade 5 ONLY allows calculator (if written into the IEP) If both CST and CMA taken, must mark Section 7c for CMA tests taken M 21, STAR Pre-Test Workshop || Slide 31

CMA Materials for 2012 Grades 8−11 If Pre-ID’d:  For grades 8–11 if at least one CMA test is pre-identified for a student, the student will receive both the CMA and the CST pre-identified answer documents If NOT Pre-ID’d:  Answer documents sent based on test booklets ordered M 21, STAR Pre-Test Workshop || Slide 32

CMA Materials for 2012 Grades 8−11 CMA for grades 8 and 11  Must order both CST and CMA grade-level test booklets for each student taking one or more CMA exams  All students must take the CST History/Social Science in grade 8 and U.S. History in grade 11 CMA for grades 9 and 10  Order the grade-level CMA test booklets for only the CMA tests to be administered  Order CST only if needed  Students in grades 9 and 10 may take only CMA (ELA, Algebra I, Geometry, grade 10 Life Science) ? 2012 STAR Pre-Test Workshop || Slide 33

CST/CMA Answer Document Right side of inside of answer doc grades 4−7 CMA section has: Different subject icons from CST Alternate row shading for the response bubbles Three options choices Fewer number of questions H 7 M STAR Pre-Test Workshop || Slide 34

CMA Grade 7 Answer Document Mathematics Section Grade 7 mathematics and Algebra I have different numbers of questions 2012 STAR Pre-Test Workshop || Slide 35

BREAK 2012 STAR Pre-Test Workshop || Slide 36

STS STS for Reading/Language Arts (RLA) in grades 2–11 STS for Mathematics in grades 2–7  Rulers for grades 2 and 5 STS for Algebra I (EOC for grades 7–11) STS for Geometry (EOC for grades 8–11) Students in grades 8 and 9 who are not taking Algebra I or Geometry courses take NO STS mathematics, but do take CST or CMA mathematics. H 8 M 16 Q STAR Pre-Test Workshop || Slide 37

Who Takes the STS? Required for Spanish-speaking English learners (ELs), grades 2–11, who either:  Receive instruction in Spanish; or  Have been enrolled in a school in the U.S. less than 12 cumulative months. Not to be administered to English-only, I-FEP, or R-FEP students H 8 M 15, STAR Pre-Test Workshop || Slide 38

Who Takes the STS? Optionally — Districts may also administer to other Spanish-speaking ELs in grades 2–11 Students taking the STS must also take CSTs or the CMA Students who take CAPA do NOT take STS H 8 M 15, STAR Pre-Test Workshop || Slide 39

Site Coordinator video, STS Elementary 2012 STAR Pre-Test Workshop || Slide 40

Multiple-Choice Tests Receive delivery District 10–20 days before testing School 5–10 days before testing Return for scoring Dist. 5 days after testing School 2 days after testing Order Materials Pre-ID Train Site Coordinators and Examiners Inventory Prepare materials Distribute and track materials Ensure correct Master File and SGID Pack with complete labels Early H STAR Pre-Test Workshop || Slide 41 Test Extended Pre-ID

Multiple-Choice Tests M 41 Receive delivery District 10–20 days before testing School 5–10 days before testing Test Extended Pre-I D Order Materials Pre-ID Train Site Coordinators and Examiners Inventory Prepare materials Distribute and track materials Ensure correct Master File and SGID Pack with complete labels Early Receive boxes: All boxes may not come in single delivery Before signing receipt, check number of boxes H STAR Pre-Test Workshop || Slide 42 Return for scoring Dist. 5 days after testing School 2 days after testing

Multiple-Choice Tests M 63 Receive delivery District 10–20 days before testing School 5–10 days before testing Order Materials Pre-ID Train Site Coordinators and Examiners Inventory Prepare materials Distribute and track materials Ensure correct Master File and SGID Pack with complete labels Early H STAR Pre-Test Workshop || Slide 43 Test Extended Pre-ID Return for scoring Dist. 5 days after testing School 2 days after testing Prep answer documents 2012 only No copying Ensure correct NPS code

Test Extended Pre-I D Multiple-Choice Tests M 64 Receive delivery District 10–20 days before testing School 5–10 days before testing Return for scoring Dist. 5 days after testing School 2 days after testing Order Materials Pre-ID Train Site Coordinators and Examiners Inventory Prepare materials Distribute and track materials Ensure correct Master File and SGID Pack with complete labels Early Give correct test to student Give breaks only at end of part Mark correct math, science tests, versions DFA: translate only “T” H STAR Pre-Test Workshop || Slide 44

Multiple-Choice Answer Documents Rearranged SEID  Pre-ID takes precedence over hand-marking  Correctable with data corrections NPS School Code moved to back H STAR Pre-Test Workshop || Slide 45

During Multiple-Choice Testing Use Directions for Administration (DFAs) correctly  Read ALL “SAY” boxes exactly as written  ONLY Translate boxes with “T” (NO CST/CMA/STS questions, prompts, or passages may be translated)  Grades 9−11 in single DFA for each test: CST, CMA, STS H STAR Pre-Test Workshop || Slide 46

During Multiple-Choice Testing Give correct test booklets and answer documents to students whose names are on answer documents Give breaks only at end of a part as indicated by stop sign Answer documents  Correctly mark test  Correctly mark version # District STAR Coordinator must contact the STAR Program Office if testing irregularities occur H STAR Pre-Test Workshop || Slide 47

Performance-based, one-on-one test For students with significant cognitive disabilities unable to take the CSTs even with accommodations and/or modifications or the CMA with accommodations Student must have an IEP IEP specifies CAPA and level Do not take STS Answer document:  Use only 2012 answer document  Ensure correct CAPA Level is marked in 7a CAPA M 14, 16 H STAR Pre-Test Workshop || Slide 48

CAPA Observers Districts must double-rate at a minimum of ten percent (10%) of the CAPA students per level, per site (including NPS) Double ratings are randomly selected Observers must mark Observer and BOTH examiners and observers must sign the answer document M 51, 143 Q 7 H STAR Pre-Test Workshop || Slide 49

Preparing To Administer the CAPA Observer’s Answer Doc 1 – Name, etc. 3 – Date of Birth 5 – Name 6 – Gender 7a – CAPA Level 7b – Grade 11 – Student ID 12a – SSID Use blank from overage. Observers must mark sections H STAR Pre-Test Workshop || Slide 50

2012 STAR Pre-Test Workshop || Slide 51 Site Coordinator video, CAPA

Return for scoring Dist. 5 days after testing School 2 days after testing Pack with complete labels M 24−27, 36, 67, 70 After Testing M 24–27, 36, 67, 70 Receive delivery District 10–20 days before testing School 5–10 days before testing Order Materials Pre-ID Train Site Coordinators and Examiners Inventory Prepare materials Distribute and track materials Ensure correct Master File and SGID Pack with complete labels Early Paperwork Back of answer document Void, transcribe SGID Master File Pack: scorables vs. nonscorables Attach correct labels 2012 STAR Pre-Test Workshop || Slide 52 Test Extended Pre-ID

After Testing Answer Documents Train examiners to  Erase NOTHING in answer circles 2012 STAR Pre-Test Workshop || Slide 53

After Testing Answer Documents Avoid teaching students in second and third grade to mark through answer circles to eliminate answers. Such marks MAY NOT be erased by adults ? 2012 STAR Pre-Test Workshop || Slide 54

Mark Discrimination Analysis An automated process completed at the time of test booklet (grades two and three) and answer document scanning Identifies erasures to determine if the response has changed from:  Correct to wrong, or  Wrong to wrong, or  Wrong to correct, or From the analyses a report is produced and forward to the CDE who in turn requests districts to conduct an investigation based on the analyses  Wrong left wrong, or  Correct left correct, or  No response 2012 STAR Pre-Test Workshop || Slide 55

After Testing Answer Documents: Ethnicity/Race If not in Pre-ID,  Mark Yes or No for #8 Hispanic or Latino  If No, mark one or more for #9  If No and #9 blank, counted as two or more races 2012 STAR Pre-Test Workshop || Slide 56

After Testing Complete Back of Answer Document A1 DO NOT complete without CDE notification A2 Special Conditions A3 Accommodations and Modifications  Part a: mark “IEP” and/or “Section 504 plan” to indicate which program/plan student has, whether used accommodations or modifications or not. Note: IEP is required to take CMA.  Part b, mark codes for all accommodations student used as specified in IEP and/or 504 plan A4 English Learner Test Variations  For each test, what was actually used M STAR Pre-Test Workshop || Slide 57

Disability Code, 16a If not in Pre-ID, mark after testing Required  000 if no IEP  Code from IEP  For CMA and CAPA Note: 000 not valid for CMA or CAPA If 16a is not marked or marked 000 and IEP (A3a) is marked and CMA or CAPA taken, district data file defaults to 999— unknown disability—and must be corrected M 124 ? H STAR Pre-Test Workshop || Slide 58

Transcribe  Braille and large print (or not processed)  In Section A3 on the back of the answer document mark “G” or “H”  Damaged answer documents  Write VOID on any answer document(s), with marks, not to be scored; return with nonscorables H STAR Pre-Test Workshop || Slide 59 After Testing

School Grade Identification Sheet (SGID) Complete for each set of answer documents or test booklets Check counts to be accurate Place on answer documents for correct  Grade  School (school code machine-marked ) Pre-printed M 26, 93 Q 8 H STAR Pre-Test Workshop || Slide 60

After Testing Master File Sheets Return with each school and district Check counts to be accurate Required with scorables if materials were ordered:  Write “0” (zero), no blanks  If not tested, note that school did not test M 60, 67, 95 Q 9 H STAR Pre-Test Workshop || Slide 61

After Testing Which Answer Documents to Return Return answer documents for students with special conditions identified in box A2 Must return CST and/or CMA answer documents only if test taken  Students taking CMA in grades 8 or 11 must return CST answer document If no CST, CMA, CAPA, or STS test taken, securely destroy Pre-ID answer documents ? Q STAR Pre-Test Workshop || Slide 62

After Testing What to Return Must return the secure CST and STS DFAs for grade 2 with nonscorables Return used grades 2 and 3 test booklets with scorables Must return all CAPA Examiner’s Manuals with nonscorables Must return all grade 4−11 test booklets and unused grades 2, 3 test booklets with nonscorables 2012 STAR Pre-Test Workshop || Slide 63

After Testing Pack and Return Return all documents within an administration in same shipment Separate scorables (with SGID) from nonscorables: make sure grade on answer documents matches grade on SGID. M 42−45, 65− STAR Pre-Test Workshop || Slide 64

After Testing Pack and Return NPS documents  Under SGID with code  With district materials Return Home/Hospital/Independent Study with student’s school or district program code, NOT NPS M 42, STAR Pre-Test Workshop || Slide 65

Late Material Return Contact STAR TAC Indicate school and district with returns If late scorables: Depending on stage of processing at scoring center, there may be a fee to process Late returns are considered a breach of security 2012 STAR Pre-Test Workshop || Slide 66

Site Coordinator video, Multiple- choice video 2012 STAR Pre-Test Workshop || Slide 67

Summary What’s New? Responsibilities, including training Writing tests CSTs CMA STS Multiple-choice tests CAPA After testing 2012 STAR Pre-Test Workshop || Slide 68

Questions Quiz Answers 1. D 2. A 3. C 4. C 5. C 6. A 7. D 8. B 9. B 2012 STAR Pre-Test Workshop || Slide 69

For more information, go to: Or call the STAR Technical Assistance Center STAR Pre-Test Workshop || Slide 70