Before we begin, please make yourself comfortable and complete the STAR Pre-Test Quiz
Standardized Testing and Reporting (STAR) Program Pre-Test Workshop January 2013
Objectives STAR coordinators will: Follow current STAR procedures properly. Ensure all materials are handled securely and appropriately. Train site coordinators to conduct testing consistently. Handout (H) Page STAR Pre-Test Workshop || Slide 3
Agenda Introductions Objectives and agenda New for STAR 2013 STAR coordinator responsibilities Writing tests Multiple-choice tests California Standards Tests (CSTs) BREAK 2013 STAR Pre-Test Workshop || Slide 4 H 1
Agenda (after break) California Modified Assessment (CMA) Standards-based Tests in Spanish (STS) California Alternate Performance Assessment (CAPA) After testing Expedited return of results Summary Early Assessment Program (EAP) tests 2013 STAR Pre-Test Workshop || Slide 5 H 1
NEW FOR STAR STAR Pre-Test Workshop || Slide 6
New for STAR 2013 Emphasis on heightened security New security affidavit New and updated videos Answer docs: No CBEDS (section 14), collected in CALPADS No ASAM No SEID English-learner program participation (section 17) definitions changes CAPA Section A1 added STS for dual immersion Expedited return of results 2013 STAR Pre-Test Workshop || Slide 7 Coordinator Manual (M) Pages 2, 116 H 1
DISTRICT AND SITE COORDINATOR RESPONSIBILITIES 2013 STAR Pre-Test Workshop || Slide 8
District Coordinators’ Responsibilities #1 Responsibility—Security No unauthorized electronic devices used in classroom during testing For testing purposes, any electronic device that is not specifically designated as an accommodation or modification in the student’s IEP or Section 504 plan is unauthorized. Security audits to occur 2013 STAR Pre-Test Workshop || Slide 9 Q 1 H 2 M 10, 30
Security Audits At randomly selected schools and district offices Before, during, or after testing Are materials secure, accounted for, and locked up when not in use? Are correct administrative procedures being followed? For example: Instructional materials have been removed or covered. Students are not being coached through the exams. Only appropriate accommodations and/or modifications are being provided, et. al. No unauthorized electronic devices are being used STAR Pre-Test Workshop || Slide 10
District Coordinators’ Responsibilities #2 Responsibility—Train Coordinators: Emphasis on heightened security New and updated videos Additions to DFAs Room sign with reminder of no electronic devices To be posted in clear view of students Included in District Coordinator kit Available on startest.org Can be photocopied 2013 STAR Pre-Test Workshop || Slide 11 H 2 M 30
2013 STAR Pre-Test Workshop || Slide 12
Video Site Coordinator video, General, first part about security only 2013 STAR Pre-Test Workshop || Slide 13
STAR Site Coordinator Responsibilities Train examiners. Ensure examiners READ and sign affidavits. Coordinator retains. Prevent errors. Secure test materials. Verify materials are marked correctly to ensure correct student scores. Guarantee correct enrollment counts. Return materials promptly STAR Pre-Test Workshop || Slide 14 M 48 H 2
Site Coordinators: Train Examiners READ and sign affidavits. Emphasize NO unauthorized electronic devices. MAKE SURE CORRECT TESTS ARE GIVEN. Students who are not testing may not stay in the classroom where a test is being administered. If students need to be taken to another room to finish testing, BE SURE THEY ARE ESCORTED BY SCHOOL DISTRICT STAFF. Do not allow students to walk to another room with test materials by themselves STAR Pre-Test Workshop || Slide 15 H 2 M 50−52
Site Coordinators Train Examiners (cont.) Examiners CANNOT: Review test questions before, during, or after testing. Check students’ answers including (but not limited to): 1.Advise students of wrong answer or to check an answer; or 2.Withhold answer docs until students demonstrate they have the right answers. H STAR Pre-Test Workshop || Slide 16 M 50−52
Site Coordinators Train Examiners (cont.) Examiners shall monitor students throughout testing to make sure students are: On correct part Not going on to other parts or back to a previously completed part Not skipping a question on their answer document (so that they are off by one or more) Not using unauthorized electronic devices during testing session H STAR Pre-Test Workshop || Slide 17 M 50−52
Site Coordinators Train Examiners (cont.) Examiners shall ensure there is enough time to complete a part before beginning the part STAR Pre-Test Workshop || Slide 18 Training tips H 2
Other District STAR Coordinator Responsibilities Receive, count, store, distribute, track, collect, count and return materials. Coordinate testing schedule. Coordinate collection of demographic data. Pre-ID (preferred) Or hand-mark answer documents Complete the Demographic Fields Form (if needed ) M 9, 20, 28−31 H STAR Pre-Test Workshop || Slide 19
WRITING TESTS 2013 STAR Pre-Test Workshop || Slide 20
Writing Tests Writing tests are required. CST and CMA Grades 4 and 7 Examiners need to ensure correct test (CST or CMA) given. Check IEPs to determine whether CST or CMA. See bottom of response booklet and DFA. H 3 M 32–36, 53– STAR Pre-Test Workshop || Slide 21
Writing Tests When in 2013? March 5 (makeup March 6) May 7 (makeup May 8) Only if not in session March 5 H STAR Pre-Test Workshop || Slide 22 M 6
Before Writing Essay: Section 1 All students must complete, even if Pre-ID was used STAR Pre-Test Workshop || Slide 23
After Writing Test If the student used a word processor: Mark Section A3, “Accommodations and Modifications,” D or T. If A3 is not marked, the test will not be scored Print out pages and write name of student, school, and district on back of each page. Place print-out inside Writing Response Booklet. Return with scorables STAR Pre-Test Workshop || Slide 24 H 3 M 35–36, 57–58 Q 2
After Writing Test (cont.) If a student with an accommodation, wrote response on loose-leaf paper or in large print or in braille document: Essay must be transcribed into Writing Response booklet or it will not be scored. Mark A3, Accommodations. B if student wrote on separate paper G if student used braille H if student used large print 2013 STAR Pre-Test Workshop || Slide 25
After Writing Test (cont.) Return all materials with either the scorables (if student given test) or nonscorables (if student not given test). Return by: Sites: 1 day after testing Districts: 2 days after testing M 35–36, 57– STAR Pre-Test Workshop || Slide 26
MULTIPLE-CHOICE TESTS 2013 STAR Pre-Test Workshop || Slide 27
STAR Program Multiple-Choice Tests CSTs All students take CSTs unless taking CMA or CAPA Grades 2–11 CMA Grades 3–11; varies by grade and content area Must have IEP and meet eligibility criteria STS For Spanish-speaking English-learners and for English-speaking Spanish-learners (purchased separately) Grades 2–11 MUST also take CST and/or CMA 2013 STAR Pre-Test Workshop || Slide 28 M 3
Before Multiple-Choice Testing Receive boxes: All boxes may not come in single delivery. Before signing receipt, check number of boxes. Prep answer documents: 2013 only No copying Provide examiners with information about which demographics are to be completed. Ensure correct NPS code STAR Pre-Test Workshop || Slide 29 H 4
Before Multiple-Choice Testing (Cont’d) Confirm which tests each student takes. Confirm any accommodations or modifications students will use and where they will be tested. Prepare materials: Test booklets No. 2 pencils Scratch paper Rulers, if required (used with regular-print booklets only) Signs 2013 STAR Pre-Test Workshop || Slide 30
During Multiple-Choice Testing Monitor for use of unauthorized electronic devices. Give correct test booklets and answer documents to students whose names are on answer documents. Make sure students are taking the correct test and marking answers in the correct section of the answer document. Ensure students complete all parts of each test STAR Pre-Test Workshop || Slide 31 H 5
During Multiple-Choice Testing (cont.) Give breaks only at end of a part as indicated by stop sign. Mark answer documents: Correctly mark test name Note: if the test name is not marked, the test will not be scored. Tests that are hand scored in the fall do not go into API/AYP. Correctly mark version # 2013 STAR Pre-Test Workshop || Slide 32 H 5
At Start of Testing: Section 1 All students must complete, even if Pre-ID was used. At start of end-of-course testing, mark EOC test name: 2013 STAR Pre-Test Workshop || Slide 33
During Multiple-Choice Testing (cont.) Use Directions for Administration (DFAs) correctly. Read ALL “SAY” boxes exactly as written. Be sure to read and complete “First Day of Testing” section with students. ONLY translate boxes with “T” (NO CST/CMA/STS questions, prompts, or passages may be translated). Grades 9−11 are in single DFA for each test: CST, CMA, STS STAR Pre-Test Workshop || Slide 34 H 5
During Multiple-Choice Testing (cont.) Schedule breaks Ensure there is enough time to complete a part before beginning the part. See DFA for more information on breaks STAR Pre-Test Workshop || Slide 35
CALIFORNIA STANDARDS TESTS (CSTs) 2013 STAR Pre-Test Workshop || Slide 36
California Standards Tests (CSTs) Grades 2–11 Unless taking CMA or CAPA Subjects tested: English–Language Arts (ELA): all grades; writing for grades 4 and 7 Mathematics: grades 2–7 and end-of-course (EOC) grades 7–11 Note: Rulers used for grade 2 CST only Science: grades 5, 8, 10, and EOC 9–11 History–Social Science: grades 8, 11, and EOC 9– STAR Pre-Test Workshop || Slide 37 M 37–40, 59–62 H 6
Who Takes Which CST for Mathematics? Grades 2–6: Grade-level test required Note: Rulers used for grade 2 CST ONLY Grade 7: Grade-level mathematics test or Algebra I required 2013 STAR Pre-Test Workshop || Slide 38 H 6 M 14–17, 84
Grade 8: One of the following is required: CST for General Mathematics (if no math course or completing a course for which there is not an EOC mathematics CST); or Algebra I; or Geometry; or Algebra II; or Integrated Math 1, 2, or STAR Pre-Test Workshop || Slide 39 H 6 M 14–17, 84 Q 5 Who Takes Which CST for Mathematics?
Q 3, 4 Grade 9: One of the following is required: CST for General Mathematics (if no math course or completing a course for which there is not an EOC mathematics CST); or EOC mathematics CST; or CST for Summative High School Mathematics Grades 10–11: One of the following is required: EOC mathematics CST; or CST for Summative High School Mathematics No assessment required if not taking a mathematics course UNLESS eligible to take Summative High School Mathematics 2013 STAR Pre-Test Workshop || Slide 40 H 6 M 14–17, 84 Who Takes Which CST for Mathematics?
Summative High School Mathematics Students in grades 9–11 will take the CST for Summative High School Mathematics based on: Completion of Algebra I, Geometry, AND Algebra II courses in previous years; or Completion of course aligned with Integrated Math 3 blueprint in a previous year; or Previously took the CST for Summative High School Mathematics STAR Pre-Test Workshop || Slide 41 M 14−17 H 6 Q 3
Mark Correct Mathematics Test Taken or student will not receive a SCORE. Also include correct version number STAR Pre-Test Workshop || Slide 42
Video Site Coordinator video, CST HS video through math only 2013 STAR Pre-Test Workshop || Slide 43
CST for Science Required grade-level science Grades 5, 8, 10: all students shall take the grade-level test. Found in grade-level test booklets: no need to order separately. Students in grade 10 shall also take an end-of- course science test: If enrolled in standards-based science course EOC test booklets must be ordered separately 2013 STAR Pre-Test Workshop || Slide 44 H 6 M 15, 18
CST for Science Grades 9–11 EOC Completed an applicable science course in the 2012 summer session or will complete it during 2012–13 school year: Review state blueprints. Review curriculum. Determine which, if any, EOC science CST students in each course will take. Mark correct EOC test and version number on the answer document STAR Pre-Test Workshop || Slide 45 H 6 M 15, 18, 85
CST for History-Social Science Grades 8, 11 required EOC World History, grades 9−11 Students in grade 11 who are completing a world history course will take BOTH the U.S. History test AND the EOC CST for World History STAR Pre-Test Workshop || Slide 46 M 19, 85
BREAK 2013 STAR Pre-Test Workshop || Slide 47
CALIFORNIA MODIFIED ASSESSMENT (CMA) 2013 STAR Pre-Test Workshop || Slide 48
CMA Participation Criteria Have an IEP Meet the SBE-adopted eligibility criteria Previously took CST and scored below basic or far below basic Previously took CAPA and scored proficient or advanced in previous 2 years See full participation criteria: STAR District and Test Site Coordinator Manual STAR Pre-Test Workshop || Slide 49 H 7 M 13, 15, 17–18, 74–75, 85
CMA Participation Criteria (cont.) ANNUALLY, IEP specifies: Whether the student takes the CMA or the CST with appropriate accommodations and/or modifications, regardless of previous CMA performance levels CMA subject(s) Variations and/or accommodations Examiners should check the student’s IEP to see whether and which CMA test the student should take STAR Pre-Test Workshop || Slide 50 H 7 M 13, 15, 17–18, 74–75, 85
CMA Participation No additional modifications are allowed. If modifications needed, student should take CST with modifications. Enrolled in grades 3–11. May take the CMA for some subjects, CST for other subjects. Must take grade-level CSTs when a CMA is not offered STAR Pre-Test Workshop || Slide 51 H 7 M 13, 15, 17–18, 74–75, 85
CMA Tests for 2013 CMA for ELA in grades 3–11 CMA for Writing in grades 4 and 7 CMA for Mathematics in grades 3–7 CMA for Algebra I (EOC for grades 7–11) CMA for Geometry (EOC for grades 8–11) Note: If CMA students in grades 8 or 9 are NOT taking Algebra I or Geometry, the IEP should designate the appropriate CST math test accordingly. There is no CMA for General Mathematics. CMA for Science in grades 5 and 8 CMA for Life Science in grade 10 *Required History–Social Science for grades 8 and 11 MUST be taken with CST STAR Pre-Test Workshop || Slide 52 H 8 Q 4 M 13, 15, 17–18, 74–75, 85
2013 CMA Materials for Grades 3−7 CMA booklets for grade 3: Separate scorable test booklet If no CST taken, return CST test booklet with nonscorables. CMA for grades 4–7: CST and CMA in same answer document Grade 5 ONLY allows calculator (if written into the IEP). If both CST and CMA taken, must mark Section 7c for CMA tests taken STAR Pre-Test Workshop || Slide 53 M 37–39
2013 CMA Materials for Grades 8−11 CMA for grades 8 and 11 Must order both CST and CMA grade-level test booklets for each student taking one or more CMA exams. All students MUST take the CST History–Social Science in grade 8 and U.S. History in grade 11. CMA for grades 9 and 10 Order the grade-level CMA test booklets for only the CMA tests to be administered. Order CST only if needed. Students in grades 9 and 10 may take only CMA (ELA, Algebra I, Geometry, grade 10 Life Science). H STAR Pre-Test Workshop || Slide 54
2013 CMA Materials for Grades 8−11 (cont.) Answer docs separate from CSTs If Pre-ID’d: For grades 8–11, if at least one CMA test is pre-identified for a student, the student will receive both the CMA and the CST pre-identified answer documents. Return only used answer documents for scoring. If NOT Pre-ID’d: Answer documents sent based on test booklets ordered. M 20–21, 37– STAR Pre-Test Workshop || Slide 55
CST/CMA Answer Document Right side of inside of answer doc grades 4−7 CMA section has: Different subject icons from CST Alternate row shading for the response bubbles Three options choices Fewer number of questions H 9 M STAR Pre-Test Workshop || Slide 56
CMA Grade 7 Answer Document Mathematics Section Grade 7 mathematics and Algebra I have different numbers of questions 2013 STAR Pre-Test Workshop || Slide 57
Video CMA 7-11 Video 2013 STAR Pre-Test Workshop || Slide 58
STANDARDS-BASED TESTS IN SPANISH (STS) 2013 STAR Pre-Test Workshop || Slide 59
Who Takes the STS? Required for Spanish-speaking English learners (ELs), grades 2–11, who either: Receive instruction in Spanish regardless of the length of time they have been enrolled in schools in the U.S. or one of its territories; or Have been enrolled in a school in the U.S. or one of its territories less than 12 cumulative months. H 10 M 14– STAR Pre-Test Workshop || Slide 60
Who Takes the STS? As an option, districts may also test Spanish-speaking ELs in grades 2– 11 who are not receiving instruction in Spanish STAR Pre-Test Workshop || Slide 61 H 10 M 14–15
Other STS Stipulations Students taking the STS must also take CSTs or the CMA. Students who take CAPA do NOT take STS STAR Pre-Test Workshop || Slide 62
2013 STS Materials STS for Reading/Language Arts (RLA) in grades 2–11 STS for Mathematics in grades 2–7 Rulers for grades 2 and 5 STS for Algebra I (EOC for grades 7–11) STS for Geometry (EOC for grades 8–11) Students in grades 8 and 9 who are not taking Algebra I or Geometry courses take NO STS mathematics, but do take the appropriate CST end-of-course mathematics test STAR Pre-Test Workshop || Slide 63 H 10 M Q 5
Video Site Coordinator video, STS Elementary 2013 STAR Pre-Test Workshop || Slide 64
CALIFORNIA ALTERNATE PERFORMANCE ASSESSMENT (CAPA) 2013 STAR Pre-Test Workshop || Slide 65
CAPA Performance-based, one-on-one test For students with significant cognitive disabilities unable to take the CSTs even with accommodations and/or modifications or the CMA with accommodations Student must have an IEP IEP specifies CAPA and level Do not take STS 2013 STAR Pre-Test Workshop || Slide 66 M 13, 15 H 11
CAPA Answer Document Use only 2013 answer document. Ensure correct CAPA Level is marked in 7a. Level I only can have 5 as a score STAR Pre-Test Workshop || Slide 67 M 13, 15 H 11
CAPA Observers Districts must double-rate at a minimum of ten percent (10%) of the CAPA students per level, per site (including NPS). Double ratings are randomly selected. Observers must mark Observer and BOTH examiners and observers must sign their separate answer documents STAR Pre-Test Workshop || Slide 68 M 49–50, 140 Q 6 H 11
Preparing To Administer the CAPA Observer’s Answer Doc 1 – Name, etc. 3 – Date of Birth 5 – Name 6 – Gender 7a – CAPA Level 7b – Grade 11 – Student ID 12a – SSID Use blank from overage. Observers must mark sections H STAR Pre-Test Workshop || Slide 69
Video Site Coordinator video, CAPA 2013 STAR Pre-Test Workshop || Slide 70
AFTER TESTING 2013 STAR Pre-Test Workshop || Slide 71
After Testing Paperwork Complete back of answer document. Transcribe voided answer documents. Complete SGID. Complete Master File. Pack: scorables vs. nonscorables Attach correct shipping labels STAR Pre-Test Workshop || Slide 72
After Testing Answer Documents Train examiners to: Erase NOTHING in answer circles STAR Pre-Test Workshop || Slide 73
After Testing Answer Documents (cont.) Avoid teaching students in second and third grade to mark through answer circles to eliminate answers. Such marks MAY NOT be erased by adults STAR Pre-Test Workshop || Slide 74
After Testing Complete Back of Answer Document A1 DO NOT complete without CDE notification A2 Special Conditions A3 Accommodations and Modifications Part a: mark “IEP” and/or “Section 504 plan” to indicate which program/plan student has, WHETHER USED ACCOMMODATIONS OR MODIFICATIONS OR NOT. Note: IEP is required to take CMA, CAPA. Part b, mark codes for all accommodations student used as specified in IEP and/or 504 plan. A4 English Learner Test Variations For each test, what was actually used 2013 STAR Pre-Test Workshop || Slide 75 M 41, 134, Inside back cover
16a—Disability Code If not in Pre-ID, mark after testing. For CST and STS: Mark “000” if no IEP; or Disability Code from IEP. For CMA and CAPA: Disability code is REQUIRED. “000” not valid for CMA or CAPA. Also, be sure to mark the “IEP” or “504 Plan” circle in section A3a even if the student does not use any accommodations or modifications STAR Pre-Test Workshop || Slide 76 M 120–21 H 12 Q 7
CAUTION If no disability is marked, but CMA answer circles have marks, Or CAPA answer doc is completed: Disability defaults to “unknown.” Must be corrected during Demographic Data Corrections or not counted as participating in API/AYP STAR Pre-Test Workshop || Slide 77 Q 7 H 12
Transcribe Braille and large print (or not processed) In Section A3 on the back of the answer document mark “G” or “H.” Damaged answer documents Write VOID on front of answer document(s) and return with nonscorables. H 13 After Testing 2013 STAR Pre-Test Workshop || Slide 78
School and Grade Identification Sheet (SGID) Complete for each set of answer documents or test booklets. Check counts to be accurate; include docs of students not tested with reason why in A2. Place on answer documents for correct: Grade School Processing stops if not correct STAR Pre-Test Workshop || Slide 79 M 25, 92 Q 8, 10 H 14 Pre-printed
SGID (cont.) Make sure the REQUIRED fields are completed to ensure accurate processing. Test Grade Mark only one For CST/CMA, STS only Number of documents Test start date=first day of testing within window Used by CDE accountability office School code NOT pre-slugged For home/hospital or independent study, enter 7-digit district code 2013 STAR Pre-Test Workshop || Slide 80 H 14
After Testing Master File Sheets Return for each school and district. Check counts of answer docs and SGIDs to be accurate. Required with scorables if materials were ordered: Write “0” (zero), no blanks, for each item ordered. If not tested, note that school did not test STAR Pre-Test Workshop || Slide 81 M 67, 94 Q 9, 10 H 15
Home/Hospital/Independent Study On answer document, A3, mark as accommodation “M” if home/hospital. On SGID enter correct home hospital/independent study school code = same as 7-digit county district code. If test booklets/answer documents ordered, but those with that school code did not test, must return Master File Sheet with zeros next to each unused, ordered item STAR Pre-Test Workshop || Slide 82 H 15
Nonpublic School Answer Documents Put on answer doc each NPS unique school code. Put under SGID with school code. Return with district materials STAR Pre-Test Workshop || Slide 83 M 26, 41–42
After Testing Which Answer Documents to Return Return answer documents for students with special conditions identified in Section A2. Must return CST and/or CMA answer documents only if test taken. Students taking CMA in grades 8 or 11 must return CST answer document. If no CST, CMA, CAPA, or STS test taken, securely destroy Pre-ID answer documents STAR Pre-Test Workshop || Slide 84
After Testing: What to Return 2013 STAR Pre-Test Workshop || Slide 85 All students enrolled on the first day of testing must return an answer document. Must return the secure CST and STS DFAs for grade 2 with nonscorables. Return used grades 2 and 3 test booklets with scorables. Must return all CAPA Examiner’s Manuals with nonscorables. Must return all grade 4−11 complete test booklets and unused grades 2, 3 test booklets with nonscorables. If only cover or part returned, considered security breach.
After Testing: Pack and Return Return all documents within an administration in same shipment. Separate scorables (with SGID) from nonscorables: make sure grade on answer documents matches grade on SGID STAR Pre-Test Workshop || Slide 86 M 35, 41, 46
Late Material Return Contact STAR TAC. Indicate school and district with returns. If late scorables: Depending on stage of processing at scoring center, there may be a fee to process. Late returns are considered a security breach STAR Pre-Test Workshop || Slide 87
EXPEDITED RETURN OF RESULTS 2013 STAR Pre-Test Workshop || Slide 88
Expedited Return of CST & CMA Results Results available within 2–3 weeks of receipt of materials at scoring center QC process for early tests before results release. Scorable materials must be complete and include all information, including accurate SGID. Downloadable file from STAR Management System: Receive an notification of a link to a data file. File will include only a subset of fields. Use with caution: final results subject to change STAR Pre-Test Workshop || Slide 89 Q 10
SUMMARY & QUIZ 2013 STAR Pre-Test Workshop || Slide 90
Summary What’s New? Responsibilities, including security & training Writing tests Multiple-choice tests CSTs CMA STS CAPA After testing Expedited return of results 2013 STAR Pre-Test Workshop || Slide 91
Quiz Answers 1.D 2.A 3.C 4.C 5.A 6.D 7.C 8.B 9.B 10.B 2013 STAR Pre-Test Workshop || Slide 92
For more information, go to: Or call the STAR Technical Assistance Center at STAR Pre-Test Workshop || Slide 93
EARLY ASSESSMENT PROGRAM (EAP) Next… 2013 STAR Pre-Test Workshop || Slide 94
Copyright © 2012 Educational Testing Service. All rights reserved EAP Updates 9/13/2015 Security is Important – Only staff administering the tests should have access to them. – Students must return all essay topic booklets and they must be returned. – No electronic devices during testing EAP Information – – 95
Copyright © 2012 Educational Testing Service. All rights reserved. 9/13/