English Language Arts – Mathematics – Science – Social Studies Colorado Measures of Academic Success (CMAS) Spring 2016 Administration Training for SACs – Part 2

Overview Review Processes Before Testing Registering Students, Ordering Paper Materials, and Setting Up Test Sessions Technology Readiness for Administrators Accessibility Features and Accommodations Testing Environment Receiving Materials

Registering Students, Ordering Materials, and Setting up PearsonAccess next Test Sessions 3

Student Registration CDE will pull data from student interchange after December 18 and will upload into PearsonAccess next. – Verify that the information in Data Pipeline is accurate and update prior to this date. New students must be added into PearsonAccess next prior to testing, including for PBT. – If a SASID is unavailable from the State at the time of registration, a temporary SASID should be created and must be resolved by the end of testing. District code, School code, two digit number ranging from 01 to 99 DDDDSSSS## (must be unique for each student) For more detailed information about the Student Registration process view the training module found here 4

Registering for PBT 5 Orders for PBT materials will be generated using information indicated for individual students in the SR/PNP by January 22. For schools, grades, or students using paper- based accommodated forms, change the SR/PNP (through file import or User Interface) testing mode to PBT. All major changes (school, grade) must be made in PearsonAccess next by January 22. – Additional orders for schools or grades will not be approved.

Registering a Student in PearsonAccess next 6 Select the Setup menu and choose Students Choose the Tasks and click Start

Registering a Student in PearsonAccess next 7 Information on this screen will transfer across all admins (PARCC, S/SS, and CoAlt

Registering a Student in PearsonAccess next 8

9

10

Registering a Student in PearsonAccess next 11 Note: Available accommodations may appear differently in Science and Social Studies administrations

Registering a Student in PearsonAccess next 12

Registering a Student in PearsonAccess next 13

Registering a Student in PearsonAccess next 14

Registering a Student in PearsonAccess next 15

Online Test Management 16

Online Test Management 17

Online Test Management 18

Online Test Management 19

Online Test Management 20

Online Test Management 21

Online Test Management 22

Online Test Management 23

Online Test Management 24

Student Transfer Process District A School 2 attempts to register student District A School 2 attempts to register student District B School 1 receives message in PAnext saying another district is attempting to register a student in District B District B School 1 receives message in PAnext saying another district is attempting to register a student in District B District B confirms that student has transferred District B confirms that student has transferred District A can register student in School 2 District A can register student in School 2 25

Technology Readiness for Administrators 26

Technology Improvements Revamped site readiness form The science and social studies site readiness form should be used in advance to identify any issues so they can be addressed before testing TestNav Desktop app to reduce Java dependency Updated the Rich Text Editor for constructed response items Science simulations adjusted to work better in TestNav 27

Technology Issues What we have done to ensure that some of the issues that happened last year are not repeated Pearson recently worked in districts in Colorado to – Test out last year’s forms in a variety of environments – Recreate issues – Test the new TestNav app 28

29 Technology Readiness for Administrators Collaborate with Technology Coordinator on Technology Readiness steps from the Test Coordinator Manuals – Technology Guides, Requirements, and Setup Files: – Technology Bulletins: –

30 Technology Readiness for Administrators Current TestNav Requirements – Operating System Support Diagram New Operating Systems Supported – Windows 10 – iOS 9 New Operating Systems Support Pending – Android M – Mac OS X New Proctor Caching Software available handout

31 Technology Readiness for Administrators TestNav Desktop App – Runs on Windows, Mac OS X, and Linux Operating Systems – No Java dependencies – No Pop-Up Blocker settings required – Identical student login experience on Chromebooks and iPads – The TestNav Desktop App is not compatible with touchscreen devices – User Permissions/Rights are required on the testing devices

32 Technology Readiness for Administrators The Google Chrome browser is no longer supported – Support was discontinued because Google chose to no longer support the Java Plug-In required to run TestNav8 – An error message will appear when attempting to open a test using the Chrome browser (no versions of Chrome are supported) – Administrators cannot use the Chrome browser to precache test content in PearsonAccess next

Administrative Considerations, Accessibility Features and Accommodations 33

34 Administrative Considerations, Accessibility Features and Accommodations Administrative Considerations and Accessibility Features for All Students Accessibility Features Identified in Advance Accommodations: – Students with Disabilities (SWD) – English Learners (EL) – English Learners with Disabilities

Types of Accessibility Features and Accommodations 35 Features for All Students Accessibility Features Identified in advance Accommodations IEP/504/EL

Administrative Considerations Adaptive and specialized equipment or furniture Frequent breaks (do not stop the clock) Noise buffers/headphones Small group testing Specified, separate, or alternate area or seating Time of day 36

Accessibility Features for All Students 37 Accessibility Features for All Students Computer-Based TestingPaper-Based Testing Audio AmplificationAuditory Aids Blank Paper Eliminate Answer ChoicesVisual Aids/Organizers Spell CheckExternal Spell Check Device Bookmark Items for ReviewVisual Aids/Organizers General Administration Directions Read Aloud, Repeated and Clarified as Needed Headphones or Noise Buffers Highlight ToolHighlighter Line Reader Masking Tool/RulerLine Reader (Straight Edge)

Accessibility Features for All Students 38 Accessibility Features for All Students Computer-Based TestingPaper-Based Testing Magnification/Enlargement DeviceMagnifying Glass or Enlargement Device NotePadScratch Paper Pop-Up GlossaryGlossary in Footnotes Redirect Student to Test Calculator (Math and Science) Calculator sections Calculator (Math and Science) Calculator sections

Accessibility Features that must be identified prior to testing Answer Masking Color Contrast* -- is now an accessibility feature for S/SS Human Reader or Human Signer for the Mathematics Assessments ASL Video for the Mathematics Assessments (CBT only) Text-to-Speech for Mathematics, Science and Social Studies Accessibility Features Identified in Advance 39 Note: These accessibility features must be identified in advance and enabled in PearsonAccess next through the User Interface or SR/PNP file for the computer- based administration, and prepared in advance for paper-based testing.

Accessibility Features Identified in Advance 40 Accessibility Features (for all Grades/Courses) Administration Guidelines Human Reader or Human Signer for the Mathematics Assessments Human Readers providing this accessibility feature must refer to Appendix B: Test Administration Protocol for the Human Reader Accommodation for English Language Arts/Literacy Assessments, and the Human Reader Accessibility Feature for Mathematics Assessments. For computer-based testing, the student must be tested in a separate or small group setting. The Human Reader for math must use the provided Computer-based Oral Script to read or sign the assessment. For paper-based testing, Test Administrator will receive two test booklets (one for TA & one for student). The Human Reader must use the provided Paper-based Oral Script to read or sign the assessment. This year an oral script is provided for math.

Accessibility Features Identified in Advance For Math, Science, and Social Studies, students may use Text-to-Speech if they use similar access strategies during every day instruction. – Teacher Read Directions are not available. – NOTE: ELA measures reading as well as literacy. Therefore, Text-to-Speech for ELA is a unique accommodation and is limited to a very small number of students who have been approved through the unique accommodation request process. 41 Text-to-Speech for Math, Science, and Social Studies

42 Accommodations for Students Accommodations for Students with Disabilities (SWD) – Presentation Accommodations – Response Accommodations – Timing and Scheduling Accommodations

Students With Disabilities – Presentation Accommodations 43 Presentation Accommodations for Students with Disabilities Assistive Technology Screen Reader Version for Mathematics* Refreshable Braille Display with Screen Reader Version for ELA/L* Braille Edition* Large Print Edition* Paper-Based Edition Closed-Captioning of Multimedia for ELA/Literacy Assessments *Transcription Guidelines in the S/SS Accommodations Supplement must be followed for ELA/math and S/SS.

Students With Disabilities – Presentation Accommodations 44 Presentation Accommodations for Students with Disabilities (cont.) Text-to-Speech for the ELA/Literacy Assessments, including items, response options, and passages * Screen Reader Version for ELA/Literacy, including items, response options, and passages * ASL Video for the ELA/Literacy Assessments, including items, response options, and passages * Human Reader/Human Signer for the ELA/Literacy Assessments, including items, response options, and passages * ASL Video for the Mathematics Assessments Human Signer for Test Directions Student Reads Assessment Aloud to Themselves *In CO, Unique Accommodation form required by December 15

Students With Disabilities – Response Accommodations 45 Response Accommodations for Students with Disabilities Assistive Technology Braille Note-taker or Writer Calculation Device and Mathematics Tools (on Calculator Sections of Mathematics Assessments) Calculation Device and Mathematics Tools (on Non-Calculator Sections of Mathematics Assessments*) Monitor Test Response *In CO, Unique Accommodation form required by December 15

Response Accommodations for Students with Disabilities (cont.) ELA/Literacy Selected Response Speech-to-Text ELA/Literacy Selected Response Human Scribe ELA/Literacy Selected Response Human Signer ELA/Literacy Selected Response External Assistive Technology Device ELA/Literacy Constructed Response Speech-to-Text * ELA/Literacy Constructed Response Human Scribe * ELA/Literacy Constructed Response Human Signer * ELA/Literacy Constructed Response Assistive Technology Device Students With Disabilities – Response Accommodations 46 *In CO, Unique Accommodation form required by December 15

Response Accommodations for Students with Disabilities (cont.) Response Speech-to-Text Response Human Scribe Response Human Signer Response Assistive Technology Device Word Prediction External Device Monitor Test Response Students With Disabilities – Response Accommodations 47

Students With Disabilities – Timing and Scheduling Accommodations 48 Timing and Scheduling Accommodations for Students with Disabilities Extended Time Extended Time (ET) All Content Areas New test design does not have 1.5 time built into it. Must be in a separate room If students need frequent breaks and have ET, they can have until the end of the school day to complete a single unit. Strongly suggest that districts provide additional guidance. Students should not work on an assessment unit all day. Time-and-a-half is included in the Science and Social Studies section testing time. Students who need extended time accommodations beyond time-and-a-half should take the assessment in a separate setting.

Accommodations for English Learners 49 Accommodations for English Learners Extended Time Word-to-Word Dictionary (English/Native Language) Mathematics Response Speech-to-Text Mathematics Response Human Scribe General Administration Directions Read Aloud, Repeated and Clarified in Student’s Native Language (by Test Administrator) Spanish Text-to-Speech for Mathematics, Science and Social Studies Online Translation of Mathematics in Spanish (or other translated languages) Online Translation of Science and Social Studies in languages other than English or Spanish

Accommodations for English Learners 50 Accommodations for English Learners (Cont.) Paper-Based Edition of the Mathematics, Science and Social Studies Assessments in Spanish Large Print Edition of the Mathematics Assessments in Spanish CSLA Paper-Based and Large Print Spanish Oral Script (Paper)

Spanish Language Arts Accommodated Form The CSLA is a paper/pencil Language Arts accommodated form available for eligible 3 rd and 4 th grade students. This Spanish form is administered in place of PARCC ELA. Large print available These students will still take PARCC Math. Enter “CSLA” in State Field 12 on current student ELA record. 51

Transcription Guidelines 52 Transcription Paper-based and Computer-based: At least two persons must be present during any transcription of student responses. The student’s responses must be transcribed verbatim into the Test Booklet/Answer Document or TestNav. – Note for braille transcription: Only a braille certified Test Administrator may transcribe student’s responses. CBT: Submit the unit once all items have been transcribed. After transcription, shred any responses made from an assistive technology device.

Transcription Guidelines 53 Transcription on Computer-based Tests: – Student responses to constructed response should be entered into TestNav by the Test Administrator before the next Unit. – Student will respond to questions on their assistive device. – Student will exit the unit/section, the student should not Submit the current unit/section. – Resume the student’s test in PearsonAccess next. – Log-in as the student and transcribe the responses. – Submit responses for the current unit/section. – Student continues testing in the next unit/section.

AF&A and SR/PNP - Training rainings rainings guidancereadingaccom guidancereadingaccom guidancescribeaccom-0 guidancescribeaccom-0 guidancecalculatoraccom guidancecalculatoraccom

CMAS Student Registration There are several fields in the SR/PNP that are used to validate selected accommodations. – If an error is received upon import, check these fields. These can only be seen by PAnext users with the Sensitive Data role. 55

Emergency Accommodation A case where a student needs a new accommodation immediately due to unforeseen circumstances. Cases could include students who have a recently-fractured limb (e.g., arm, wrist, or shoulder); whose only pair of eyeglasses have broken; or a student returning from a serious or prolonged illness or injury. Emergency accommodation form must be completed and maintained in the district. Contact CDE if a student requires a paper-based administration. Refer to Appendix G of the PARCC Accessibility Features and Accommodations Manual online: Use of an Emergency Accommodation on a PARCC Assessment. Also use this form for Science and Social Studies. This will be identified in the Student’s Information through the User Interface. 56

PARCC: Student Accommodation Refusal Form If a student refuses an accommodation, the school should document in writing that the student refused the accommodation. Refer to Appendix H of the PARCC Accessibility Features and Accommodations Manual, online: Student Accommodation Refusal Form. The accommodation must be offered and remain available to the student during testing. School Test Coordinators should send a copy of the form to parents when a student refuses an accommodation documented in an IEP, 504 Plan, or EL Plan. Form must be maintained in the students record. 57

The Test Environment 58

Student-to-Test Administrator Ratio Student-to-Test Administrator ratio must not exceed 30 to 1 – Test Administrator must be able to actively monitor the space within the physical testing environment. Consider room configuration – Make special considerations for large testing environments or environments with complicated configurations. Test Administrators must: – Actively proctor. – Remain attentive and in the room during the entire testing section. – Circulate throughout the room during the test. Should be able to see students working, not student work 59

The Test Environment The testing environment must: Be adequately lit, quiet, free of distractions, and heated or cooled. Provide an adequate writing surface (paper-based). Be free of electronic devices and music. “Do Not Disturb/Only Authorized Personnel Allowed” sign must be placed on the door during test sessions. 60

The Test Environment No food or drinks are allowed on desks or near test materials. The testing environment must be free of any content related posters or aids that suggest possible answers to students: – Word walls – Steps for solving math equations – Any content related materials – Any resource that defines, explains, or illustrates terminology or concepts 61

The Test Environment Generally, posters that do not include content specific definitions, content related processes or solutions may remain on the wall. Timing Box (optional box around; other information required) Unit Name: Math Unit 1 Unit Testing Time: 90 Min Starting Time: 9:00 Stopping time: 10:30 62

Room Configuration Students should not be able to see each other’s work from a normal testing position. Consider the following seating configurations to maintain test security: – Seat students in every other seat (useful in a computer lab setup) – Arrange monitors back-to-back – Seat students back-to-back – Seat students in a semicircle (useful for schools using devices) – Seat students in widely spaced rows or in every other row (appropriate for a classroom setup) Dividing screens or other privacy materials may be used if students cannot be placed far enough away from each other. 63

Headphones PARCC ELA all students must have headphones for all Units. – Not every unit has sound, but 1 unit for each student will – Need to be prepared and adjust sound prior to each unit Text-to-Speech To be in a testing room with other students, headphones must be worn. Students may be tested separately if they are not able to wear headphones. Math, S/SS do not contain audio, unless TTS is used. 64

Unauthorized Visitors and the Media Only students, Test Administrators/Examiners, and authorized school, district, state personnel, or state- sanctioned test monitors may be in testing areas during administration. Media are not allowed to have access to the tests before, during, or after test administration, or take pictures or video of testing materials or testing students. Parents are not allowed in the testing room with their child. 65

Afternoon Testing If the school is having technology issues, do not start a unit/section unless there is enough time left in the day to complete the unit/section. It is a misadministration to start the test and then stop and complete it the next day. – This is only allowed for illness. 66

After Hours Testing If a school will test later than 4:30 PM provide CDE with a list of school and test sessions. These test sessions will need to be granted permission by CDE to test after hours. 67

Receiving Materials and Test Security 68

Test Security Protocols Protection of student information and data Protecting the validity of the state assessments Financial considerations 69

Security Plan Successful Security Plan requirements: – All personnel have appropriate training. – All involved personnel understand security protocols. – All involved personnel have signed security agreements. Think about anyone who may be in the testing environment! – Test environments are secured against unauthorized personnel. – Establish a documented chain of custody. – Materials are kept in a central, secure location with limited access. 70

Test Materials Security Student Testing Tickets Paper-based Test Booklets Social Studies source books Periodic Table (PBT HS Science) Human Reader/Oral scripts Used scratch paper Any student work/responses Mathematics Reference Sheets prior to and after given to students 71 SecureNon-Secure Test Administrator Manual (TAM) Test Coordinator Manual (TCM) Unused scratch paper Procedures Manual Test Examiner Manual (TEM)

Maintaining Security of the Assessments All secure test materials must be secured while in the Test Administrator’s possession. No duplication of secure CMAS materials is permissible. No cell phones or other communication, reproduction or recording devices are allowed during test sessions unless required for accessibility. – Students should be aware that cell phones or other electronic devices are prohibited. Students who are found with these electronic devices in their possession during testing (including if they have finished testing but other students have not) or during a break may lead to the invalidation of not only their test, but to the invalidation of others’ tests as well. – Manage devices! All individuals are strictly prohibited from taking photos of TestNav screens. Please ensure that individuals in your district are aware of this critical instruction. 72

Chain of Custody Document before, during, and after testing. – Any movement of secure materials must be documented. Deliver materials to schools no more than two weeks in advance. Complete the chain-of-custody form/school security checklist. Deliver paper based forms and materials (oral scripts) to Test Administrators only on the day of testing. Distribute only the content area and grade level being assessed. Return materials to a designated secure location. – Not stored in classrooms Return materials to Pearson after testing is completed. 73

Initial Materials Order 74 How Is It Generated and What Is Included in an Initial Order: 1.CDE will provide the initial upload of students. 2.Import your Student Registration updates. 3.You will receive paper-based test materials for any students with the paper test mode indicated in the SR/PNP prior to January 22, 2016.

Receiving Test Materials 75 Initial materials will be received 2 weeks prior to your district start date. Materials are packaged by school and shipped to the district. PARCC quantities, which include 5% overage per school, are derived from the information provided in the SR/PNP fields. For S/SS and CoAlt S/SS there is no overage.

Contents of Initial Shipment 76 Test Coordinator Kit – Resealable plastic bag (holds all materials) – Paper Bands – Pearson Scorable and Nonscorable Labels (different colors) – UPS Ground return labels for Scorable and Nonscorable materials – Pre-gridded Scorable Materials Return School Header sheet – Pre-printed Student ID Labels and Roster – Return Instructions Sheet – Shipping Carrier Return Instructions Packing List and Chain of Custody Form Test Coordinator Manuals Test Administrator Manuals Test Booklets/Kits/Answer Documents Math Reference Sheets, Rulers, and Protractors, if applicable Large Print kits, braille kits Human Reader/Oral Script kits

Chain of Custody Forms PARCC 77 Districts may use these forms or create their own to track all secure materials. District Chain of Custody Form for Initial Shipment of Materials Form indicates : ‒A full list of materials within the district ‒Form and security numbers School Chain of Custody Form indicates: ‒Security numbers for each secure test material ‒Student and Test Administrator assignment ‒Date and time for checked-out and checked-in of materials District Chain of Custody Form for District Overage of Materials Computer-based Chain of Custody Form ‒Materials Moved from Locked Central Storage Area to Classroom ‒Materials Moved from Classroom to Locked Central Storage Area ‒Materials Securely Destroyed by Shredding

Documenting and Storing Test Materials 78 Upon Receipt of Test Materials, Test Coordinators should:  Remove the Packing List, Chain of Custody Form, and Test Coordinator Kit from Box 1.  Use the Chain of Custody Form to document all test manuals and test materials received.  Inventory materials immediately to verify that there is an adequate number for administration. NOTE: Count the shrink wrap packages only. Do not open shrink-wrapped packages until four school days before testing, and do not distribute materials before the first day of testing.  Order additional material, if necessary.  Keep all test materials in a centrally locked storage area, with limited access, until distributing them to the Test Administrators.  Remind Test Administrators that all test materials must be distributed only on test administration day and must be returned to secure storage immediately after testing.

Documenting and Storing Test Materials 79  Keep all boxes in which the test materials were delivered and use them to return Scorable and Nonscorable materials after testing is completed.  Report the following occurrences immediately to Pearson using the Form to Report Contaminated, Damaged, or Missing Materials (see the Test Coordinator Manual): ‒Non-receipt of any packages listed on the School Packing List. ‒Discovery of a damaged test material. ‒Discovery of missing or duplicate sequence numbers on any Test Booklets.  Science and Social Studies should report similar occurrences immediately to Pearson Customer Service.

Additional Order Windows 2016 Spring Additional Order Windows: Please order at least 5 days prior to the test administration. It is the District Assessment Coordinator’s responsibility to understand the additional order window. 80 ComponentAdditional Materials Window PARCC ELA and Math (Secure) February 29* to April 28, 2016 PARCC ELA and Math (Non-Secure) February 29 to May 4, 2016 Science and Social Studies (Secure) March 29 to April 28, 2016 Science and Social Studies (Non-Secure) March 29 to May 4, 2016 *Two weeks prior to district testing window start date.

Steps to Order Additional Materials 81 Orders Can Be Submitted by Users with the Following Roles: DAC (LEA Test Coordinator) with Additional Orders add-on role An additional materials order is a three-step process on the Orders & Shipments page of PearsonAccess next : 1.Verify the shipping information. 2.Enter a quantity. 3.Review and complete the ordering process. Refer to the PearsonAccess next Additional Orders Training Module found at If any materials are ordered through the Additional Orders process, they need to be associated with the receiving student’s record. The registration/accommodation information must be entered into PearsonAccess next on the student’s SR/PNP before placing the Additional Order.

Key Information to Order Additional Materials 82 Keep in mind when ordering additional material: Do not submit additional orders prior to receiving your initial shipment of test materials. – All test materials should be inventoried prior to any additional order. Once an additional order is approved, please allow 4-5 business days for shipment delivery. Although PARCC Test Booklets and Answer Documents will be shipped in packs of 4, they are ordered one-to-one. If you need materials for 7 students, enter 7 and PearsonAccess next will calculate the appropriate number of packages to order. Additional orders are packaged by school or district and shipped to the district.

Key Information to Order Additional Materials 83 Keep in mind when ordering additional material: Ancillary materials for return shipping are not automatically in your AO – Shipping labels – Mathematics tools and Reference Sheet – Header sheets Account for the need of these additional materials when you place an AO

Requesting an Additional Order 84 Select the appropriate Administration at the top of the screen.

Requesting an Additional Order 85 Under the Setup, select Orders and Shipment Tracking.

Requesting an Additional Order 86 Under the Select Tasks dropdown menu check Create/Edit Orders and click the Start button.

Requesting an Additional Order 87 Fill out the Details section and select Ship To contact.

Requesting an Additional Order 88 Fill out the Materials Order screen.

Requesting an Additional Order 89 Click the Create button once you have reviewed that all your requested items are listed.

Additional Order - Status 90 The Additional Order will now be listed as “submitted” on the Orders & Shipment Tracking screen.

Additional Order - Timing 91 The Additional Order will now be listed as “submitted” on the Orders & Shipment Tracking screen.

Questions? 92

Part 3 – February 4 th, 3:00 / / Upcoming Trainings 93

Kenny Smith Analyst Contact 94