1. English Language Arts – Mathematics – Science – Social Studies Colorado Measures of Academic Success (CMAS) Spring 2016 Administration Training for SACs – Part 3

2. Overview Preview Process During CMAS Testing Administering Tests Basic Technical Troubleshooting Make-Up Testing After Testing Additional Assessments

3. During Testing Test Administration 3

4. Tasks to Complete During Testing 4 On the Day of Testing (CBT):  Distribute test materials.  Ensure Test Administrators have a computer or tablet available.  Monitor test activity.  Ensure accessibility features and accommodated forms are assigned to appropriate students.  Be available to Test Administrators and Proctors.  Investigate security breaches and testing irregularities.  Follow protocol for contaminated or damaged test materials, safety threats and severe weather.  Respond to all technology related issues.  Collect materials from Test Administrators after each test unit/section.

5. During Testing: Security Breaches 5 Monitoring and Reporting Security Breaches and Testing Irregularities 1.All instances of security breaches and testing irregularities must be reported to the School Test Coordinator (STC), and subsequently, the DAC, immediately. 2.DAC will contact the state immediately upon receiving the call. 3.Testing Irregularity or Security Breach – PARCC: STC (SAC) will complete the Form to Report a Testing Irregularity or Security Breach and DAC submit it through Syncplicity ELA/Math folder. – Science and Social Studies: SAC/DAC will complete the Test Incident Report and submit it through Syncplicity Sci/SS folder.

6. During Testing: Contaminated & Damaged Materials 6 PBT - Contaminated or damaged test materials must be replaced.  Place Student ID label on replacement document or complete data grid.  Record security barcode number of the damaged and new documents.  Submit the Form to Report Contaminated Damaged, or Missing Materials to Pearson and to Syncplicity ELA/Math folder.  If possible, transcribe responses from contaminated test material into the replacement. If not, for PARCC contact Stephanie Boyd at boyd_s@cde.state.co.us, and for Science and Social Studies contact Sara Loerzel at loerzel_s@cde.state.co.us. boyd_s@cde.state.co.usloerzel_s@cde.state.co.us  Destroy contaminated material according to local biohazards protocols.  Compile a list of contaminated/damaged Test Booklets, maintain the list for 3 years, and notify Stephanie Boyd for PARCC at boyd_s@cde.state.co.us, and Sara Loerzel for Science and Social Studies at loerzel_s@cde.state.co.us.boyd_s@cde.state.co.usloerzel_s@cde.state.co.us

7. Create a Plan and Train Staff for Safety Threats and Severe Weather Test Administrators and Proctors must: 1.Note the time of the disruption. 2.Secure test materials as specified in your School Security Plan. 3.Prepare students for the continuation of the unit/section and resume students’ tests. 4.Document the situation in writing. 5.If the disruption will cause the unit/section to be carried over into the next day, notify CDE. During Testing: Safety Threats and Severe Weather 7

8. Test Administration Materials Test Administrator’s Manual (TAM) – Fill in and select options for after the test session. – Read script exactly as written (may clarify after exact reading). – Practice in advance! – Each unit/section will be submitted independently Student Testing Tickets – Hand out and collect in the test environment. – Have a master list of students including accommodations. – Student Testing Tickets are secure! 8

9. School Level Decisions: After Students Finish Unit/Section – Will students be able to leave when they have finished testing? (no minimum time) – Sit quietly? – Read? (cannot use any electronic reading devices) – May students be released to location outside testing area? – What to do when all students are completed with unit/section? – Where will released students go? – To whom will students be released? 9

10. Active Administration Active Administrators: Provide feedback Clarify test questions Answer content related questions Interfere with the students’ demonstration of skills Interact with students in any way that would impact student responses Engage in other tasks during test sessions Read sources, items, or student responses Help with TestNav navigation 10 Administrators May Not: Ensure students have all necessary materials for each section Ensure a standardized testing environment Follow all scripts exactly as written Move throughout the room during testing Read directions to students when asked and may clarify the directions Use proximity to keep students on task Use “continue working” script

11. Administration Steps for CBT  Prepare the test environment and situate students  Start test session in PearsonAccess next  Unlock the unit/section being administered through PearsonAccess next  Follow directions and read script in the Test Administrator’s Manual  Hand out Student Testing Tickets and scratch paper  Assist students in logging on to TestNav 8  Complete directions to students and direct them to start the unit/section  Actively administer each test unit/section  Verbally stop test unit/section  Collect Student Testing Tickets and scratch paper  Lock unit/section  Close test session in PearsonAccess after last unit/third section only  At this point, the status of all tests for all students in the test session must be “Completed” or “Marked Complete” for each unit/section * Incomplete units/sections should be “marked complete” by SACs 11

12. TestNav 8 PARCC/Science and Social Studies – https://co.testnav.com https://co.testnav.com TestNav 8 training center – https://home.testnav.com https://home.testnav.com 12

13. TestNav 8 New Apps Homescreen (December – January) 13

14. Signing in to TestNav 14

15. Review in TestNav 8 On any item in TestNav there is a Review button located in the top toolbar. At any time a student is able to click the Review button to see all questions in the section, and quickly identify questions they have “Not Answered” or “Bookmarked”. 15

16. Log Out of TestNav (To return to same unit/section) Steps for students who become ill during testing, or for units/sections that need to be transcribed: In the top right hand corner of your screen, select the gray button next to your name and choose the option “Logout of TestNav.” This message appears, “I want to exit this test and finish later.” Select the blue “Save and Return Later” button. 16

17. Exiting from TestNav 8 After clicking the Next arrow following the last question the student will arrive at the End of Section screen, shown below Select the green “Submit” button A Section Exit Warning screen will pop up. Select “Yes” to confirm that you want to leave this unit/section. 17

18. Basic Technical Troubleshooting 18

19. Common Error Codes 1001: “Your test has been saved. Please notify your test administrator.” – Early Warning System initial message, does not indicate the issue, another error code will follow 1009: “Unable to download test content” – Network connection issue between the testing device and Pearson servers. 3005: “TestNav has detected that another application attempted to become the active window” – This could be caused by pop-ups in the background, power saving features, or key combinations like ctrl+alt+del 8026: “Unable to connect to the proctor caching computer. Please contact your administrator.” – Network connection issue between the testing device and the local Proctor Caching device 19

20. Common Error Codes - What to do? Resume the student in PearsonAccess next Have the student log in again on the same testing device If the same error occurs repeatedly, or if the same error is affecting multiple students, contact your Technology Coordinator Do not move the student to another testing device unless the student safely exits the test using the log out feature. 20

21. Common Errors 9059: “The username or password you entered is incorrect.” If the username/password being used is accurate, the student may be on the incorrect login page – “Colorado” 21

22. Technology Tip If students are testing on iPads or Chromebooks, note the specific device on which each student is testing. Each student should use the same device for all units/sections to aid in response data recovery if needed. 22

23. Make-Up Testing 23

24. Make-Up Testing 24 Make-Up Testing Students who are absent, become ill, or who can no longer test because of classroom, school, or technical interruptions during original units/sections, may utilize make-up testing. They may not return to previously viewed questions. Test security and administration protocols apply. School Test Coordinators will establish the make-up testing schedules for their schools. PARCC ELA/Math Units may be taken out of order only for make- up testing. Science and Social Studies Sections may not be taken out of order. Priority: minimize risk of prior exposure to test content that could result in an invalidation.

25. Online Test Management Multiple screens may be managed in PearsonAccess next at the same time. 25

26. After Testing 26

27. Tasks to Complete After Each Unit/Session of Testing 27 Computer Based Testing – After Testing The day of testing: Collect materials (Student Testing Tickets, scratch paper, etc.). Ensure students have logged out of TestNav. Return materials to STC/SAC using chain of custody form. Paper Based Testing – After Testing The day of testing: Collect materials (Test Booklets, source books, scratch paper, etc.). Ensure names are on Test Booklets, answer documents and source books. Return materials to STC using chain of custody form.

28. Final Day: Tasks to Complete After Testing 28 Computer Based Testing – Final Day After Testing The final day of testing: Collect materials (Student Testing Tickets, scratch paper, etc.). Ensure student test units/sections have been submitted/completed. Ensure test sessions have been stopped. Purge the cached test content. Securely destroy materials listed in TCM School or District Return used scratch paper in provided envelopes. Paper Based Testing – Final Day After Testing The day of testing: Collect materials (test booklets, scratch paper, etc.). Ensure labels are affixed or data grids are complete. Return PBT materials to Pearson as soon as possible. Securely destroy materials listed in TCM. Return used scratch paper in provided envelopes.

29. Not Tested Students Students who were absent or not tested (did not access any part of the test): Paper Based Testing: Return test materials with unused materials – Mark not tested reason in PearsonAccess next Computer Based Testing: Information will be sent when procedures are finalized 29

30. Tasks to Complete After Testing 30 After Testing (continued) One week after the final unit/section: Organize and return nonscorable test materials. ‒ Identify transcribed and damaged test materials as “Do Not Score.” Complete a Post-Test Certification Form for all CMAS and submit through Syncplicity Assessment Forms folder. Destroy/shred scratch paper and used Mathematics Reference Sheets. Must return used scratch paper for Science & Social Studies in secure return envelopes. Keep records for three years. Within the final week of testing: Resolve critical warning/alerts in PearsonAccess next. Do not need to resolve title III warning.

31. Student ID Labels 31 The student ID label will override any bubbled demographic information. Set aside student ID labels that were not used to be securely destroyed/shredded. If an ID label is not available, grid all the fields on the data grid (must match info in PAnext) – Incomplete or incorrect bubbling will lead to rejected student tests that must be resolved later.

32. Rejected Test Attempts 32 Rejected Test Atempts are tests that will not be scored if not fixed. (Timeline of May to early June) If the information on the data grid does not match PAnext, it creates a Rejected Test Alert. All 6 fields must match. – First name, last name, SASID, gender, date of birth, grade If accommodations are for CBT, but the student takes the PBT version, PAnext needs to be updated or the test will not be scored.

33. Packing Materials 33 Checklist to prepare materials for packing:  DAC will receive materials from the School Test Coordinator.  Scorable Test Booklets/Answer Documents contain a Student ID Label or hand-gridded student demographic data.  School Header Sheets completed for each grade level and/or subject.  All grades of Algebra I will be under one header sheet for the school.  All 7 th ELA will be under one header sheet for the school.  Scorable and nonscorable materials are packed separately, and in the boxes in which they were delivered.  Boxes are not overfilled.  One return shipping label is placed on the top of each box.

34. Packing Scorables 34 Packing Scorable materials for Return Shipment:  Science/SS materials separate from PARCC materials  Place all materials in the shipping boxes.  One school, per box. Do not combine two school’s test materials in one box.  Use appropriate shipping labels.  Once all materials are in boxes, indicate the sequence of boxes being returned for the school (e.g., Box 1 of 3, Box 2 of 3, and Box 3 of 3) on the return shipping label.  Do not mix Scorable and Nonscorable materials in the same box. Scorable materials Used test booklets (grade 3, Science/SS) Used answer documents (grades 4–high school) Transcribed into test booklets (grade 3, Science/SS) or answer documents (grades 4–high school)

35. Packing Scorables 35 PARCC and Science and Social Studies will have and Iowa shipping address. The PARCC scorable label is red. The Science and Social Studies scorable label is orange.

36. Preparing Scorables 36

37. Non-Scorable Materials Nonscorable materials Unused test booklets (including for absent students) Unused answer documents (grades 4–high school) Used test booklets (grade 3 and S/SS) and answer documents (grades 4–high school) that have been marked “Do Not Score” Used ELA/Math test booklets (grades 4–high school) Large print test booklets (transcribe into scorable) Braille test booklets (transcribe into scorable) 37

38. Preparing Nonscorables 38 PARCC and Science and Social Studies will have and Iowa shipping address. The Science and Social Studies nonscorable label is blue. The PARCC nonscorable label is purple.

39. Packing Nonscorables 39

40. Arrange for Pickup 40 Scorable materials must be picked up by May 4, 2016 Contact UPS at 800-823-7459 to schedule pickup:  Pickups must be scheduled at least 24 hours in advance. Call by May 2, 2016.  Check to see if you qualify for freight shipment.  UPS customer service is available 24/7. Tell UPS you are calling about a pickup request for Pearson and will be using their “Return Service.”  Once pickup is confirmed, you will get a confirmation number from UPS that can be referenced if questions or changes arise.

41. Everyone involved in CMAS: ELA, math, science, and social studies administration must be trained each year. This includes SACs, Test Administrators, technology personnel and any other school staff involved in administration. SACs are responsible for ensuring that all individuals involved in test administration receive training and sign a security agreement. 41 School Training

42. Comprehensive training must include: – Test Security – Standardized Test Environment – Test Administration – Test Session Management (for appropriate personnel) – Test Administrator Role vs. Teacher Role – Opportunity for personnel to ask questions CDE will be providing a basic PPT that schools will be able to use and update for Test Administrator trainings. Schools will need to add school- required instructions. Training 42

43. An online index for assessment manuals and materials. – PARCC – topic-based – Colorado – alphabetical Easy search capabilities. Frequently updated and updated on demand. News feed with the latest broadcast emails. Most popular topics are listed at the top. View pages, print results, and download full PDFs. 43

44. Student Surveys Student surveys will not be included in the online assessment If they are used this year, they will be from a separate link. 44

45. Additional Assessments 45

46. Colorado Alternate English Language Arts and Mathematics Assessments for Students with significant cognitive disabilities Grades 3-11 Window: PARCC window (3/16 early start date) Link to recorded trainings are available on the Assessment Unit website: http://www.cde.state.co.us/assessment/trainings http://www.cde.state.co.us/assessment/trainings Annual training is required CoAlt: Dynamic Learning Maps (DLM) 46

47. Resources and Support 47

48. Resources – Support Page 48

49. Resources Training Modules – Located at https://parcc.tms.pearson.comhttps://parcc.tms.pearson.com Practice Tests – Available through https://co.pearsonaccessnext.comhttps://co.pearsonaccessnext.com PARCC Accessibility Policy Manual & Implementation Guidance – PARCC Accessibility Features and Accommodations Manual – http://avocet.pearson.com/PARCC/Home#10762 http://avocet.pearson.com/PARCC/Home#10762 Test Coordinator & Test Administrator Manuals for Paper-based and Computer-based Testing – Found at https://PARCC.pearson.com on the Support pagehttps://PARCC.pearson.com CMAS: Science and Social Studies Procedures Manual and Test Administrator Manuals – Will be posted at http://www.cde.state.co.us/assessment/newassess-sumhttp://www.cde.state.co.us/assessment/newassess-sum 49

50. Resources Unique Accommodation Request Guidance – Checklists for Reading Access (e.g., TTS, Read aloud), Scribe, Calculator – http://www.cde.state.co.us/assessment/trainings http://www.cde.state.co.us/assessment/trainings Handouts from CMAS Training – http://www.cde.state.co.us/assessment/trainings http://www.cde.state.co.us/assessment/trainings CSLA eligibility and information – http://www.cde.state.co.us/assessment/csla http://www.cde.state.co.us/assessment/csla 50

51. Resources – PRC Partnership Resource Center – Released items – https://prc.parcconline.org/assessments/parcc-released-items https://prc.parcconline.org/assessments/parcc-released-items Use PARCC Member Code: CO1876 PRC resources include – K-2 Formative Tasks – Speaking and Listening – Diagnostic 51

52. Resources – Office Hours CMAS Call-in Office Hours Thursdays from 3-4 Next office hour scheduled for December 7 Weekly office hours begin January 7 Topics include PearsonAccess next Procedures Review Updates Weekly DAC Emails Assessment Unit updates and information emailed to DACs on Tuesdays, as needed 52

53. Contact Customer Support for assistance with: Resources – Customer Support Accessing resources Setting up proctor caching Submitting additional orders Inquiring about shipments TestNav Navigating PearsonAccess next Navigating the Training Center Managing Student Registration Data Setting up test sessions Managing user IDs and passwords 53 PARCC Online Support and Resources http://PARCC.Pearson.com/Support http://PARCC.Pearson.com/Support CMAS Science and Social Studies and CSLA Support Hours: 4:30 am – 5:30 pm MT, Mon.–Fri.Hours: 7:00 am - 6:00 pm, MT Mon.-Fri. Call Toll Free: 1-888-493-9888Call Toll Free: 1-888-687-4759 Email: PARCC@support.pearson.comPARCC@support.pearson.comEmail: cohelp@support.pearson.comcohelp@support.pearson.com Chat is available

54. Updates 54 US DOE Peer Review – Monitoring is to take place for state assessments – CMAS Similar to past ACT monitoring DACs will be notified prior to school visits – CoAlt: Science and Social Studies Districts will be contacted in advance to schedule score monitors when testing will take place

55. Questions?

56. Kenny Smith Analyst 303-866-2366 smith_kenny@csi.state.co.us Contact 56

57. 57 Thank you