Colorado Measures of Academic Success (CMAS) Training for SAC’s

Agenda SAC Responsibilities ◦ Communication ◦ Scheduling ◦ Test Security Pearson Access ◦ Online test management Proctor Training Accommodations

Windows, grades, content areas Assessment Window November 3-21, 2014 Science grade 12 Social Studies grade 12

Frameworks The frameworks list ◦ Percent representation and number of score points for each of the reporting categories/standard areas that will appear on the summative assessments ◦ Evidence Outcomes eligible for inclusion  Topics explicitly identified in the Social Studies standards are legitimate content for the assessment in addition to the standards' concept and skills sum sum

Changes….. Online Assessment vs Paper Pencil Will be a shift for teachers, proctors, students, parents, administrators- communicate regularly Using Pearson Access to manage your testing Accessibility features vs Accommodations Learning tech readiness for you and your building More rigorous, higher DOK

Similarities Ethical administration and procedures and ensuring standardized conditions Test security is important for valid and reliable scores Active Proctoring is a must

CMAS: High School Science and Social Studies Program Overview

TestNav: Software that runs the assessment ◦ Make sure your apps are up-to-date  TestNav 8 is new software that is supported by iPads and Chromebooks PearsonAccess: Software that is used to manage student data PearsonAccess.com: Web portal to PearsonAccess and other resources CMAS Components

Students designated as 12 th graders. Participating 12 th graders typically will be students who are: ◦ Designated as 12 th grade for the first time ◦ Part of School Year freshman cohort ( anticipated year of graduation) ◦ Part of School Year freshman cohort or later classified as 12 th grader due to credit accumulation ◦ In their fourth year or less in high school Who should be Tested?

Each content area consists of 3 sections ◦ Each section includes 24 items Option 1: Administer 3 sections to students in one day Option 2: Administer 1(or 2) section(s) per day The assessments include the following item types: ◦ Selected Response ◦ Constructed Response ◦ Computer-Enabled/Technology-Enhanced ◦ Simulations (science) ◦ Performance Events (social studies) Test Structure

What are the Responsibilities of School Assessment Coordinators?

SAC Responsibilities include Communication Scheduling Test Security and Ethics Technology Pearson Access Test Administrator Training Practice tests (epats)

SAC Responsibilities Test Administration Training Read Procedures Manual in its entirety after today’s training and prior to training your building A face to face proctor training is required by you to your building proctors prior to the start of the testing window ◦ Use the Proctor Training ppt. provided, it includes ethics and test administration Keep all signed confidentiality agreements onsite for all of your trained CMAS proctors 13

SAC RESPONSIBILITIES: COMMUNICATION

Communication Lead contact for questions in their building Always available to school proctors during all testing sessions in case of tech or test administration question or concern Lead communication with building technology staff Be part of communication with building tech staff and district IT Building communication to DAC

Who to contact with questions Test administration ◦ Proctor to SAC ◦ SAC to DAC ◦ DAC to CDE ◦ Tech questions  Building tech to district IT-inform SAC of any tech issues so they are aware

Assessment Technology CDE

SAC RESPONSIBILITIES- SCHEDULING

Definitions PearsonAccess Test Session: Virtual data grouping of students who are grouped together within PearsonAccess for test management purposes. Each PearsonAccess test session consists of one grade level and one content area (three sections). Students must be placed in a scheduled PearsonAccess test session before they can log in to a test. Test Section: The parts of a CMAS: Science and Social Studies assessment. Each content area of the CMAS: Science and Social Studies assessments include three sealed test sections. Physical Testing Group: Students who test within a physical testing environment at the same time.

Scheduling Create school wide testing schedule ◦ including accommodations and make ups Proctor scheduling: Suggest proctor and tech savvy person both be in room so if students are stuck with tech issues proctor isn’t stuck with one student ◦ Helps keep standardized conditions

Each content area consists of 3 sections Test sections can only be administered to students in consecutive order One content area at a time except for make-ups To the extent possible, all students within a grade should be assessed at the same time. Should that not prove possible, all students should be assessed within the shortest timeframe practicable (i.e., in back-to- back sections, within the same day or consecutive days if more sections are needed than can be administered in a day, etc.) CMAS Scheduling Considerations

Scheduling considerations cont… Technology ◦ Number of compatible devices ◦ Bandwidth ◦ Wireless access points ◦ How many concurrent testing sessions can you run?-use the site readiness tool ◦ Extra computers

CMAS: High School Test Structure and Timing CMAS: Science and Social Studies Section Administration Time for Elementary and Middle School Time for Set Up and Transition (Estimated) Required Testing Time for All Students Additional Testing Time (10 minutes)55 minutes15 minutes If all students have completed the test section, the Test Administrator may read the script to end that particular test section. New

Start up TestNav 8.0 Log in Test transfer (proctor cache…) Give directions Review sample items Time for Set up and Transition Includes….

Required to be on task for 55 minutes* Students are entitled to a full 70 minutes without interruption to complete section* Start the clock when directions are complete Treat technology interruptions as any other “interruption to testing” ◦ Note the time of the technology interruption ◦ Student must be given remaining time to complete section *If all students have completed the test section, the Test Administrator may read the script to end that particular test section. Students must have 70 minutes to test New

School Decisions: ◦ Sit Quietly ◦ Read (cannot use any electronic reading devices) ◦ Must not do any writing or any other activity ◦ May be released to location outside testing area ◦ What to do when all students are completed with section School Site Considerations: ◦ To where will students be released? ◦ To whom will students be released? After 55 Minutes

Select Timing Option (1, 2, 3, or 4) ◦ If Option 1 or 2 is selected, indicate where students should go when finished Section Timing: School Level Decisions

Timing Options

Schedule first group/first day with more of a time cushion than other groups if you can If you have to do multiple sessions, schedule smallest group first Determine whether one content area will be completed before beginning the next, or if testing will alternate between the two content areas (make-ups excluded) Determine whether the district wants to condense testing (make-ups excluded) or spread throughout the testing window Determine whether students will take an entire session in one day or take one section per day (make-ups excluded) Remember: This is Colorado CMAS Scheduling Considerations

All students now have extended time included in their test sessions Students using Text-to-Speech (TTS, replaces English Oral Scripts) may be in the same session with other students if they use headphones if headphone noise does not impact other students Students who need double time (110 minutes) must be scheduled in a separate session “Teacher Read Directions” Accommodation is not available in CMAS: Science and Social Studies CDE recommends administering Oral Scripts for social studies individually CMAS Scheduling Considerations: Accommodated Sessions

Student-to-Test Administrator ratio must not exceed 30 to 1 ◦ Test Administrator must be able to actively monitor the space within the testing environment ◦ Recommend 2 proctors to 30 students in order to maintain standardized testing conditions Student-to-Test Administrator Ratio

Best Practices-Recommendations 2 extra devices in each testing room Make a school plan for which timing option you will use and make sure everyone knows it

School CMAS schedules to Kim Terry no later than Oct. 24 th Also send security of testing materials form

Priority: minimize risk of prior exposure to test content that could result in an invalidation Student completes missed test section during make-up testing time in advance of re-joining original physical testing group Make-Up Testing

Sample Make-Up Testing Schedule Day 1Day 2Day 3 Regularly Scheduled Make-Up Testing Time (beginning of morning) -Absent Student Takes Section 1 - Physical Testing Group Testing Time (scheduled after initial morning make-up testing time) Physical testing group takes test section 1 Absent Student re-joins physical testing group for test section 2 Physical testing group takes test section 3

CMAS or CoAlt CSAP-A decision not based on: ◦ Category of disability ◦ Time in special education ◦ Program placement Must be documented by IEP team Contact Becky Ford in ESS if you need clarification 37

How many compatible devices does your school have for testing? How many students in tested grade level? What option will you use? 1, 2, 3, or 4? What other impacts to scheduling do you see? How does make-up testing affect scheduling? ◦ How to schedule for students who miss multiple days? Scheduling Discussion – Guiding Questions

SAC responsibility Test and materials security

Test Security Testing environment-screen security and number of computers How far apart to sit students Can students view from front to back the rows of screens in front of them? Student view side to side St authorization tickets-secure Student pre exposure to items

Test security No cell phones in testing room ◦ Collect (baggies with names) so students do not have them during testing No student tablets allowed in testing room Ipads are allowed for TEST ADMINISTRATORS only ◦ No recording ◦ No pictures of anything in test environment ever

Security of Student Authorization tickets-one approach SAC print before the test Put all into an envelope labeled for that test ◦ Maybe with a class list on the outside of it, ◦ All used tickets will be collected by the proctor and put back in that envelope Have another empty envelope labeled “MAKE UP TESTING REQUIRED” ◦ Proctors put any unused authorization tickets

Chain of Custody Student authorization tickets: Count in/out and test administrator sign for each time Paper forms Oral scripts Secure central storage location ◦ Not stored in classrooms

Test Materials Security Secure Non-Secure Student Authorization Tickets Seal codes Paper test books Social Studies source books Oral scripts Test Administrator Manual (TAM) Procedures Manual

Maintaining Security of CMAS All secure test materials must be secured while in the Test Administrator’s possession No duplication of secure CMAS materials is permissible No cell phones or other communication, reproduction or recording devices are allowed in the classroom

Unauthorized Visitors and the Media Only students, Test Administrators/Examiners, and authorized school, district, state personnel or state- sanctioned test monitors may be in testing areas during administration Media are not allowed to have access to the tests before, during, or after test administration, or take pictures or video of testing materials or testing students

The testing environment must be free of any content related posters or aids that suggest possible answers to students ◦ Word walls ◦ Steps for solving math equations ◦ Any content related materials Generally, posters that do not include content specific definitions, content related processes or solutions may remain on the wall The Test Environment

SCHOOL TECHNOLOGY RESPONSIBILITIES

School tech Java updates shortcut or LAN school set up using login given by IT that locks out other programs, puts test nav screen on every computer Site readiness tool so # of devices to run at one time is known eck.jsp?acc=co_chk eck.jsp?acc=co_chk Refer to district IT tech training for more information

System Check If you have the specifications for which browsers and versions work with which operating systems, etc you may not need this tool

Results From System Check - Failed

System Check - Passed

Without Proctor Caching - 26 Students

With Proctor Caching

With proctor caching- 466 students

Receiving and Returning Test Materials

Receiving Test Materials ◦SAC to verify materials received with the School Packing List

Online and Paper ◦ Test Administrator’s Manual ◦ CMAS Secure Return Envelope ◦ School Security Checklist Online Only ◦ Student Authorization Tickets ◦ Seal Code Document ◦ English and Spanish Oral Scripts for Online Form ◦ Onsite Translations into Languages other than English/Spanish Paper Only ◦ Test Books, including Braille and Large Print ◦ Source Book (Social Studies Only) ◦ Periodic Table (Science Only) ◦ English and Spanish Oral Scripts for Paper Form ◦ Onsite Translations into Languages other than English/Spanish Test Materials

Receiving Test Materials Materials will arrive via district warehouse-date tbd ◦ Green labels on CMAS boxes ◦ Pink labels on CoAlt boxes

SACs Collect all secure materials and group as follows:  Scorable test books  Test books must be grouped by content area. Top the grouped test books with a completed header sheet and secure with a paper band.  Unused test books  Secure return envelopes  Accommodated materials  Electronic materials must be removed from any devices after testing and verification sent to the DAC Prepare materials for packaging  Check and deliver CMAS scorable test books to the DAC ASAP  Check and deliver CMAS nonscorable materials to the DAC  Return materials in original boxes Returning Test Materials- SACs

Questions