The Office of Student Assessment Services October 26, 2018 Introduction to Computer-Based Testing Steps to Take in Fall/Winter to Prepare for the Spring 2019 MCAS Administration The Office of Student Assessment Services October 26, 2018

Scott Kelley, Data and Reporting Specialist Presenters Scott Kelley, Data and Reporting Specialist Robert Pelychaty, Accommodations and Appeals Coordinator Jodie Zalk, Test Administration Coordinator Liz Pennington, Pearson Project Manager Massachusetts Department of Elementary and Secondary Education

Logistics for This Session Questions may be asked at any time using the Q & A feature on the WebEx screen. Specific questions about a student or your district should instead be sent by email to mcas@doe.mass.edu. We will attempt to answer all questions asked during the session; after the session, all questions will be answered and emailed out to participants. This session is being recorded and will be available online in about one week at: MCAS Resource Center -- mcas.pearsonsupport.com/training In the section entitled “Training Sessions Previously Offered This School Year”

Steps to Prepare for Computer-Based Testing This Fall/Early Winter 01 Steps to Prepare for Computer-Based Testing This Fall/Early Winter 02 Resources, Support, and Next Steps CONTENTS

Steps to Prepare for Computer-Based Testing This Fall/Early Winter 01

Background Information: Transition to the Next-Generation MCAS 2017 CBT required * grades 4 and 8 CBT optional grades 3, 5, 6, and 7 2018 CBT required * grades 4, 5, 7, and 8 CBT optional grades 3 and 6 2019 CBT required* grades 3–8 and 10 and high school Biology and Intro Physics field tests (Note: Retests are legacy paper-based administrations.) * Paper-based testing will be available for students with disabilities who require a paper-based test as an accommodation as well as for EL students who are unfamiliar with computers.

Late Winter/ Early Spring General Timeline for MCAS CBT Pre-Administration Tasks Fall (Ongoing) Read Student Assessment Updates. Become familiar with CBT components. Identify the test administration team. Update contact info with DESE. Fall/Winter Plan for accessibility features and accommodations. View online modules and participate in training. Review tech specs, and prepare infrastructure and devices. Update contact info in PAN and create additional accounts. Complete the SR/PNP. Late Winter/ Early Spring Conduct an Infrastructure Trial. Create TestNav Configurations Precache tests. Prepare students for online testing. Review additional instructions in the Principal’s Administration Manual. Expected to be available in late winter. Delivered to schools two weeks before testing.

Steps Involved This Fall/Winter Become familiar with the components for CBT. Identify the test administration team. Update contact info with DESE. Update contact information in PAN and create additional accounts. Plan for accessibility features (for all students) and accommodations for students with disabilities/ELs. View online training modules, and attend additional training sessions. Review tech specs, and prepare the school’s infrastructure. Prepare devices and materials. Conduct an Infrastructure Trial. (strongly recommended) Prepare students for online testing. Not all of these steps are in sequential order; some are ongoing tasks.

1. Become familiar with the components for CBT: PearsonAccess Next. Online test management system for principals, test coordinators, technology coordinators, and test administrators Primarily used for the following: Manage user accounts Student registration (SR/PNP) Managing computer-based test sessions Resources: PearsonAccess Next User Guide User Role Matrix Layout for importing users into PAN

TestNav TestNav Online testing platform used by students to take the computer- based MCAS assessments Resources: TestNav8 Online Support Set up and Use TestNav Troubleshooting

ProctorCache ProctorCache Software that allows for precaching of test content on a designated ProctorCache machine located at the school or district. Strongly recommended to reduce bandwidth requirements and to provide a more seamless testing experience for students Resources: Set Up and Use ProctorCache ProctorCache System Requirements Features and Demos

Logging into PearsonAccess Next Demonstrations Logging into PearsonAccess Next Accessing resources in the MCAS Resource Center

MCAS Resource Center mcas.pearsonsupport.com

Technology Setup Page on the MCAS Resource Center mcas.pearsonsupport.com/ technology-setup/

Questions & Answers

2. Identify the test administration team. Identify staff members who can help with planning and management of CBT: Test coordination Accessibility features for all students Accommodations for students with disabilities and English learners Technology set-up Determine local responsibilities: Who will schedule and manage test sessions? Who will configure devices for testing? How will information be shared across the team? Who needs to receive the SAS Update?

3. Update contact information with DESE. Update contact information for the following roles: MCAS Test Coordinator (district- and school-level): Note: Can assign this role to multiple individuals. Educational Technology Director (district-level only) Principals Submit updates to the District-Level Directory Administrator for: Public school districts, public schools, charter public schools, educational collaboratives, approved private special education schools, and alternative education programs Go online to the EOE Information Technology web page (select "District/School Information Update" as the subject) to submit updates for: (Include your District and School Code.) Test sites, adult education programs, out-of-state schools, SEIS-DYS programs DESE uses contact information to email time-sensitive information and the Student Assessment Update (to principals, test coordinators, special education directors, EL directors).

4. Update contact information in PAN and create additional accounts. Two PAN sites: live site and training site Passwords on one site will always match the other. Dates that the PAN live site will be available for spring 2019: Grade 10: January 14 Grades 3–8: January 23 Different roles provide different levels of access in PAN Review the User Role Matrix. Additional user accounts should be created by the school or district for the appropriate staff members. Approximately three weeks before testing, schools will need to assign accounts for test administrators. Refer to the PearsonAccess Next User Guide for instructions on creating and editing user accounts.

Include selected features and accommodations in the SR/PNP. 5. Plan for accessibility features (for all students) and accommodations for students with disabilities and English learners. Review and assign accessibility features for all students and accommodations for students with disabilities and ELs. Include selected features and accommodations in the SR/PNP. Before testing: required for student to receive correct test forms After testing: to update features or accommodations used during testing Resources: Accessibility and Accommodations Manual Guide to the SR/PNP Process Recording of the accessibility and accommodations training session Online training module Approved graphic organizers and supplemental Math & STE reference sheets

6. View online training modules, and attend training sessions. Modules to Assist with Pre-Administration Tasks mcas.pearsonsupport.com/training Modules to Assist with Tasks to Complete During Testing Training Sessions Previously Offered This School Year

7. Review tech specs, and prepare the school’s infrastructure. Review specifications and resources: CBT technical specifications Minimum and recommended specs for hardware and devices Recommended levels of bandwidth Note special instructions for Chrome OS (Chromebook). TestNav8: Recently Updated Confirm whether all devices planned for testing will meet these specifications. Identify/address gaps in technology capacity such as Potentially insufficient bandwidth USDE guide on building technology infrastructure for learning

8. Prepare devices and materials. Plan a sufficient number of devices for test administrators and for students. Recommended tool: Device calculator Ensure all devices will be charged prior to each test session. Have materials available (and check to see if they are in working order): Power cords, power strips, extra batteries, extra computers If using tablets: external keyboards If students are using text-to-speech: headphones

9. Conduct an Infrastructure Trial. (strongly recommended) Prepare for CBT by simulating test day network utilization Strongly recommended, especially for schools new to CBT When should we conduct a Trial? Infrastructure Trials can begin on February 11, 2019 Conduct your school’s trial at least two weeks before testing. Who should participate? Test coordinators Technology coordinators Test administrators Students Massachusetts Department of Elementary and Secondary Education

Why should our school do an Infrastructure Trial? The Infrastructure Trial confirms that: TestNav is configured correctly. ProctorCache software is set up correctly. Devices can successfully run TestNav and that online test content can pass through the content filters at the school. The network can bear the full load. Participating staff understand their roles during an MCAS computer-based administration. Students are familiar with the computer-based tools and format.

Infrastructure trial Demonstrations Training Site (for use by all test administration staff, based on role) ProctorCache (for use by technology coordinators) Precache (for use by technology coordinators) Creating sample students (for use by principals and test coordinators)

Questions & Answers

10. Prepare students for online testing. Review technology skills and tools Ensure the curriculum incorporates digital learning; review the DLCS Curriculum Framework Student Tutorial Demonstration of the navigation, tools, and features for CBT Students complete it independently (no audio). Practice tests Simulation of the tools and features for CBT Include accessibility features and special edition text-to-speech accommodated test forms

Additional Resources for Preparation Additional resources for students Sample student work and scoring guides Answer keys and scoring rubrics Click on the subject, and then click on the grade. Equation editor guides and symbol keys for Math and STE Reference sheets for Math and STE  Resources for parents/guardians

Demonstrations Student tutorial Practice tests

Questions & Answers

Resources, Support, and Next Steps 02

Additional Resources on the DESE MCAS website Description Home page Access MCAS headlines and links to MCAS site (e.g., test schedule, test designs, training) Student Assessment Updates Biweekly email with important updates about the MCAS program If you do not already receive this email, subscribe by emailing imailsrv@list1.doe.mass.edu with the following information in the body of the email: "subscribe SASUpdate Your_Name" (Example: subscribe SASUpdate John_Smith).  Resources from the Office of Digital Learning Resources on acquiring technology, digital citizenship, and online courses may be particularly helpful for schools new to CBT

January 2019 Training Sessions Date Session Audience January 15 MCAS Accessibility and Accommodations for new staff Principals, test coordinators, technology coordinators, special education administrators and supervisors, test administrators January 24 Overview of the SR/PNP Principals, test coordinators, technology coordinators January 29 MCAS Test Security and Administration Protocols for returning staff Principals, test coordinators, and test administration teams January 31

February 2019 Training Sessions Date Session Audience February 12 Pre-Administration Tasks for Technology Staff for new staff Technology Coordinators February 13 Overview of Infrastructure Trials for returning staff Principals, test coordinators, technology coordinators February 15

Spring 2019 “Office Hours” Sessions Date Session Audience March 12 Session 1: Creating, Preparing, and Starting PAN Sessions Monitoring and Managing PAN Sessions (tasks for test administrators) Enrollment Transfers in PAN Principals, test coordinators, test administrators March 21 Session 2: Updating Accommodations in PAN Before Testing Resolving Incorrect Accommodations After Testing Has Begun Resuming Students from “Active” Status Stopping a PAN Session Not Tested Reasons Principals, test coordinators

Email and Phone Support MCAS Service Center DESE Office of Student Assessment Services All questions on logistics and technology (e.g., PearsonAccess Next, SR/PNP, TestNav) Web: mcas.pearsonsupport.com/ Email: mcas@measuredprogress.org Phone: 800-737-5103 All policy questions (e.g., student participation, accommodations) Web: www.doe.mass.edu/mcas Email: mcas@doe.mass.edu Phone: 781-338-3625

Today: Complete the evaluation form. Next Steps Today: Complete the evaluation form. Only available when you close this WebEx session Responses associated with the name and email address used to log in Email your input to mcas@doe.mass.edu if you have problems accessing or completing the form. Early next week: Receive email with the following resources: The recording of this session The Q&A from this session Massachusetts Department of Elementary and Secondary Education

The Office of Student Assessment Services THANK YOU The Office of Student Assessment Services 781-338-3625 mcas@doe.mass.edu www.doe.mass.edu/mcas 75 Pleasant Street, Malden, MA 02148