Update on Testing NYSCOSS Conference Steven Katz Assistant Commissioner, Office of State Assessment Heather Klusendorf Program Manager, Computer-Based Testing Grades 3-8 ELA and Math September 2018

Grades 3-8 ELA and Math Spring 2019 and 2020 will have the same test design and format as the Spring 2018 tests Spring 2021, new exams based on NYS Next Generation Learning Standards The Office of State Assessment (OSA) will be continuing to work with NYS educators to gather input for design of the 2021 exams. What are your thoughts? Any feedback for us? DRAFT

Operational CBT, 2017-18 DRAFT

Computer-Based Testing, NY Year 1 2015-16 All schools given the option to administer stand-alone field tests on computers 902 schools administered field tests on computer More than 60,000 students took the field tests on computer Year 2 2016-17 All schools given the option to administer operational tests with CBT in any subject, any grade level 184 schools administered operational tests with CBT More than 28,000 students took the operational tests on computer 819 schools administered field tests on computer Year 3 2017-18 More than 650 schools administered operational tests with CBT More than 145,000 students took the operational tests on computer More than 1000 schools plan to administered field tests on computer DRAFT

Why CBT? Test Administration is simpler No test booklets to transport No lost answer sheets No paper rattling during test taking No rulers dropping to the floor Students report “liking” taking the test on computer Administrators and students like the online testing accommodations Scoring Administration is simpler No lost testing booklets No shuffling through test booklets to find an item to score—items are displayed immediately and quickly onscreen through technology Electronic alerting from scorers makes communication easier Real-time reports provide an at-a-glance of the scoring room status DRAFT

Computer-Based Testing, NY 2018 was the second year that schools could choose to administer their Grades 3-8 ELA and mathematics exams on computers. 2016 CBT Field Testing Pilot No major technical issues 2017 First-Year of Operational CBT Minor technical glitch on first day of operational CBT ELA 2018 Second-Year of Operational CBT Technical issues during operational CBT ELA DRAFT

Technology Happens DRAFT

Technology Happens Lessons Learned from CBT ELA Communicate & Listen Communications to principals, Lessons Learned and feedback sessions, Fall CBT Roadshows Be flexible Nine primary testing days, extended the CBT ELA widow Find better ways to communicate Operational CBT Listservs, “CBT Today” section on CBT Support, adding contact names to CBT Technology Readiness data collection Review all systems Requiring Questar do a complete audit of all systems and deliver a technical improvement plan Develop contingency plans We are developing “if this, then that” action plans ahead of this year’s operational CBT administration DRAFT

Statewide CBT Simulation Based on feedback from our operational CBT schools and based on a process developed at several districts last year, we are organizing the first-ever Statewide CBT Simulation: Participation is voluntary Uses the Questar Secure Browser Practice Tests Tests Performance and more Helps schools to better prepare DRAFT

Question Sampler DRAFT

Question Sampler Available from a public landing page and can be used by students, parents, teachers, or administrators. Users can experience the testing tools without downloading and installing a secure browser or app. Most test accommodations are available in English and five translated languages. Text-to-Speech is available in English only. Three samplers per subject and grade level. For the best experience use a Chrome browser to access the Sampler https://ny.nextera.questarai.com/tds/#practice

ScorePoint Response Example Example of Scoring a Response Entered on Computer DRAFT

Computer-Based Testing Timeline 2018-2019 School Year September-October November-January February-March April-May CBT Weekly Updates Calls Resume (Fridays) Nextera Admin District and School Data Updated Regional Fall CBT Information Sessions CBT Technology Readiness Checklist Updated Technology Readiness Online Verification opens CBT Support Refreshes for 2018 NYSED Online Ordering System Opens Schools Continue to Order Operational CBT Schools Continue to Sign Up for CBT Field Testing Verify CBT Technology Readiness Confirmation of Scoring Consortia Relationships CBT Winter Training Roadshow Locations Determined Students Use the CBT Secure Browser Practice Tests ScorePoint Training Roadshows Statewide CBT Simulation: February 26th & March 5th Proctor Webinar CBT Readiness & Best Practices Webinar Confirm Readiness with all Operational CBT Schools and Scoring Consortia NYSED Prepares for Operational CBT ELA Operational CBT: April 1-8 ELA Scoring: April 5 -17 Lessons Learned from ELA Webinar: April Math Operational CBT: April 30 – May 7 Math Scoring: May 6 – 16 Lessons Learned from Operational CBT: May CBT & PBT Field Tests: May-June CBT Student Constructed Responses Available to Schools: June 1 DRAFT

Fall CBT Information Sessions Attend a session: https://cbtsupport.nysed.gov/hc/en-us/articles/360013258571 DRAFT

Questions about CBT? CBT Customer Support CBTSupport@nysed.gov https://CBTSupport.nysed.gov

Regents Exams SED’s goals when developing Regents Exam schedules: Primary goal is to optimize student performance and minimize scheduling exams such that students may have two exams on the same day Provide schools with feasible schedules Facilitate schools meeting the required 180 days of session DRAFT

Questions for the Office of State Assessment? emscassessinfo@nysed.gov 518-474-5902 http://www.p12.nysed.gov/assessment/