Division Director of Testing Regional Meeting Spring 2019 Test Administration Updates

PearsonAccessnext Landing Page Direct links to PearsonAccessnext and the PearsonAccessnext training center have been added to the landing pages for the “live” and training sites.

PearsonAccessnext Online Support (1 of 4) On Friday, December 14, 2018, Pearson released PearsonAccessnext Online Support, which replaced the PearsonAccessnext User Guide. Customer feedback and input from various Pearson groups contributed to this updated version, with the goal of improving usability and structure for end users.

PearsonAccessnext Online Support (2 of 4) Updates include: The home screen allows users to select a section visually.

PearsonAccessnext Online Support (3 of 4) Instructions are available in various mediums (written, images, and videos)

PearsonAccessnext Online Support (4 of 4) The following sections appear on most pages: General Information Prerequisites Step-By-Step Effects What’s Next?

Coming Soon! (2 of 2) Starting with the Spring 2019 Writing and Non-Writing Test Administrations, all Special Test Accommodations will be listed on the alerts screen.

Testing Status Code 9 (Previously Passed) Testing status Code 9 should only be applied to students’ tests in grades 3-8 who have been retained (in the same grade as the previous school year) and the student passed the SOL test the previous year.

What is a Flip?

Before Calling VDOE to Flip a Form… The STC should instruct the Examiner to have the student EXIT the test: Keep the student seated at his/her workstation. VDOE cannot change the student’s form to the correct audio or read-aloud form unless the student is in Exited status. Do not mark the test complete or have the student submit the test.

Mathematics Updates

Mathematics Updates (1 of 2) Spring 2019 (Grades 3-8 and End-of-Course) Standards of Learning assessments will measure the 2016 Mathematics Standards of Learning. All paper Grade 8 and EOC Mathematics tests (2009 and 2016 SOL) administered in spring 2019 and all subsequent test administrations will use Version 2.0 answer documents.

Mathematics Audio Updates Beginning in spring 2019, the audio forms of Mathematics SOL assessments assessing the 2016 SOL will use a Text-to-Speech feature. This tool will be located to the right of the item. Students click on the arrow to begin hearing the item. Text will highlight as it is being read. The audio CD’s are not available for paper, braille, and large print mathematics tests assessing the 2016 Mathematics SOL. The read-aloud accommodation will need to be utilized.

Plain English Mathematics vs. Universal Design Beginning in spring 2019, new Mathematics SOL assessments will not include a separate Plain English form of the tests. All items used on mathematics tests now meet the criteria for Universal Design. Universal Design principles require that language that is not specific to the content area (mathematics) be simplified and that all test questions be written so that they are accessible by all populations of students. See Superintendent’s Memo #284-17.

Mathematics Tool and Practice Item Updates A straightedge tool has been added to the TestNav tool bar on Mathematics tests and is available on all items. Mathematics practice items were updated to reflect new content and include the Desmos calculator, new straightedge tool, and new formula sheets. Mathematics audio practice items were updated to reflect the Text-to-Speech feature.

New Calculators (3 of 5) Desmos Virginia Four Function and Scientific Calculators

New Calculators (5 of 5) Desmos Webpage is available on the VDOE website. The use of Desmos was highlighted in the 2018 Fall Mathematics Institutes. Mathematics Instructional Plans are available incorporating Desmos. Sixteen webinars have been hosted (Dec. 2018-Feb. 2019) by the Office of Science, Technology, Engineering, and Mathematics Webinar recordings are available and additional webinars will be offered. Contact: mathematics@doe.virginia.gov

Mathematics Training Center Tests (1 of 2) The Elementary School Mathematics CAT Training Test has been updated to reflect the 2016 Mathematics Standards of Learning and will be added to the Training Center prior to spring 2019. There will not be a Desmos Virginia Four Function calculator in the Elementary School Mathematics Training Test. This test contains only Grade 3 Mathematics test questions, and a calculator is not available in the Grade 3 Mathematics test.

Mathematics Training Center Tests (2 of 2) An email will be sent to DDOTs when the updated Elementary School and Middle School Mathematics CAT Training Tests become available.

Training Center Tests for Desmos Virginia Calculators A secure version of each Desmos Virginia Calculator will be available in the Training Center as a separate test that contains no test items. These may be used for students with accommodations needing access to the online Desmos calculators. These Training Tests will be named: Desmos Virginia Four Function Calculator Desmos Virginia Scientific Calculator Desmos Virginia Graphing Calculator

Practice Item Set Updates (1 of 3) New tabs will be added for Reading and Desmos Virginia Calculators.

Practice Item Set Updates (2 of 3) The Reading - 2017 tab will display a screen for grades 3-8 and End of Course practice items.

Practice Item Set Updates (3 of 3) The Desmos Virginia Calculators tab will display a screen for the three online calculators.

Standard Setting Committees for Mathematics SOL Tests Standard setting committees for the End-of-Course (EOC) Mathematics Standards of Learning tests based on the 2016 Mathematics Standards of Learning were held November 5-7, 2018. Standard setting committees for Grades 3-8 Mathematics Standards of Learning tests based on the 2016 Mathematics Standards of Learning were held February 5-7, 2019. Communicated in Superintendent’s Memo #229-18 and Superintendent’s Memo #316-18 These committees were responsible for recommending cut scores that reflect students’ achievement status.

Additional Orders – Mathematics Audio forms are not available for the new Mathematics (2016 SOL) paper forms. Only two paper forms of the new Mathematics (2016 SOL) tests are available for each test type (Regular/Read Aloud, Large Print, or Braille).

Updates to Examiner’s Manuals for Spring 2019 Testing

Directions for Online Mathematics (2016 SOL) Tests (1 of 3) Examiners should be very familiar with the directions for the online Mathematics tests prior to the day of testing. Examiners must know about the different sections and which students receive those directions. Examiners must know about the non-audio and audio directions boxes for the 2016 SOL tests The audio plays the samples, the examiner does not read the samples to students with the audio accommodation.

Directions for Online Mathematics (2016 SOL) Tests (2 of 3) The Grade 3 Mathematics test may be given over one or two days based on the division-wide decision. MCPS gives the test in one day. The Grades 4 & 5 Mathematics tests consists of two parts; a non-calculator portion and a calculator portion. The test may be given over one or two days based on the division-wide decision. MCPS gives the test in one day. Since Grades 3, 4, and 5 Mathematics (2016 SOL) are administered in Spring only, there is only one section of mathematics directions (Section 5.3) in each manual.

Flow Chart for the Grades 3, 4, and 5 Mathematics (2016 SOL) Directions

Examiner’s Training for Mathematics 2016 SOL Tests Prior to the day of testing, help Examiners to identify the correct directions sections for testing the non-audio and audio directions boxes for the 2016 SOL tests. If Examiners read the wrong directions to students, an irregularity must be filed. Could result in nullification of scores and students taking the test over, after the correct directions are read. Please call attention to the directions in Examiner’s training.

Addition to Troubleshooting Section of the TIM/Examiner’s Manual: Auto Exit (1 of 2) TestNav will automatically Exit a student’s test after two hours of inactivity. Inactivity is when the student does not: move the mouse, press any keys, or touch the screen (on touchscreen devices). When the student has been inactive for 1 hour, 59 minutes and 30 seconds this message will appear on the student’s workstation screen: “Are you still there? This test will be exited in 30 seconds if no activity is detected.”

Addition to Troubleshooting Section of the TIM/Examiner’s Manual: Auto Exit (2 of 2) When the test is automatically Exited, the following error message will appear on the student’s screen: “Error 3124. TestNav has closed the test session due to inactivity. To continue testing, ask your proctor to resume your test, and sign in again.” To enable the student to continue with the test, the student’s test must be Resumed in PearsonAccessnext, then the student can sign in with the student testing ticket.

Updates to Various Documents, Forms, and Guidelines

Updated Transmittal Form and Affidavit The Testing Ticket Transmittal Form and Affidavit for Examiners/Proctors was updated to include a column to identify the online test session to which the Examiner/Proctor is assigned. The Examiner’s and Proctor’s affidavits have been separated on the form.

Testing Ticket Transmittal Form and Affidavit for Examiners/Proctors

Updates to the Transmittal Forms and Affidavits for Paper Testing in the Supplements The Test Booklets/Prompts Transmittal Form and Affidavit for Examiners/Proctors and the Special Test Forms/Kits Transmittal Form and Affidavit for Examiners/Proctors were updated to add the location of the test to which the Examiner/Proctor is assigned. The Examiner’s and Proctor’s affidavits have been separated on the form. The Supplements are only available on the VDOE website.

Test Booklets/Prompts Transmittal Form and Affidavit for Examiners/Proctors

Guidelines for Proctoring and/or Recording a Test Session Guidance has been added for recording and storage devices. A device or application that saves the test session recording to the cloud must not be used. Recordings of test sessions may not be saved to the cloud. Refer to the Test Implementation Manuals Appendix C.

Updated Guidelines for Expedited Retake Testing The guidance for expedited retake testing has been updated to meet the requirements implemented beginning with the Spring 2018 Non-Writing test administration. Guidance for eligibility criteria for Grades 3-8 and EOC SOL tests administered to meet federal accountability requirements. Guidance for eligibility criteria for EOC SOL tests needed for verified credits. Refer to the Test Implementation Manual for details.

Additional Test Development Updates

English Updates During 2018-2019, both 2010 and 2017 English Standards of Learning are included in the written and taught curricula. Spring 2019 SOL assessments will measure 2010 English SOL and include field test items measuring the 2017 English SOL. In 2019-2020, all written, taught, and assessed curricula reflect the 2017 English Standards of Learning. See Superintendent’s Memo #017-18

Reading Test Blueprints New Reading assessments measuring the 2017 English Standards of Learning will be administered for the first time in the spring 2020 test administration in Grades 3 through 8 and End-of-Course (EOC). To support preparation for implementation of the 2017 English Standards of Learning, the new Reading test blueprints are available on the VDOE website. See Superintendent’s Memo #260-18 for additional information.

Reading Practice Items Reading practice items will be updated in spring 2019 to reflect new content. A Superintendent's Memo will be posted announcing the updates to the practice items.

Review of Science Standards and Curriculum Framework Public comment on the 2018 Science Standards of Learning closed on September 19, 2018. First review of proposed revised 2018 Science Standards of Learning Curriculum Framework will occur in March 2019. Public comment period for proposed revised 2018 Science Standards of Learning Curriculum Framework will occur in March 2019. Information can be accessed on VDOE website.

SOL Item and Test Review Committees 2019 Standards of Learning Item and Test Review Committees: Communicated in Superintendent’s Memo #341-18 Participants will perform several duties, such as examine test items for appropriateness and fairness and to confirm a match with the SOL. The 16 committees will meet during various dates in July 2019. Completed applications are due to VDOE by February 15, 2019.

Special Testing Accommodations for Students with Disabilities (SWD) Refer to Appendix B in the Test Implementation Manuals and Examiner’s Manuals

Testing Accommodations for SWD (1 of 3) Visual Aids—students with disabilities may use a paper Periodic Table of the Elements on the online Chemistry SOL test. Headphones, Ear Muffs, or Ear plugs—has been renamed Noise Dampening Equipment. This is also noted in the Table of Testing Accommodations, in Appendix B.

Testing Accommodations for SWD (2 of 3) Communication Board, Choice Cards—information added stating, the Communication Board or Choice Cards must rest on the work surface and may not be held by the examiner. Dry Erase Board—guidance for maintaining test security has been added for when large or small dry erase boards are provided.

Testing Accommodations for SWD (3 of 3) Information Boxes Updates—the following information boxes have been updated to clarify and/or correct procedures: Guidance for Reading Tests Aloud—Information for all Assessments Guidance for Creating on Online Read-Aloud Test Session Guidance for Creating an Online Session for the Read-Aloud Accommodation for Computer Adaptive Tests (CAT)

Calculator Accommodation Criteria Form Revised (1 of 2) If the calculator with accessibility features and/or additional mathematical capabilities needed by the student and/or the calculator the student will use on the non-calculator portion of the test, also has additional mathematical capabilities that are not needed by the student, a completed Special Assessment Accommodation Request Form must be submitted to the Department of Student Assessment and ESEA Programs with a copy of the completed Calculator Accommodation Criteria Form. An explanation must be provided detailing how student access to the additional mathematical capabilities the student is not eligible to use, will be prevented during testing.

Calculator Accommodation Criteria Form Revised (2 of 2) The Checklist of Mathematical Capabilities for Approved Calculators has been updated to include the capabilities provided on the Desmos Calculators now available for the online SOL Mathematics tests based on the 2016 Standards of Learning. Accommodation Code 28 should be used for Calculator with Additional Capabilities accommodations.

Upcoming Testing Memo (1 of 5) An upcoming testing memo will update the guidance found in Testing Memo Numbers 1301 and 1302 for using the two-day option of the online versions of the Grades 3-5 Reading and Mathematics and the Grades 6 and 7 Mathematics SOL tests for students requiring the Multiple Test Sessions accommodation on these tests. These students must have an IEP, 504 Plan, or English Learner (EL) Participation Plan.

Upcoming Testing Memo (2 of 5) The “Stop” sign has been replaced by a Seal Code box. The Seal Code Box screen separates Part one from Part two of the test. The Seal Code prevents the student from accidently entering Part two. The two-day option in the online version of these tests requires that the student complete all of part one of the test on the first day and Exit the test at the screen with the Seal Code box.  The student must finish all of part two of the test on the second day.

Upcoming Testing Memo (3 of 5) A revised table that provides information about the test items before the “Stop” sign/Seal Code Box will be provided. The information in the revised table should be referenced when determining the appropriateness of administering the online test using the two-day option to students who require the Multiple Test Sessions accommodation.

Upcoming Testing Memo (4 of 5) Online SOL Test Percentage of Test Items In Part One of the SOL Test Grade 3 Mathematics CAT Approximately 50% Grade 4 Mathematics CAT Approximately 25% Grade 5 Mathematics CAT Grade 6 Mathematics CAT Approximately 20% Grade 7 Mathematics CAT Approximately 10%

Upcoming Testing Memo (5 of 5) Online SOL Test Percentage of Test Items In Part One of the SOL Test Grade 3 Reading CAT Approximately 50% Grade 4 Reading CAT Grade 5 Reading CAT

Health Management Devices (1 of 2) The Health Management Device Form must be completed for each student with a documented health need who requires the use of a health management device (e.g., continuous glucose monitor) during the administration of a Standards of Learning assessment. The completed form ensures that consideration is given to the type of health management device needed by the student, while also confirming the integrity of the SOL test administration. The procedure to use with the health management device during testing must be approved by the Division Director of Testing (DDOT). Have notification f rom CES—2 Students EMES—1 Student FBES—1 Student

Health Management Devices (2 of 2) Test Examiners and Proctors should be aware when they have students who require a health management device during testing and ensure the procedures, designated on the approved form, are followed to ensure testing integrity. The Health Management Device form is on the VDOE website.

VAAP 2018-2019 For the 2018-2019, 2019-2020, and 2020-2021 school years, the currently available VAAP based on student work samples aligned to the 2009 Mathematics ASOL and the 2010 English and Science ASOL will continue to be administered. The Aligned Standards of Learning (ASOL) have been removed from the VAAP Implementation Manual and are available on the Virginia Department of Education website.

Effect of ESSA on VAAP The United States Department of Education has notified states that assessments such as VAAP that consist solely of student work samples will not be permitted under the Every Student Succeeds Act (ESSA).  Virginia Department of Education staff will be revising VAAP to comply with ESSA requirements. The new alternate assessment will be available for administration by 2021-2022 and will measure ASOL derived from the 2016 Mathematics SOL, the 2017 English SOL, and the 2018 Science SOL.

English Language Proficiency Assessment Updates

ELP Assessment Testing Window Dates can be located on the Virginia WIDA Member Page

Division Director of Testing Regional Meeting Spring 2019 Reporting and Data Topics

On Demand Reports Formatting Update Beginning with the Spring 2019 Non-Writing Test Administration, the Test Name and Deliver Group (Group Name) fields have been added to the default header row. The Student Number and Date of Birth fields were removed from the default header row, however remain as an option in the Manage Columns list.

NEW – Summary Detail by Standard of Learning Report (1 of 5) This report is provided for computer adaptive tests (CAT) only. This report will provide summary information on school performance for Standards of Learning as compared to: the proficient performance level, the advanced performance level, and the school’s performance on the total test.

NEW – Summary Detail by Standard of Learning Report (2 of 5)

NEW – Summary Detail by Standard of Learning Report (3 of 5)

NEW – Summary Detail by Standard of Learning Report (4 of 5) There will be one table for each reporting category and the associated SOLs for the test. The reporting categories will be listed in test blueprint order. An asterisk (*) indicates that fewer than 20 students were tested on a particular SOL. The report will be created using the best test attempt for all students. For mathematics tests, the double dagger indicates items that were administered in a section of the test where calculators are not allowed.

NEW – Summary Detail by Standard of Learning Report (5 of 5) This report will: be produced at the school level only. be available as a PDF in the Published Reports section of PearsonAccessnext. be available Post-ATR (Authorization to Report).—This means July or August be added to the SOL Non-Writing Report Chart in PearsonAccessnext. This report will not be included in the list of reports that divisions may order as a printed report.

Audits

Audits – Test Records Audit Update Test Records Audits – Audits of a school’s data related to SOL testing. A team of auditors from VDOE reviews a school’s assessment records in conjunction with supporting documentation submitted by the division. The Office of Student Assessment selects one school in 32 divisions (4 in each Superintendent’s Region) in the fall and spring test administrations for audit. Data from the current assessment year is reviewed for accuracy.

Audits – Test Records Audit Update As a result of changes in the Standards of Accreditation as well as ESSA requirements, the Office of Student Assessment is updating our test records audit process. Staff will continue to audit elementary, middle, and high schools on data fields such as: the appropriate use of the retest flag. the appropriate use of the recovery flag. the appropriate use of testing status 1, 4, 50, 51, and 9. the appropriate implementation of expedited retake opportunities.