TESTING SERVICE Rosemary Baum, Test Service Manager W. F. Adam, Test Coordinator Matthew Coleman, Test Coordinator Topic: 3-8 TESTING

3-8 TESTING

DISCUSSION What’s New in Testing in 2016? Change in the number of Book Forms (2016) Change in process to assist districts (2016) Change in District Return Count sheet (2016) Change from 2015 – Unused extra answer sheets and labels – DO NOT SEND TO NERIC (2016) Change in N-24 form (2016) (one grade per sheet) What’s New in Testing for ? (Computer Based Testing in 2017) 3-8 TESTING

WHAT’S NEW IN TESTING IN 2016? MEMO ENTITLED: Changes for the 2016 Grades 3-8 English Language Arts and Mathematics Tests WHEN: Released on January 27, 2016 FROM: Angelica Infante, Deputy Commissioner of the Office of Instructional Support and Peter Swerdzewski, Assistant Commissioner, Office of State Assessment TOPICS: Greater involvement of educators in the test development process, Decrease in the number of test questions, and A shift to untimed testing WHERE TO FIND MEMO: 8ela-math-tests.pdf 8ela-math-tests.pdf 3-8 TESTING

CHANGES IN 3-8 ELA – TESTING

CHANGES IN 3-8 MATH – TESTING

AB C A: Pre-printed by NERIC: School Building Names will be listed. B: Pre-printed by NERIC: # of Pre- printed (answer sheets that were shipped to the school/district). C: The school or district will list the number of answer sheets that are being returned. This number should equal. -The number of pre-printed answer sheets that the district received (both sheets). -Plus the number of extra answer sheets for new students (two sheets for each student – even if there is a Reason Not Tested). IMPORTANT – MUST BE RETURNED PROPOSED CHANGES 3-8 TESTING

WHAT’S NEW IN TESTING FOR ? MEMO ENTITLED: Elementary- and Intermediate-level Testing Schedule WHEN: Released on January 27, 2016 FROM: Angelica Infante-Green, Deputy Commissioner TOPIC: Testing Schedule WHERE TO FIND: 8testschedule17.pdf 3-8 TESTING

COMPUTER BASED TESTING IN TESTING CBT – OPERATIONAL TESTS LAST TWO SLIDES OF THIS POWERPOINT CONTAIN THE FULL SCHEDULE.

3-8 TESTING

ADMINISTRATION DATES – Grades 3-8 ELA Administration Dates: Tuesday, April 5 th through Thursday, April 7 th Makeup Dates: Friday, April 8 th through Tuesday, April 12 th Math Administration Dates: Wednesday, April 13 th through Friday, April 15 th Makeup Dates: Monday, April 18 th through Wednesday, April 20 th Science 4 and 8 – Performance Administration Dates: Wednesday, May 25 th through Friday, June 3 rd Science 4 and 8 – Written Administration Dates: Monday, June 6 th Make-up Dates (for Written): Tuesday, June 7 th and Wednesday, June 8 th 3-8 TESTING

THE TOP 10 TESTING ISSUES (or the top 10 reasons why a student may not get a score) 10. Missing or incorrect counts on the District (on District Return Test Count Sheet – our scan count and your district count should be the same) 9. Missing rosters (used as reference for NERIC processors if it is filled out including BOOK FORM) 8. Missing N-24 Form (important because it lists all new students) 7. Stray marks in heading 6. Missing Scoring Model Code 3-8 TESTING

THE TOP 10 TESTING ISSUES (or the top 10 reasons why a student may not get a score) 5. Missing Book Forms - in 2015, ELA – on page 1; Math – on pages 1 and 3 4. Missing Reason Not Tested 3. Missing test sheets (all pre-printed sheets – both pages – must be returned and answer sheets for new students, even if they were absent or refused, must be returned) 2. Missing Scoring Committee Number 1. Missing bubbles for Constructed Response 3-8 TESTING

DELIVERY FROM NYSED: ELA & MATH BOOKLETS DELIVERY: UPS delivers all of the tests between the hours of 8:00 am and 5:00 pm. TRACKING: Districts can track shipments one to three days before the scheduled delivery date. Go to CLICK: Track by Reference Number. (This is the BEDS code of the school where the tests are to be shipped.) IN REFERENCE NUMBER FIELD: Type in BEDS code. PROBLEM: If you are unable to track your shipment or notice any irregularities, contract the Office of State Assessment (OSA) via fax to TESTING

FOR DISTRICTS NOT PARTICIPATING IN REGIONAL SCORING: PACKAGING OF THE TEST – BY GRADE 1 – District Return Test Count Sheet (ON TOP) 2 – Rosters (with Book Form listed) 3 – N-24 Forms (one per grade) 4 – Extra answer sheets that were used by a student or show the reason not tested need to be returned to NERIC. 5 – All pre-printed answer sheets that were sent to the district need to be returned to NERIC (both pages for all students – whether they took part of the test or have a reason not tested). 3-8 TESTING

VALIDITY RULE - FOR REFUSALS IMPORTANT Refusal: Students who refuse to take the entire test must be reported at the local level with a final score of "999" and a standard achieved code of “96,” indicating refusal. These records do not move to Level 2 of the Student Information Repository System. These students will be considered to have "no valid test score" and will be counted as not tested. Students who indicate refusal to take the test but answer at least one question on the test will receive a scale score and performance level based on the questions answered. SIRS Manual, January 13, 2016, Version 11.17, page TESTING

VALIDITY RULE – FOR ABSENT IMPORTANT Absent: Students who are absent for any session (for ELA or mathematics) or any parts (written or performance for science) or the entire test must be reported at the local level with a final score of "999" and a standard achieved code of “99,” indicating no valid score, whether or not there are any response records. These students will be counted as not tested in verification reports and for accountability calculations. If a student leaves the test administration in the middle of a session and is not able to make up that part of the test, school officials must decide whether to consider the student absent (no valid test score) or to calculate a final test score and performance level by assigning 0 credits for the incomplete parts. SIRS Manual, January 13, 2016, Version 11.17, page 66

TEST SECURITY – In the Classroom for paper and pencil tests Electronic devices are prohibited in test rooms. Examples include cell phones, iPods, tablets, laptops, notebooks, cameras, etc. (see 7/12/12 SED Memo). Proctors have the right to collect electronic devices prior to start of the test. Admission to the test may be denied to a student who refuses to relinquish a prohibited device. Some students with disabilities may use recording/playback devices, provided an accommodation is specified in the student’s IEP/504 plan. 3-8 TESTING

TEST SECURITY – In Districts and Schools Secure test materials must be stored in a safe or vault. Check contents of shipment against shipping notice. After testing, all used/unused test booklets and used answer sheets must be kept secure. Used answer sheets may not be reviewed, scanned or scored by anyone before the official scoring process has been completed and answer sheets have been scanned by the NERIC. 3-8 TESTING

TEST SECURITY – What to do if there is an issue Student violations are reported by the principal to NYSED and NERIC. Adult violations should be reported by school officials to NYSED’s Test Security Unit. REASONS:  Giving aid to a student.  Altering student responses.  Altering test answers or scores. Violations may result in an Admin Error. CONTACT: TESTING

TEST SECURITY - at NERIC Answer sheets returned to NERIC are counted and put into secure storage. Answer sheets are scanned in a secure area and after scanning are returned to secure storage. During the editing process, answer sheets are moved from secure storage to the work area. After editing, the answer sheets are returned to secure storage. Answer sheets remain in secure storage until returned to the district, usually around September or October. 3-8 TESTING

NYSAA AND NYSESLAT NYSAA Program Service Code: 0220 Grade Level: 13 or 14 CBT: ELA and Math Portfolio: Science (grades 4, 8, and high school) and Social Studies (high school) NYSESLAT Program Service Code: 0231 LEP Eligibility Exit Code: TESTING

ISRs FOR ELA, MATH AND SCIENCE ELA/Math/Science ISR Order Form sent to districts in Summer Sign-up is prior to the ISR release by NYSED. Quote for ISR print/mail service/WebEDGE upon request. Color or black/white ISR’s are mailed to student residences with district cover letter. Parent addresses come from Level 1. WebEDGE service available though Parent Portal for schooltool, eSchoolData and PowerSchool. 3-8 TESTING

NYSAA ONLINE REPORTS Preliminary NYSAA Report for use by BOCES NYSAA District/School Roster Report NYSAA ISR is available in Level 2 Reports in the Score Reports folder. NYSAA Data File will be loaded to the District Folder. 3-8 TESTING

EXAMPLES OF MISSING ITEM DATA 3-8 TESTING

EXAMPLES OF MISSING ITEM DATA WHEN SCORING – DO NOT LEAVE BLANK – unless a ‘Reason Not Tested’ is bubbled on page 1. If a student answers one question in Book 1 but refuses to take Book 2, bubble in NO RESPONSE. If the student is absent for one part of the test (and does not make it up), bubble in Absent NOTE – The sheet CAN NOT be processed until NERIC gets an answer from the district. 3-8 TESTING

EXAMPLE OF CORRECTLY BUBBLED SHEET The SCORING MODEL CODE and the SCORING COMMITTEE are bubbled. Every question is bubbled. 3-8 TESTING

EXAMPLE OF INCORRECT SHEET What will happen when this sheet is scanned? Mary Abel’s sheet will be scanned and data processed. The scanner reads the preprinted data for Mary Abel at the top of the sheet. NOTE: It does not read Timothy Wright’s name, ID #, and DOB. The scanner will read the student ID of Mary Able but capture the data of Timothy Wright. What is the right way to handle this situation? Mary Abel’s sheet; bubble ‘Not enrolled at time of test." Timothy Wright; use an Extra Answer Sheet What is wrong with this answer sheet? This is a preprinted answer sheet. Student name and DOB are crossed out & replaced with another student’s name and DOB. Timothy Wright’s ID number is written in the space provided. 3-8 TESTING

EXAMPLE OF INCORRECT ID NUMBER A new student is given an Extra Answer Sheet to take the test. All applicable information is written in the appropriate places. N24-2 form is completed for this student. N24-2 form is mailed to NERIC where data is loaded in the Testing database. What happens when this sheet is scanned? The data is loaded to Level 1 for ID # Data is scored by the vendor and returned to NERIC to load to the DW. PROBLEM! The ID # written on the sheet belongs to a 5 th grader. When NERIC loaded the assessment data to Level 1 it did not error because ID #25999 exists in the table. The 5 th grader received a scale score with a Performance Level of ’94’ (No Valid Score), because he/she took the wrong level of test for their grade level. Juan Valdez did not receive anything. It is the district’s responsibility to ensure the data written on the answer sheet and N-24 form is accurate. The CIO must contact NERIC if they find a discrepancy. 3-8 TESTING

RECOMMENDED WEB SITES NERIC: NYSED: OSA: engageNY: Test Security: TESTING

Do you have any suggestions regarding how NERIC can better serve your testing needs? Questions and Answers 3-8 TESTING

NERIC CONTACTS Rosemary Baum (518) Bill Adam (518) Matthew Coleman (518)

Elementary- and Intermediate-Level Testing Schedule Page 1 of TESTING

3-8 TESTING