1. PRESENTED BY: STEPHANIE E. HASKINS APRIL 30, 2015 Spring 2015 Non-Writing SOL Training

2. Training Agenda Timeline What’s New? Testing and Curriculum Resources Student Registration & Test Assignments Role of Examiners Reminders for Testing Coordinators Questions - 2 -

3. Testing Timeline DateActivity Week of April 20Non-secure Testing Materials Arrive May 12Data Upload File Due to DDOT May 15Secure material delivery (Paper/pencil) May 21 – June 9SOL Testing (See attached) March 13Return all testing materials (MS) June 11Return all testing materials (HS) June 19SOL Reports go home to parents

4. Testing Upload Group Name: Consider how you want score reports to be organized. Group Code: Will NOT appear on printed reports; allows for data sorts; Max 10 characters Ethnicity/ Race: Hispanic; 32 categories ELL information: Test tier, composite, literacy, SOA-LEP, AYP-D SOA Transfer: Enrolled after 20 th day – Sept 17 th or after OR Feb 18 th or after AYP: If a student began school ANY day AFTER the first day OR first day of semester AND was NOT in our division last year, can be coded as AYP. May disregard reference to “September 30”.  A: within division  B: outside division/ within Virginia  C: outside Virginia Term grad: Scheduled to graduate by Aug 31, 2014; qualifies for 2 nd attempt Project Graduation: High school only – Refer to definition in TIMS RP-Code: Genesis Retest: High school only – if retaking test Online Test: Students NOT marked as online should have documented need Additions in RED andDeletions in RED

5. Testing Upload

6. Resources School Test Coordinator Handbook Student Data Upload File Requirements Test Implementation Manual Supplement to Test Implementation Manual Examiner’s Manual Pearson Access User’s Guide for the Virginia Assessment Program Students with Disabilities: Guidelines for Assessment Participation Students with Disabilities: Guidelines for Special Test Accommodations Virginia Standards of Learning Assessments Guidelines for Administering the Read-Aloud Accommodation Limited English Proficient Students: Guidelines for Participating in the Virginia Assessment Program

7. Testing Resources Test Implementation Manual:  What’s New?  Checklist of STC Responsibilities  Online Tools, Icons, Descriptions  Testing Manipulatives  Troubleshooting online testing  Responding to Student Questions  Appendix A: Test Security  Appendix B: Test Transmittal  Appendix C: Special Test Accommodations  Appendix D: Table of Testing Accommodations

8. Testing Resources Examiner’s Manual:  Checklist of Examiner Responsibilities  What’s New?  Applications for Test Preparation  Online Tools, Icons, Descriptions  Testing Manipulatives  Accommodations  Reporting test errors/ Test Irregularities  Troubleshooting online testing  Specific directions  Answering student questions  Directions for Submitting Tests  Test security  Special Test Accommodations

9. What’s New for Non-Writing? School affidavit confirms that all secure materials are returned. Pre-testing discussion regarding cell phones, unauthorized materials, cheating & new test directions. Testing status 50 (Student refusal/disruptive) and Testing status 51 (Parent refusal). Appendix C and D have been updated to include additional information for testing accommodations. History 2001 Standards of Learning will no longer be offered. Lexile and Quantile scores will no longer appear on printed parent reports.

10. What’s New for Non-Writing? VMAST Algebra I and EOC are available for students with disabilities pursuing a standard diploma with credit accommodations.  Must have passed course  Must have taken EOC test at least twice, with 374 or below  Must meet VMAST participation criteria  Must be coded as retest

11. Grade 6: Computer Adaptive Test (CAT) Non-Calculator/Calculator Section

12. Grade 6: CAT Non-Calculator/Calculator Section Examiners MUST read to the student the directions from the Examiner’s Manual that accompany the distribution of a calculator. If the Examiner observes that a student has moved beyond the “STOP” sign and did not ask for a calculator, the Examiner is to provide the student with a calculator and allow him/her to continue testing. The Examiner MUST:  read the directions from the Examiner’s Manual that accompany the distribution of the calculator and provide the calculator.  document which item # the student is on when providing the calculator (if beyond # 10). After the student completes testing, the Examiner must inform the School Test Coordinator (STC) of the situation. The STC or other school representative MUST inform the parent of what occurred and offer the option to retest with the understanding that the score from the first test attempt will be removed, and the score of the second test attempt will be included in all data and reports. Submit the irregularity to the DOE if a student will be retested. Maintain the irregularity locally if no retest will be administered.

13. Criteria for All Expedited Retakes The student must: 1. Have passed the course associated with the test; and 2. One of the following:  Failed the test by a narrow margin; or  Failed the test by any margin and have extenuating circumstances that would warrant retesting; or  Did not sit for the regularly scheduled test for legitimate reasons. The “narrow margin” criteria shall be defined as a scaled score of 375- 399. The division superintendent will be responsible for making the determination of what constitutes “extenuating circumstances” and “legitimate reasons” for the purposes of establishing eligibility for an expedited retest of a Standards of Learning test.

14. Extenuating Circumstance Irregularity Occurred due to individual situation with student Unrelated to testing environment Related to testing environment Refer to list of irregularities How do I differentiate?

15. Grades 3 – 8 Parent Permission Each parent MUST “opt-in” for their child to participate. 1. Who will collect written permissions, and how will this be noted? 2. Who will call if students fell in expedited retake range? Will all parents be called, including those who have not submitted paperwork? 3. When will parents be called and students notified – once all tests are complete or before?

16. Additional Details: Test Windows The grades 3 through 8 test windows submitted in PearsonAccess represent the date range for 1 st time test attempts. Expedited retakes can be completed during or after the initial test window within three weeks of the initial test’s score reporting, but no later than June 26, 2015.

17. Additional Details: Miscellaneous Expedited retakes should not be coded Recovery. If a student was administered an alternate form due to a test irregularity, student assessment staff will need to assist with assigning an expedited retake form (as forms are available).

18. Expedited Retakes for Grades 3-8: Preparing for Spring 2015: Online Expedited Retake Context Online expedited retake test sessions are setup using the Expedited Retake Context for the following tests: Grade 8 Reading and Mathematics Code with Z-Code-B  Cannot code as Retest Main Context Online expedited retake test sessions are setup using the Main Context with the Alternate Form assigned for: Grades 3-7 Reading Grades 3-7 Mathematics Virginia Studies Civics & Economics Grade 5 and 8 Science Code these expedited retakes with Z-Code-B

19. Expedited Retakes for Grades 3-8: Preparing for Spring 2015: Online The Alternate Form Group Type is only available to DDOTs STCs can do the following:  Add new test assignments  Create sessions using the appropriate context GROUP CODE example: ER Rdg6  Expedited Retake Context for Grade 8 Reading and Mathematics  Main Context for all others  Add students to sessions  Code Z-Code-B

20. Questions and Answers Q1: If the initial SOL test was coded recovery can the expedited retake also be coded recovery? A1: No, expedited retake tests do not qualify for the Recovery code. Q2: Is remediation required prior to administering an expedited retake? A2: Divisions are urged to offer remediation to students before an expedited retake attempt; however, it is not required. This slide pertains to Spring 2015 Expedited Retakes for Non-EOC Grades 3-8 tests only.

21. Questions and Answers Q3: How many expedited retake attempts can a student be offered? A3: Students in grades 3-8 taking non-EOC SOL tests can only take one expedited retake per course/ subject, and it must be attempted in the same test administration as the initial failing attempt. Q4: Can students in grades 6-8 who took non-EOC SOL tests be offered an expedited retake for tests failed in Fall 2014? A4: No, the Resolution only applies to SOL tests taken during the Spring 2015 Non-Writing SOL test administration. This slide pertains to Spring 2015 Expedited Retakes for Non-EOC Grades 3-8 tests only.

22. Questions and Answers Q5: Can school divisions narrow the criteria for expedited retakes (e.g., smaller score range, course grade, course, certain grade levels, etc.)? A5: Yes, divisions have the flexibility to narrow the criteria for expedited retakes. Q6: Is an expedited retake available to students who passed the SOL test and want a higher score? A6: No, expedited retake criteria specify failed SOL test attempts only. This slide pertains to Spring 2015 Expedited Retakes for Non-EOC Grades 3-8 tests only.

23. Questions and Answers Q7: Under certain circumstances, students with disabilities and LEP students may receive the read- aloud or audio accommodation on the EOC Reading test even though the students have not been determined as eligible by the school division according to the criteria required for the read-aloud or audio accommodation on the Reading Assessment. Does this apply to students in Grades 3- 8? A7: No, this is available only to students pursuing a verified credit or trying to certify literacy for the Modified Standard Diploma. This slide pertains to Spring 2015 Expedited Retakes for Non-EOC Grades 3-8 tests only.

24. Questions and Answers Q8: Can the division require the student to participate in remediation before the student takes the expedited retake? A8: School divisions have the option to require that students taking retests in non-EOC grade 3- 8 tests participate in remediation. This slide pertains to Spring 2015 Expedited Retakes for Non-EOC Grades 3-8 tests only.

25. Questions and Answers Q9: When do expedited retakes need to be administered? A9: The DDOT or STC should schedule expedited retake test sessions within three weeks of the initial test’s score reporting, but no later than the last day of the Non-Writing Spring 2015 test administration, June 26, 2015. Q10: Can expedited retakes be administered after the last day of school? A10: Yes, as long as all expedited retakes are providedwithin three weeks of the initial test’s score reporting, but no later than the last day of the Non- Writing Spring 2015 test administration, June 26, 2015. This slide pertains to Spring 2015 Expedited Retakes for Non-EOC Grades 3-8 tests only.

26. Questions and Answers Q11: Can a student who is absent during the regular window be tested during the expedited retake? A11: Yes. Do not code a student absent unless the student was absent from the regular session and was never present to make-up the test for the remainder of the division’s test window, including test make-ups and expedited retakes.

27. Questions and Answers Q12: Do you need to account for students who are absent for their expedited retake opportunity? A12: No. The expedited retake test is optional for the student. Do not account for students who do not retest under the expedited retake opportunity. This slide pertains to Spring 2015 Expedited Retakes for Non-EOC Grades 3-8 tests only.

28. Questions and Answers Q13: Our school division opts to administer the grade 3 reading and mathematics SOL tests over two days. Can the expedited retest be administered with the break OR do we have to use the 2-day testing again? A13: The expedited retake should be administered under the same conditions as the initial test attempt. This slide pertains to Spring 2015 Expedited Retakes for Non-EOC Grades 3-8 tests only.

29. Online SOL Test: A Student’s Perspective TestNav Login Screen

30. Pointer Eliminate Choice Highlighter Pencil Eraser Notepad Ruler Protractor Dot Straightedge Compass Exhibit Calculator Online Tools

31. SOL Practice Items

32. Pearson Training Center

33. Test Security Agreement READ all of the Test Security Agreement prior to signing and administering any SOL assessment.

34. Pre-Testing Discussion Discuss consequences of accessing cell phones, electronic devices, or other unauthorized materials during testing. Discuss consequences of cheating on the test. In addition to any school consequences... “Remember, you must do your own work and not discuss the test at any time with anyone, including your classmates and teachers. Students who cheat on the test will receive a score of zero and will not be permitted another opportunity to take the test until next test administration.”

35. Role of Examiners/ Proctors During test administration, Examiners/Proctors must monitor the testing process by moving as unobtrusively as possible about the room. They should ensure that students are working independently and do not have access to unauthorized materials.

36. Answering Student Questions Examiners/ Proctors MAY answer questions regarding technical issues of the assessment. They may NOT answer questions that would provide any hint or clue with regard to the assessment.

37. Examples of Technical Questions Scrolling: “To view all of the reading passage, use the scroll bar to the right of the passage to move the page up and down.” Navigating the test: “To move to the next question click Next”; “To go back to the previous question click Previous”; “To go back to a question from the review screen click on the question’s number”; “To submit your test click the Submit the test button”; “Go back to the test item to make sure the Pointer was used to indicate the answer.” NOTE: Examiners/ Proctors may NOT use the student’s mouse or keyboard to navigate any portion of the test for the student.

38. FAQs When a student has completed testing can the test examiner scroll down the review screen (look over the student’s answer section on the answer document) and make sure the student has an answer for every question? No. The examiner must not touch the student’s mouse (avoid the appearance of providing assistance). The Examiner may only tell the student to “read the screen carefully” (online) or to “review the answer document carefully” (paper).

39. FAQs We are concerned that our students might select the wrong button to submit their tests. Can the examiner submit the test for the student? No. The examiner must not touch the student’s mouse (avoid the appearance of providing assistance). Directions in the Examiner’s Manual state, when students are ready to submit their tests for scoring, they raise their hands. The Examiner then follows guidance from Examiner’s Manual.

40. Guidance for Submitting a Test Grades 3-5: If examiner sees that student has unfinished items, the examiner may read this screen to the students. This screen says: “Stop. You are trying to exit the test. You have __ unfinished items.” (Refer to directions in Examiner’s Manual.) 40

41. Guidance for Submitting a Test GRADES 6-8 & EOC: If examiner sees that student has unfinished items, examiner may only tell student to “Read the screen carefully.” 41

42. FAQs If the student does not remember how to use one of the tools, can the examiner show the student how to operate the tool? No. The examiner may say, “for help with a tool, click on the help icon (life preserver) on the tool bar.”

43. FAQs Can staff and students get practice with the various functions on a test before live testing? YES! Students and staff may practice the login process, using tools, navigation, and submitting tests by taking a Training Center Test or by using the practice TestNav items. Students who have the audio accommodation may practice the audio controls also by taking the Training Center Test in audio format. Look for Applications for Test Preparation in the TIM and Examiner’s Manuals for several other applications to help students.

44. FAQs Can a student’s parent sit in the testing room with their child during testing? No, only test examiners/proctors and staff that are essential to testing (all of which have been trained and have signed the test security agreement) are permitted in the secure testing environment.

45. FAQs Can a teacher review a new test to get a feel for the type of questions that are being asked? No, this is what released test items and practice items can be used for.  Released Tests for Spring 2015:  Mathematics Item Sets: Algebra I, Algebra II, Geometry  Science Item Sets: Grade 5 Science, Grade 8 Science, Earth Science, Biology, Chemistry  Reading Entire Tests: Grade 3 Reading, Grade 4 Reading, Grade 5 Reading, Grade 6 Reading, Grade 7 Reading, End-of-Course Reading  Reading Item Sets: Grade 8 Reading  Writing Item Sets: Grade 8 Writing  Writing Entire Tests: End-of-Course Writing

46. FAQs While testing: Can I write notes of encouragement and put them on students’ desks, or can I verbally encourage students to do their best on the test, or pat them on the back to show support, etc.? No, none of this is permissible during the test session. These actions can give the appearance of inappropriate assistance and can result in an investigation and possible retesting.

47. Paper vs. Online Students who meet one or more of following criteria may be assigned a paper/pencil test: Placement: Special situation school, homebound, Governor’s school Accommodation requires paper/pencil: large-print, Braille, flexible schedule (multiple testing sessions requiring more than one day) Documented medical condition: Exposure to computer will aggravate condition (i.e. seizure disorder, etc.) All other requests must be completed through “Documentation of Need for Paper/Pencil SOL Assessment”

48. Table of Testing Accommodations Code Accommo- dation Student Content Area Description 1 Flexible Schedule SWD LEP HMRS  Testing with breaks requires the test to be completed within one school day;  Multiple test sessions that involve testing over more than one school day—require a paper/pencil test. 10Read-Aloud SWD LEP HMS  Tests are read (in English only) to the student. Must be recorded or proctored. 26 Calculator or Arithmetic Tables SWDM  Gr. 3 Mathematics—for use on the entire test.  Gr. 4, 5, 6, 7 Mathematics—for use on the NON- calculator portion of the test.  Grades 3-7 students must meet eligibility criteria.  Grade 8 and EOC Mathematics—not applicable (see #28). 48

49. Audio Symbols for Tests

50. Read-Aloud Symbols for Tests

51. Interpreter Accommodation Interpreters... May have access to the SOL or VMAST tests for review purposes 24 hours prior to the administration, as authorized by the DDOT May interpret test directions, sample items, and questions regarding the mechanics of the tests. These questions should be directed to and answered by the test examiner. Must have test sessions proctored or video-taped. Must sign an Interpreter’s Affidavit.

52. STC Reminders... Proctor Authorization Tickets and Student Authorization Tickets – These tickets should be printed no more than 4 days prior to the test window start date and must be stored in a secure location until needed. Start the test session the day of the scheduled session. Use the Examiner’s/ Proctor’s Test Booklet/ Test Ticket Transmittal Form/ Affidavit to distribute and collect test tickets and materials to examiners. Provide Examiners extra copies of the formula sheets and the Periodic Table of the Elements, where applicable. Ensure that all examiners/ proctors have allowable test manipulatives. (Refer to instructions in TIM and Examiner Manual for clearing calculator memory.)

53. More Reminders... Section Breaks– Some tests have two sections, and a seal code must be used for the next section.  Grade 3 Reading (2 Days)  Grades 4 – 5 Mathematics (2 Days): - Section 1 – NON-calculator - Section 2 – 4-function calculator  Grades 6 – 7 Mathematics (1 Day): - Section 1 – NON-calculator - Section 2 – Scientific calculator

54. More reminders... View the status of each test session through Session Details screen (Ready, Active, Exited, Resumed, Resumed- Upload, Submitted, Processing, Completed, Marked Complete). Add, move, and remove students from test sessions, as needed. Students who are absent on the day of testing must be removed/moved from the session before it can be stopped. Stop all online test sessions at the end of the day. All students must show a Completed status on the Session Details screen. Any students with a Not Started, Exited, or Resume status must be removed/ moved to a make-up or irregularity session before stopping the test session.

55. More reminders... Moving a student: If students are moved to an alternate testing site to complete their tests, their Student Authorization tickets must be collected by the Examiner or Proctor prior to the move and redistributed only after the students are settled in the new location. While in transit, students must not be allowed to discuss the test with anyone or have access to educational materials. Their online test must be Exited prior to being moved to the new location. Before the student can log in (using the same information on the test ticket) to complete their test, the student’s test must be Resumed in Test Session Management.

56. Testing Irregularities Report any irregularities within 24 hours. MOST Common Irregularities: #1 - Student unable to complete test #2 - Accommodation not provided or inappropriate accommodation provided #3 - Test inappropriately marked complete #4 – Wrong test #5 - Inappropriate manipulative

57. Marking Tests Complete Mark test complete guidelines: Every student identified for testing must be accounted for via an online test or a paper document, including students who were not tested because they:  Were exempt due to LEP  Were absent during the entire testing window  Refused or were disruptive  Parent refusal  Cheated  Were involved in a medical emergency  Failed the course but passed the test and are retaking the course  Took a substitute test for verified credit Move these students to a new session and the DDOT will mark these tests complete at the conclusion of testing.

58. Other reminders... Testing Accommodations: Add Test-Specific data in PearsonAccess to indicate what accommodations were provided to the student under the Test Details screen of PearsonAccess. (Temporary Accommodations may be handled through the upload or under Student Registration.) Student Alerts: Clear all student alerts for the school, when possible. Ask if there are questions related to alerts. Be sure that the RETEST flag is selected on the Test Assignment screen for every student who is retaking the test for verified credit.

59. Other reminders... Testing Accommodations: Add Test-Specific data in PearsonAccess to indicate what accommodations were provided to the student under the Test Details screen of PearsonAccess. (Temporary Accommodations may be handled through the upload or under Student Registration.) Student Alerts: Clear all student alerts for the school, when possible. Ask if there are questions related to alerts. Be sure that the RETEST flag is selected on the Test Assignment screen for every student who is retaking the test for verified credit.

60. High School Only: Substitute Tests: If a student is enrolled for the first time in a course that requires an EOC test and has taken or will take an approved substitute test in place of the EOC tests, include in upload and select Testing Status code 10. If a student has failed an EOC test and takes an approved substitute test as a retest in an attempt to earn a verified credit, complete Testing Status code 10 AND set Retest flag to Y. Read-aloud/Audio for Reading: Under certain circumstances an LEP student or a student with a disability may receive the read-aloud or the audio accommodation on the EOC Reading test even though the student has not been determined as eligible based on criteria for read-aloud tests.

61. Questions?