1. PRESENTED BY: STEPHANIE E. HASKINS OCTOBER 9, 2013 Fall 2013 Writing SOL Training

2. Training Agenda Fall 2013 Writing Timeline Testing and Curriculum Resources Student Registration & Test Assignments Online Writing: A Student’s View in TestNav ™ Special Test Accommodations Role of Examiners Reminders for Testing Coordinators Questions - 2 -

3. Testing Resources Test Implementation Manual:  Page iii: What’s New?  Page xv: Checklist of STC Responsibilities  Pages 16-17: Online Tools, Icons, Descriptions  Pages 29-31: Responding to Student Questions  Appendix A: Test Security  Appendix C: Special Test Accommodations (page 87)  Appendix D: Table of Testing Accommodations (page 94)

4. Resources School Test Coordinator Handbook Student Data Upload File Requirements Test Implementation Manual Supplement to Test Implementation Manual Examiner’s Manual Pearson Access User’s Guide for the Virginia Assessment Program Virginia Standards of Learning Assessments Guidelines for Administering the Read-Aloud Accommodation

5. Curriculum Resources www.doe.virginia.gov/testing/sol/standards_docs/english/2010/ online_writing/index.shtml www.doe.virginia.gov/testing/sol/standards_docs/english/2010/ online_writing/index.shtml SOL Writing Test Blueprint and Rubric SOL Writing Test Prompts Writing Practice Tools and Guides Writing MC/ TEI Practice Items and Guides Checklists for Writers http://www.doe.virginia.gov/testing/sol/standards_docs/english /index.shtml http://www.doe.virginia.gov/testing/sol/standards_docs/english /index.shtml Standards and Framework Released Tests www.staunton.k12.va.us SOL Writing Rubric http://www.perspectiveforeducators.com/va Writing Scoring (Password is: Virginia)

6. Other WRITING Testing Updates: Same released prompts will be used for Fall 2013 testing (Refer to VDOE website). End-of- course prompts will be added after Fall 2013 testing. (No other grade levels will have prompts added.) NEW Understanding Scoring Tab of Perspective website provides anchor papers, practice papers, and verification sets. In addition to classroom use, this site could also be shared with parents for at home use. Refer to Testing Memo #1062: Strategies for Addressing Potential Scenarios during Online Writing Test Sessions.

7. Testing Timeline DateEvent Week of Sept 16Non-secure Testing Materials Arrive ASAPList of retesters and standard year October 16Data Upload File Due to DDOT October 17Secure material delivery October 21 & 22Paper/pencil and online multiple-choice October 23* & 24Paper/pencil* and online prompt November 6Last Day to Return Materials January 13 & 142 nd opportunity online Writing test

8. Testing Upload Group Name: Consider how you want score reports to be organized. Group code: Will NOT appear on printed reports; allows for data sorts; Max 10 characters Test code: MUST double-check at high school. (EOC112-online; EOC002-paper) Ethnicity/ Race: Hispanic; 32 categories ELL information: Test tier, composite, literacy, SOA-LEP, AYP-D SOA Transfer: Enrolled after 20 th day – Sept 19 th or after AYP: If a student began school ANY day AFTER the first day AND was NOT in our division last year, can be coded as AYP. May disregard reference to “September 30”.  A: within division  B: outside division/ within Virginia  C: outside Virginia Term grad: Generates two pre-ID labels and qualifies for 2 nd attempt Project Graduation: High school only – Refer to definition in TIMS RP-Code: Genesis Retest: High school only – if retaking test Recovery: Reading or Math only; Check if student has received 10+hours of remediation D-Code: High school only – if pursuing modified standard diploma (needs literacy/ numeracy requirements) Online Test: Students NOT marked as online should have documented need OR be taking 2002 test (For retesters, double-check YEAR of previous Writing test) Additions in RED andDeletions in RED

9. A student must complete the writing test all in paper/pencil OR all online.

10. Paper vs. Online Students who meet one or more of following criteria may be assigned a paper/pencil test: Placement: Special situation school, homebound, Governor’s school Accommodation requires paper/pencil: large-print, Braille, flexible schedule (multiple testing sessions requiring more than one day) Documented medical condition: Exposure to computer will aggravate condition (i.e. seizure disorder, etc.) ** For Writing, any student retesting with 2002 Standards **

11. Materials Paper/Pencil Multiple-choice Pencil Scratch paper Short paper Pencil Scratch paper Dictionary (Highlighter or pen of 1 color, as needed) Online Multiple-choice Pencil Scratch paper Short paper Pencil Scratch paper (Highlighter or pen of 1 color, as needed)

12. Paper Writing Tests If administering EOC Writing (2010) tests in paper/pencil: Section K must be completed on the answer document to ensure proper scoring:

13. Online Writing Tests: How Creating test sessions for online SOL Writing tests: One difference in test session management when administering online writing: Unlike a non-writing test administration – One online SOL Writing test assignment will allow a DDOT or STC to add that student to two sessions A session for the short paper component A session for the multiple-choice/TEI component Student must complete both components to have a complete, scorable writing test A student MUST complete both components in the same mode

14. Online Writing Tests: How Creating an online Writing Test Session

15. Online Writing Tests: How Creating an online Writing Test Session (continued)

16. Online Writing Tests: How

19. In a writing test administration, the two components (MC/TEI and short paper component) will show individually on the Student Test Details screen for an online SOL Writing test.

20. Online Writing Tests: How Certain details about each component (MC/TEI and short paper components) will show individually on the Student Test Details screen for an online SOL Writing test.

21. Online Writing Tests: How Special test accommodations will be recorded on the Student Test Details screen for each component of the writing test. If the same accommodation is used on both components, it is coded only once.

22. Online SOL Writing Test: A Student’s Perspective TestNav Login Screen

23. Sample Screen This appears after the student successfully logs in.

24. The sample screen is a picture of the Student Response Area that the Examiner refers to in the test directions read to students for the Short Paper component. Students are not able to type in the sample screen. The tools on the TestNav Toolbar on the sample screen ARE active. The Student Response Area and the Response Tools are NOT active on the sample screen.

25. Exhibit Window from the Sample Screen Includes 4 different tabs The text “SAMPLE PROMPT” appears on the first tab of the Exhibit Window when the student is on the Sample screen.

26. Exhibit Window from the Sample Screen Window can be resized

27. Exhibit Window from the Sample Screen The Checklist for Writers is on the 2 nd Tab

28. Exhibit Window from the Sample Screen The Shortcut Keys are shown on the 3rd Tab

29. Exhibit Window from the Sample Screen Copyright Statement is shown on the 4th Tab (This does not appear after the Sample screen.)

30. Student Response Screen: Appears after the Sample Screen

31. Exhibit Window from the Student Response Screen Three tabs (Prompt, Checklist for Writers, Shortcut Keys) The SOL Writing Prompt will appear on the first tab of the Exhibit Window when the student opens it while on the Short Paper screen. The tabs with the Checklist for Writers and Shortcut Keys are also active.

32. Test Nav Layout

33. Special Test Accommodations Writing (2002) and Writing (2010) tests Review Appendices C & D for specific details regarding the use of special test accommodations in paper and online writing tests. Examples of test accommodations described with additional details (including scenarios, required procedures, etc.) include but are not limited to: Dictation to a Scribe Dictation in English to a Scribe English Dictionary, Bilingual Dictionary Spelling Aids Word Prediction Software Word Processor, Word Processor with Speech-to Text, Typewriter

34. Special Test Accommodations Questions and Answers Q: If there is a student who, based on physical disability, is unable to type (but is able to write) the writing prompt, will it be allowed for an adult to "transcribe" by typing his written response into the computer? A: The adult is allowed to transcribe the student’s written response into the computer for the student, however the student’s written response and what is typed into the computer must be verified by a second school staff member to ensure that no errors occurred in the transcription. Additionally, the student’s written response must be retained on file and secure in your office until scores are received and verified. Q: Is Dragon Dictation on the iPad an allowable recording device? A: Yes, this is allowable under the conditions that Guided Access in used on the iPAD. Guide Access allows the examiner to give the test taker access to only one application on the IPAD. If you are considering this for a student who will be participating in the Writing Test, please submit a Special Accommodation Request so that we can formally approve and provide all administration conditions. Q: Is Co-Writer considered an acceptable "word prediction software"? A: Yes, Co-Writer is acceptable word prediction software. Features must comply with the Word Prediction Software described in the Procedures for the Participation of Students with Disabilities in Virginia Accountability System, p. 27.

35. Use of the English Dictionary and Bilingual Dictionary on the 2010 and 2002 Standards of Learning (SOL) Writing Test Components Notes: 1 This test accommodation is not permitted in either online or paper mode. 2 This test accommodation is permitted, and must be documented in the student’s IEP or 504 Plan. Use accommodation code 29. 3 This test accommodation is permitted, and must be documented in the LEP Student Assessment Participation Plan. Use accommodation code 29. 4 This test manipulative is available to all students. Do not enter an accommodation code for this manipulative. 5 This test accommodation is permitted for LEP students only, and must be documented in the LEP Student Assessment Participation Plan, use accommodation code 17.

36. Special Test Accommodations: Online Writing (2010) Audio Test Audio on the online Multiple-Choice/TEI component Assign the audio form to the student in the online test session Audio player appears in the lower right of the screen on the first test question, after the sample item(s) Same format as non-writing audio tests – starts to play automatically as the student navigates to each test item Audio on the online Short Paper component Assign the audio form to the student in the online short paper test session Audio of the prompt will not begin until student clicks “Play” button

37. Audio Symbols for Tests

38. NOTE: Read-aloud CANNOT be created for short-paper test. The session must be created as a “regular” test session. ALL students may have prompt read to them.

39. Special Test Accommodations Online Writing (2010) Audio Short Paper Component Audio of the prompt will not begin until the student clicks the “Play” button

40. Test Security Agreement READ all Test Security Agreement prior to signing and administering any SOL assessment.

41. Role of Examiners/ Proctors During test administration, Examiners/Proctors must monitor the testing process by moving as unobtrusively as possible about the room. They should ensure that students are working independently and do not have access to unauthorized materials.

42. Answering Student Questions Examiners/ Proctors MAY answer questions regarding technical issues of the assessment. They may NOT answer questions that would provide any hint or clue with regard to the assessment.

43. Examples of Technical Questions Scrolling: “To view all of the reading passage, use the scroll bar to the right of the passage to move the page up and down.” Navigating the test: “To move to the next question click Next”; “To go back to the previous question click Previous”; “To go back to a question from the review screen click on the question’s number”; “To submit your test click the Submit the test button”; “Go back to the test item to make sure the Pointer was used to indicate the answer.” NOTE: Examiners/ Proctors may NOT use the student’s mouse or keyboard to navigate any portion of the test for the student.

44. FAQs When a student has completed testing can the test examiner scroll down the review screen (look over the student’s answer section on the answer document) and make sure the student has an answer for every question? No. The examiner must not touch the student’s mouse (avoid the appearance of providing assistance). The Examiner may only tell the student to “read the screen carefully” (online) or to “review the answer document carefully” (paper).

45. FAQs We are concerned that our students might select the wrong button to submit their tests. Can the examiner submit the test for the student? No. The examiner must not touch the student’s mouse (avoid the appearance of providing assistance). Directions in the Examiner’s Manual state, when students are ready to submit their tests for scoring, they raise their hands. The Examiner gives permission to the student to submit and may say, “to submit your test click on the 3 rd button which says Submit the test.”

46. FAQs If the student does not remember how to use one of the tools, can the examiner show the student how to operate the tool? No. The examiner may say, “for help with a tool, click on the help icon (life preserver) on the tool bar.”

47. FAQs Can staff and students get practice with the various functions on a test before live testing? YES! Students and staff may practice the login process, using tools, navigation, and submitting tests by taking a Training Center Test. Students who have the audio accommodation may practice the audio controls also by taking the Training Center Test in audio format. Look for Applications for Test Preparation in the TIM and Examiner’s Manuals for several other applications to help students.

48. FAQs Can examiners condense the directions on tests with seal codes, including part 2 directions with part 1? No, examiners may not change or shorten the directions. The directions must be read as they are printed in order to maintain a standardized test environment.

49. FAQs If an examiner observes a student not writing to the prompt, can he or she tell the student to read the prompt and make sure you are writing to it? No, they cannot address individual students. The examiner can remind the entire class to “Read the topic carefully and write a short paper about it.”

50. FAQs Are parents or students permitted to have a copy of their child’s short paper after scoring is complete? Yes. Parents may not have the un-released prompt however, just the student’s response to the prompt. Students cannot request the paper, the parent has to request it.

51. FAQs Can a student’s parent sit in the testing room with their child during testing? No, only test examiners/proctors and staff that are essential to testing (all of which have been trained and have signed the test security agreement) are permitted in the secure testing environment.

52. FAQs Can a teacher review a new test to get a feel for the type of questions that are being asked? No, this is what released test items and practice items can be used for.  Anticipated Released Tests Schedule for the “new” SOL  History/Social Science (2008 SOL) Spring 2013  Mathematics (2009 SOL) Spring 2014  Reading (2010 SOL) Spring 2015  Science (2010 SOL) Spring 2015

53. FAQs While testing: Can I write notes of encouragement and put them on students’ desks, or can I verbally encourage students to do their best on the test, or pat them on the back to show support, etc.? No, none of this is permissible during the test session. These actions can give the appearance of inappropriate assistance and can result in an investigation and possible retesting.

54. STC Reminders... Proctor Authorization Tickets and Student Authorization Tickets – These tickets should be printed no more than 4 days prior to the test window start date and must be stored in a secure location until needed. Start the test session the day of the scheduled session. Use the Examiner’s/ Proctor’s Test Booklet/ Test Ticket Transmittal Form/ Affidavit to distribute and collect test tickets and materials to examiners. Provide Examiners extra copies of the formula sheets and the Periodic Table of the Elements, where applicable. Ensure that all examiners/ proctors have allowable test manipulatives. (Refer to instructions in TIM and Examiner Manual for clearing calculator memory.)

55. More reminders... View the status of each test session through Session Details screen (Ready, Active, Exited, Resumed, Resumed- Upload, Submitted, Processing, Completed, Marked Complete). Add, move, and remove students from test sessions, as needed. Students who are absent on the day of testing must be removed/moved from the session before it can be stopped. Stop all online test sessions at the end of the day. All students must show a Completed status on the Session Details screen. Any students with a Not Started, Exited, or Resume status must be removed/ moved to a make-up or irregularity session before stopping the test session.

56. More reminders... Moving a student: If students are moved to an alternate testing site to complete their tests, their Student Authorization tickets must be collected by the Examiner or Proctor prior to the move and redistributed only after the students are settled in the new location. While in transit, students must not be allowed to discuss the test with anyone or have access to educational materials. Their online test must be Exited prior to being moved to the new location. Before the student can log in (using the same information on the test ticket) to complete their test, the student’s test must be Resumed in Test Session Management.

57. Testing Irregularities Report any irregularities within 24 hours. MOST Common Irregularities: #1 - Student unable to complete test #2 - Accommodation not provided or inappropriate accommodation provided #3 - Test inappropriately marked complete #4 - Inappropriate manipulative

58. Marking Tests Complete Mark test complete guidelines: Every student identified for testing must be accounted for via an online test or a paper document, including students who were not tested because they:  Were exempt due to LEP  Were absent during the entire testing window  Refused or were disruptive  Cheated  Were involved in a medical emergency  Failed the course but passed the test and are retaking the course  Took a substitute test for verified credit Move these students to a new session and the DDOT will mark these tests complete at the conclusion of testing.

59. Other reminders... Testing Accommodations: Add Test-Specific data in PearsonAccess to indicate what accommodations were provided to the student under the Test Details screen of PearsonAccess. (Temporary Accommodations may be handled through the upload or under Student Registration.) Student Alerts: Clear all student alerts for the school, when possible. Ask if there are questions related to alerts. Be sure that the RETEST flag is selected on the Test Assignment screen for every student who is retaking the test for verified credit.

60. Test Alerts and Reporting Must have both components completed in the same mode to be reported as a complete test New alerts will be used such as: Unmatched Test Component – Either the online short paper or online MC/TEI component is not complete Additional details to be provided regarding Student Test Alerts and Accessing Score Reports - 60 -

61. Questions?