County Test Coordinators County Technology Coordinators WRITING ASSESSMENT TRAINING January 16, 2007

West Virginia Board of Education Policy 2340, West Virginia Measures of Academic Progress (WV-MAP) Sandra Starr, Coordinator Office of Assessment and Accountability

§ Definitions (pp. 1-8) Revisions include clarification of existing definitions, i.e. Examiner additions of definitions necessary to update assessment expansions and revisions to testing security deletions of obsolete definitions

§ Program Regulations (pp. 8-10) Revisions include Further clarifications of existing assessment program regulations, i.e. private and parochial, Building Level Coordinator additions of regulations for programs new to WV-MAP, i.e. APTA deletions of regulations for inactive programs, i.e. Alternate Assessment

§ Administration Regulations (pp ) Revisions include clarification of existing assessment administration regulations Examiner (5.3.3 on p. 11) Building Level Coordinator (5.3.5 on p. 11) breach protocol ( on p. 12)

§ Reporting Regulations (pp ) Revisions include clarification of existing language addition of CD, DVD, Web-based, or other digital media reporting options

§ Test Security (pp ) Revisions include clarifications of existing language, security procedures, test administrators and Examiners roles additions of Building Level Coordinator (7.4.1 on p. 14) and breach protocol (7.7 on p. 15) changes to all existing and/or additions of Secure Materials and Test Security Agreements

§ Investigation of Alleged Breach of Testing Security/Copyright Infringement (pp ) Revisions include clarification of investigation process/procedures actionable behaviors

Appendix A Testing Code of Ethics No major revisions Addition of test preparation practices

Appendix B County Test Coordinator's Secure Materials and Test Procedures Agreement Format change to document itself Addition of Building Level Coordinator Clarification of responsibilities, i.e. trainings

Appendix C Principal's Secure Materials and Test Procedures Agreement Format change to document itself Addition of Building Level Coordinator (#14) Clarification of responsibilities, i.e. trainings

Appendix D Building Level Coordinator's/Assistant Building Level Coordinators Secure Materials and Test Procedures Agreement (Other than Principal) New agreement Responsibilities same as Principals except document states that BLC reports to/responsible to/when assigned by Principal

Appendix E Examiners/Proctors/Scribes Secure Materials and Test Procedures Agreement Format change to document itself Additions of specific testing situations (IEP/504/LEP, on-line, APTA) Clarification of responsibilities, i.e. trainings

Appendix F County/School Personnel Secure Materials Agreement New agreement Clarifies responsibilities for personnel handling but not administering secure test materials Requires training but not in test administration

Appendix G Verification of Training for Principals, Building Level Coordinators, County/School, RESA Personnel (Examiners/Proctors /Scribes/Other School Personnel) New document Use/File each time a training is conducted ONLY proof of training

Questions? Thank you! You may access Policy 2340 at

West Virginia Writing Assessment Grades 4, 7 and 10 Sandra Foster, Coordinator Jason Perdue, Coordinator

Notebook 2006 Results (Tab 2) 4 th, 7 th, and 10 th Grades 2007 –Grades 7 and 10 – Online (Tab 3) Testing Window VanGuard 3.1 Installation and Important Dates County Testing Windows Administration Manual 2007 – Grade 4 -- Handwritten (Tab 4) Administration Manual Writing Roadmap 2.0 (Tab 5) Quick Reference Administrator Guide Quick Reference Teacher Guide Parent Guides (back pocket) 4 th Grade 7 th & 10 th Grades

2006 Administration 45,000 seventh and tenth grade students assessed Four-week testing window Timely delivery of results/reports

2006 Challenges -- Schools Bandwidth – connectivity Number of labs/computers Computer classes in labs Security updates and patches Windows 2000/XP Deep Freeze and Fortress

2006 Responses POSITIVE Word processed Untimed Reports Turn around time NEGATIVE Connectivity Losing essays

Moving on

GENERAL GUIDELINES 4 th 7 th and 10 th Administered to all students excluding APTA students Appropriate Secure Materials and Test Procedures Agreements must be on file No time limit Acceptable Use of the Internet Form must be on file (7 th and 10 th )

Irregularities Resulting in Investigations: Inadequate training CTCs, Principals/Building Level Coordinators, Examiners Mishandling of testing materials Trained examiners/staff Assisting students with content with typing/word processing with errors Copying or keeping testing materials photocopies rough drafts

2007 Online Writing Assessment Grades 7 and 10 (Tab 3)

2007 Testing Window 10 th Grade February 26 – March 9, th Grade March 12 – March 23, 2007

Installing VanGuard 3.1 INSTALLATION: Close open windows Go to VanGuard website Save file to desktop Double click on the vanguard 3.1.exe icon on desktop Follow the WinZip Self-Extractor - vanguard v3.1.exe instructions REGISTRATION CODE: EXIT PASSWORD: 1ctb Related Documents

Important Dates -- WVDE and CTCs Delivery of Student WVEIS File File to CTCs January 9 – 12, 2007 Corrected file posted to Writing Assessment Website January 17, 2007 Delivery of Usernames/Passwords Cards to CTCs February 9 – 12, 2007 Cards to schools February 12 – 23, 2007

2007 Testing Window Follow countys schedule Conduct make-up sessions during countys testing window

Updating Student Information Student information must be updated online Schools are expected to make all additions, deletions, and updates using the Writing Assessment Website: /

Choose one of the two options or close the webpage

Directions for Administering the Online Writing Assessment PowerPoint and Script (pp. 17 – 23) Enter through VanGuard Directed to the Writing Roadmap login page Log in using unique user name and password Work on a secured desktop Access to a writers checklist and the WV rubric

VanGuard Log In

Student Log-in Screen

Student Main Menu

Prompt Selection Return To Class Listing

Prompt Confirmation

Instruction Screen

Checklist SAVE

West Virginia Rubric

Essay Submission SAVE

West Virginia > Barbour Elementary > Student: Brenda West

Post Submission Confirmation Screen 12/21/04 3:59 PMAssignment Date: 12/21/04 3:59 PMReport Date: Barbour CountyCounty:SevenStudent Grade Kennedy Middle SchoolSchool: Student Number: JoAnne EddeTeacherBrenda WestStudent Name: Prompt Name: Grade 7, Informative/Expository, A Good Deed

Nonscorable Essays 1.Too Short 2.Off Topic 3.Repetitious 4.Insufficient Development 5.Unknown Words 6.Bad Syntax/Incoherent 7.Copied Question

Frequently Asked Questions Q. Why cant my student logon? Q. What if a student is listed in the wrong school/county? Q. What if a student cannot write an essay? Q. What if there are no essay units available? Q. What if the system says that a student is not in a class?

Inform school administrators of dates and testing schedules Provide training Signing of appropriate Secure Materials and Test Procedures Agreement Prepare school packets Serve as contact with Office of Assessment and Accountability Responsibilities of the County Test Coordinator:

Provide Information to schools/parents/students Distribute Parent Guides Train Examiners Deliver manuals/materials Deliver student usernames and passwords Inform Office of Assessment and Accountability of testing irregularities Participate in WVDE investigations

Insure that computers are in good working order Security updates/patches Install/update VanGuard security Insure students have on file Acceptable Use of the Internet Form Responsibilities of the County Technology Coordinator:

Responsibilities of the Principal/Building Level Coordinator: Be trained prior to test administration Have on file appropriate documentation Inform examiners/students/parents Parent Guides/Letters Schedule according to county window Schedule labs/classes

Responsibilities of the Principal/Building Level Coordinator: Train examiners Obtain signatures for the appropriate Secure Materials and Test Procedures Agreement Distribute manuals/materials Prepare class rosters Deliver materials Username and password cards Scratch paper/pencils

Responsibilities of the Principal/Building Level Coordinator: Check computers Monitor for irregularities Collect and destroy rough drafts

Characteristics of the Examiner Competent Comfortable with technology Positive attitude Effective atmosphere

Responsibility of the Examiner Meet the criteria for administering WV-MAP Follow test administration procedures Prepare students prior to testing Review manual Become familiar with directions

Responsibilities of the Examiner Demonstrate the process via the PowerPoint presentation Check usernames with roster Monitor during testing Enter exiting password – 1ctb Collect rough drafts – deliver to principal

Accommodations IEPs Section 504 Plans LEP Students

Request for Additional Accommodations for Students with IEPs, Section 504 Plans, or LEP Students Requested by county personnel Received by February 23

Transcribing -- Directions for Scribes Meet Examiner criteria Follow guidelines Complete Scribe Verification Form

Students -- Not in Daily Attendance Home-Schooled Homebound Alternative Schools Private/Parochial Schools

2007 Writing Assessment Grade 4 (Tab 4)

2007 Testing Window 4 th Grade February 26 – March 2, 2007

Student Answer Sheets Delivered to Principal/Building Level Coordinator Day of testing Delivered to County Test Coordinators March 9, 2007 Standards Committee Members select sample papers March 12 – 16, 2007 Delivered to Office of Assessment and Accountability March 23, 2007

GENERAL GUIDELINES All county schools test on same day Not a timed assessment Secure prompt No teacher-prepared graphic organizers No copying of essays Destroy scratch paper and rough drafts

Responsibilities of the 4 th Grade Examiner Become familiar with directions/manual Prepare students prior to testing session Follow prepared script Monitor during testing Collect rough drafts – deliver to principal

Responsibilities of the 4 th Grade Examiner Complete answer sheets that are not pre- slugged Prepare answer sheets for scoring and delivery to Charleston Complete (if necessary) Scribe Verification Form Irregularity Form

Transcribing -- Directions for Scribes Meet Examiner criteria Follow guidelines Complete Scribe Verification Form IEP/504 LEP Short Term Medical Condition

Writing Roadmap 2.0 Updates Quick Reference Administrator Guide Quick Reference Teacher Guide

Writing Roadmap 2.0 Transferring Students Search by WVEIS Search by student name

Writing Roadmap 2.0 Support/Contact Information CTB/McGraw-Hill Technical Support Staff WVDE Office of Assessment and Accountability Sandra Foster, Coordinator Jason Perdue, Coordinator Kris Smith, Secretary

Support/Contact Information West Virginia Department of Education Office of Assessment and Accountability Brenda West, Asst. Director Sandra Foster, Coordinator Jason Perdue, Coordinator

Support/Contact Information CTB/McGraw-Hill Online Support Kimberly Block Online Program Manager ( ) Marci Krause Online Support Manager ( ) CTB/McGraw-Hill Product Information Lynn Hunley Sr. Evaluation Consultant ( )

KEY WEB ADDRESSES West Virginia Department of Education Office of Assessment and Accountability Writing Assessment CTB/McGraw-Hill Writing Roadmap 2.0