Virginia Substitute Evaluation Program The Program Process

New Training Format Web Conference format replaces concurrent sessions in the regional face-to-face workshops. Web Conference format is a pilot. Feedback and evaluation is necessary to assess the effectiveness of the Web Conference format.

Virginia Substitute Evaluation Program Web Conference Schedule Session 1- September 16, 2009 9:30am- 11am. Session 2- September 16, 2009 2:00pm- 3:30pm. Session 3- September 23, 2009 9:30am-11:00am.

During this Web Conference Your phone has been muted. Type your questions into the chat window and send to Host and Presenter. Time will be allotted throughout the presentation to answer your questions.

Web Conference Housekeeping You will need a copy of the VSEP Implementation Manual 2009-2010. This manual is available on the Virginia Department Of Education website at http://www.doe.virginia.gov/VDOE/Assessment/home.shtml.

Purpose of this Training To update Division Directors of Testing, Special Education Directors, and instructional leaders on program procedures for the Virginia Substitute Evaluation Program (VSEP).

Web Conference Topics Overall Program Description Participation Criteria and Review Submission Procedures Evaluation Plan Resubmission and Appeal Process Manuals and Forms VSEP Program Dates

Virginia Substitute Evaluation Program The Virginia Substitute Evaluation Program (VSEP) is an alternative method of assessing students who by the nature of their disability are unable to access the regular Standards of Learning (SOL) assessment even with testing accommodations. VSEP Implementation Manual 2009-2010, p 1.

Virginia Substitute Evaluation Program The VSEP is available to students with disabilities who are enrolled in end-of-course SOL assessment classes and students who need the grade 8 numeracy and literacy certification required to earn a Modified Standard Diploma. VSEP Implementation Manual 2009-2010, p 1.

End-Of-Course Evaluated Content Areas English: Writing English: Reading Algebra I Algebra II Geometry Biology Earth Science Chemistry Virginia and United States History World History I World History II World Geography English: Reading (1995) has been removed for this assessment.

Grade 8 Requirements for Modified Standard Diploma Reading (literacy assessment) Reading (literacy cumulative: 2009-2010 will be the last administration of this test.) Mathematics (numeracy assessment) Mathematics (numeracy cumulative: 2009-2010 will the last administration of this test.)

Participation Criteria And Review

Participation Criteria and Review The student must have a current IEP or 504 plan (or one being developed). The student must be enrolled in a course or have passed a course that has an SOL EOC test and/or the student must meet the literacy and numeracy certification to earn a Modified Standard Diploma. VSEP Implementation Manual 2009-2010, p 5.

Participation Criteria and Review All accommodations on the SOL test must have been considered for use with the student in the course/content submission area. The impact of the student’s disability demonstrates to the IEP team or 504 committee that the student will not be able to access the SOL assessment even with accommodations and therefore requires an alternative evaluation. VSEP Implementation Manual 2009-2010, p 5.

VSEP 2008 - 2009 Participation Review 306 students participated representing 329 course work compilations 24 EOC English: Reading 18 EOC English: Writing 65 Algebra I 20 Geometry 21 Earth Science 20 Biology

VSEP 2008 - 2009 Participation Review (cont) 2 Chemistry 12 VA & US History 32 World History I 3 World History II 23 World Geography 36 Literacy 53 Numeracy

VSEP 2008 - 2009 Performance Review Issues identified in scoring resulting in lower scores Inadequate anecdotal records Ungraded work Work completed with open-book Inconsistent accuracy in work samples

Submission Procedures

Submission Procedures If IEP team or 504 committee determines that a student meets the criteria for participation in VSEP for a specific SOL assessment, the Intent to Submit a Substitute Evaluation form is completed. A complete Intent to Submit package includes: Intent to Submit Evaluation Form Allowed Accommodations Justification Statement Evaluation Plan Submission Form Evaluation Plan/Worksheets (for the specific content area) Evaluation Plan Approval/Denial Form

Submission Procedures Once the Intent to Submit form has been completed, the student’s course content teacher and special education teacher are responsible for completing the Evaluation Plan Submission Form. The Intent to Submit Substitute Evaluation form, Evaluation Plan Submission Form and Evaluation Worksheets are submitted to a building administrator or designee. VSEP Implementation Manual 2009-2010, p 7.

Submission Procedures Building Administrator reviews and signs the plan before submitting to the Division Director of Testing (DDOT). The DDOT reviews and signs the plan before submitting to the Virginia Department of Education, Division of Student Assessment and School Improvement. VSEP Implementation Manual 2009-2010, p 7.

Submission Procedures Each Intent to Submit Evaluation Form and Evaluation Plan Submission Form will be reviewed by Virginia Department of Education staff using the rubric in Appendix D (pg.32-33 in your manual) and returned to the school division within ten business days from receipt. A separate Intent to Submit a Substitute Evaluation Form is required for each content area assessed. Turn to page 23 in your manual.

Intent to Submit a Substitute Evaluation Form This form documents that the student meets the VSEP participation criteria. The form is completed and signed by the student’s IEP team or 504 committee. NEW FOR THIS YEAR… Late submission of an Intent to Submit a Substitute Evaluation Form and Evaluation Plan Submission will be approved ONLY is there are extenuating circumstances. VSEP Implementation Manual 2009-2010, p 23

Intent to Submit a Substitute Evaluation Form cont. Section III: Allowed Accommodations Accommodations listed below have been added to the Allowed Accommodations form. Small Group Testing Test administered in locations with minimal distractions Noise buffers Plain English Version VSEP Implementation Manual 2009-2010, p 24-25

Intent to Submit A Substitute Evaluation Form Section IV: Justification Statement Brief Overview of the student’s disability Impact of the disability on the student’s classroom performance Accommodations that have been used in classroom, division, or state assessments, and impact on the student’s performance. Page 27 Appendix B, gives sample justification statements for you to reference. VSEP Implementation Manual 2009-2010, p 26

Evaluation Plan Submission Form Evaluation Plan/Worksheet This form provides information about the participating student and school division. This form describes the assessment evidence planned to demonstrate the student’s individual achievement for each SOL on the test blueprint. VSEP Implementation Manual 2009-2010, p 28-31

Evaluation Plan Approval/Denial Form The Approval/Denial form indicates the Virginia Department of Education’s response to the submission of the Intent to Submit a Substitute Evaluation Form and Evaluation Plan Submission Form.

Overall Program Participation Criteria Submission Procedures Questions???? Overall Program Participation Criteria Submission Procedures

Evaluation Plan Submission Form Evaluation Plan Worksheet

Evaluation Plan Submission Form The Evaluation Plan Submission Form identifies student and school division information. NEW THIS YEAR……. The Evaluation Plan Submission Form include the signatures of the Building Administrator and the Division Director of Testing. VSEP Implementation Manual 2009-2010, p 7 and p 28-31.

Evaluation Plan/Worksheet The Evaluation Plan/Worksheet should address the evidence planned for the Course Work Compilation (CWC) over the duration of the course. The Evaluation Plan/Worksheet should reflect a complete demonstration of the skills and knowledge related to the standards addressed in the test blueprint. VSEP Implementation Manual 2009-2010, p 7and p 28-31.

Evaluation Plan/Worksheet Pertinent Points Each SOL stem and bullet should be addressed in this plan. The plan should contain the methods or products used to demonstrate achievement of the standards. Submit one copy with the Evaluation Plan Submission Form. Use your copy to monitor the CWC throughout the semester. VSEP Implementation Manual 2009-2010, p 29

Evaluation Plan/Worksheet The special education teacher and course content teacher are responsible for completing the Evaluation Plan/Worksheet and should work collaboratively in addressing each standard in the test blueprint for the assessed content area. Methods or products planned for the student to demonstrate achievement of each standard should be included in the Evaluation Plan/Worksheet. VSEP Implementation Manual 2009-2010, p 7and p 29.

Evaluation Plan/Worksheet The Evaluation Plan/Worksheet should be unique and individualized for the student. Consider the following when completing the evaluation plan/worksheet The student’s disability How the student accesses SOL content How the student demonstrates skills and knowledge; and Specific assessment methods or products for each SOL stem and bullet.

Examples

Don’t Do That…… G.7 The student will solve practical problems involving right triangles by using the Pythagorean Theorem, properties of special right triangles, and right triangle trigonometry. Solutions will be expressed in radical form or as decimal approximations. Classwork, Homework, Quizzes, and Test.

But Do This…… G.7 The student will solve practical problems involving right triangles by using the Pythagorean Theorem, properties of special right triangles, and right triangle trigonometry. Solutions will be expressed in radical form or as decimal approximations. Students will solve 5 different practical problems involving properties of right triangles including the use of the Pythagorean theorem, right triangle trigonometry, and specials right triangles. Two problems will be word problems that require the student to create diagrams. The other 3 problems will be labeled diagrams and the student must find missing measurements.

Don’t Do This…….. 9.5 The student will read dramatic selections. c. Describe how stage directions help the reader understand a play’s setting, mood, characters, plot, and theme. Julius Caesar i-movie

But Do This…… 9.5 The student will read dramatic selections. c. Describe how stage directions help the reader understand a play’s setting, mood, characters, plot, and theme. While reading The Crucible, the student will complete a graphic organizer that uses stage directions to identify setting, mood, characters, plot and theme.

Appeals Process Resubmission Process

Appeals Process The purpose of the appeal process is to ensure the assigned score to the student’s Course Work Compilation (CWC) is a true depiction of the student’s achievement. School divisions may request that a student’s CWC be appealed if the student received a failing score and there is evidence the CWC should have received a higher score. Two division staff members who are familiar with the VSEP scoring rubric must review the CWC and agree that the CWC should have received a higher score. VSEP Implementation Manual 2009-2010, p 19.

Appeals Process Procedures Appeal requests can be initiated by parents or school personnel. All requests to appeal must be reviewed and approved by the school division before submitting to Pearson. The DDOT is responsible for the CWC’s appeal submission to Pearson. VSEP Implementation Manual 2009-2010, p 19.

Resubmission Students are allowed to resubmit failed CWCs. Students are required to resubmit the entire CWC including additional evidence for standards that previously received low scores. VSEP Implementation Manual 2009-2010, p 19.

Resubmission Procedures Indicate the “Resubmission Subject/Course” in Section 1 of the Intent to Submit Substitute Evaluation Form (Appendix B page 23 in your manual). In the Evaluation Plan/Worksheet portion, teachers should address the SOL that received failing or low scores in the original submission.

Resubmission Procedures The original Course Work Compilation Submission Cover Sheet and Affidavit along with a new Course Work Compilation Submission Cover Sheet and Affidavit completed and signed to cover the new evidence being submitted should accompany the resubmission. In addition to the evidence submitted in the original submission, the student must submit new or additional evidence that addresses the SOL that received low or failing scores. VSEP Implementation Manual 2009-2010, p 19.

Questions??? Evaluation Plan Submission Form Evaluation Plan Worksheet Appeals Process Resubmission Process

VSEP Dates Important Reminders Manuals and Forms VSEP Dates Important Reminders

Manuals and Forms The VSEP Implementation Manual is a guide primarily for teachers who are providing instruction to students participating in the VSEP assessment. The VSEP Implementation Manual is located on the Virginia Department of Education Student Assessment web page. School divisions will be allocated 5 manuals per division. You can order more manuals through additional orders from PearsonAccess.

Manuals and Forms All important forms needed for implementation of the VSEP are located in the Appendices in the back of the VSEP Implementation Manual. (Page 21-38) Appendix A  Frequently Asked Questions Appendix B  Intent to Submit a Substitute Evaluation Form Appendix C  Evaluation Plan Submission Form and Evaluation Plan/Worksheet Appendix D  Evaluation Plan Approval/Denial Form

Manuals and Forms (con’t) Appendix E  Course Work Compilation Submission Cover Sheet and Affidavit. Appendix F  Teacher Checklist for Course Work Compilation Appendix G Administrator Checklist for Course Work Compilation Appendix H Completed Coursework Compilation Submission Checklist.

VSEP Dates Fall 2009 Administration October 16 Fall VSEP Intent Forms due to VDOE Nov. 2 – Dec. 4 Register Student (SDU or Manual) December 18 CWC Shipping Materials Arrive in Divisions January 8 All CWC’s due to Pearson January 19 - 22 Fall Scoring Event February 1 Preliminary Reports February 5 CWC’s Returned to Divisions February 19 Resubmission Intents ONLY!!! March 12 Appeal Requests Due

Spring 2010 Administration VSEP Dates Spring 2010 Administration February 12 Spring VSEP Intent Forms due to VDOE February 19 Resubmission Intents from Fall Admin ONLY Jan. 4 – April 23 Register Students (SDU or Manual) May 7 CWC Shipping Materials Arrive in Divisions May 21 All Spring CWC’s Due to Pearson May 25 – June 4 Spring Scoring Event June 14 Preliminary Reports July 6-9 CWC’s Returned to Divisions June 14 – July 16 Appeal Requests Due

Important Reminders All students participating in the VSEP assessment must meet the eligibility criteria established by the Virginia Department of Education. Participation decisions are the sole responsibility of the IEP team or 504 team committee. Students are not allowed to participate in the VSEP and regular SOL assessment for the same subject area during the fall or spring administrations.

Important Reminders Consideration for VSEP is done on a test-by-test basis. Work samples in multiple choice format are not permitted as evidence. Students participating in the VSEP are counted as non-participants in the calculation of Adequate Yearly Progress (AYP).

Questions Virginia Department of Education Division of Student Assessment and School Improvement Student_Assessment@doe.virginia.gov (804) 225-2107