Virginias Alternative Assessments Presented by: Judy Honaker

Alternative Assessments NCLB states that an alternate assessment is an assessment designed for the small number of students with disabilities who are unable to participate in the regular State assessment, even with appropriate accommodations. Further, that alternate assessments may be needed for students who have a broad variety of disabling conditions; consequently, a State may employ more than one alternate assessment. An alternate assessment may be scored against grade level standards…

3 Types of Alternative Assessments VAAP (students well below grade level) VGLA (students in grades who do not have to earn verified credits by passing SOL tests) VSEP (students who are enrolled in grade level classes that require an End Of Course Standard of Learning test to earn a verified credit)

Virginia's Alternate Assessment for Students NOT ON GRADE LEVEL Only students with disabilities who have an IEP and who are not participating in any Standards of Learning assessments at their grade level (3, 5 and 8) may be considered for participation in the Virginia Alternate Assessment Program. (VAAP) The student must demonstrate impairments that prevent the completion of curriculum based on the Standards of Learning even with program and assessment accommodations. Also, the student's present level of performance must indicate a need for extensive, direct instruction and/or intervention in a life skills curriculum. Finally, the student must require intensive, frequent, and individualized instruction in a variety of settings to show progress and acquire, maintain, or generalize life and/or functional academic skills.

Virginia Grade Level Alternative (VGLA) and Virginia Substitute Evaluation Program (VSEP) Both the VGLA and VSEP are grade level alternative assessment options allowing a student to demonstrate individual achievement and proficiency on Virginias SOLs through a collection of student evidence. The VGLA is available at grades 3 – 8 in all content areas. The VSEP is available for ALL End-of-Course tests at the high school level and/or the Modified Standard Diploma requirements for math and/or reading.

Identify Tests VGLA and VSEP The content areas tested are dependent on the students grade and the local school divisions policies regarding testing of the general student population.

VGLA and VSEP content areas mirror those of the division: Grades 3, = Reading, Mathematics, Science, History/Social Science Grades 5, 8 = Reading, Mathematics, Science Grades 4, 6, and 7 = Reading and Mathematics Content Specific History Grade 11 = Reading, Mathematics, Science, and History Identify Tests (contd)

History = VGLA and VSEP administered at the corresponding grade levels as history is assessed division-wide. e.g., Virginia Studies SOL test administered division-wide at grade 4, then grade 4 VGLA students would submit a History entry at grade 4. Identify Tests (contd)

Procedures: VGLA and VSEP A students IEP team/504 committee examines the participation criteria established for the VGLA OR VSEP and finds that a student meets the criteria for participation. The students properly composed IEP team/504 committee makes the determination of which assessment program/accommodation(s) are appropriate for a student with a disability.

AFTER participation decisions have been made and noted in the students current IEP…

VGLA: Grades Participation Criteria The student must have a current IEP/504-plan; As a result of a disability, the student demonstrates his/her individual achievement of SOL content through means other than multiple-choice formats; As a result of a disability, the student is unable to demonstrate his/her individual achievement on the SOL test for the assigned course or grade level using available accommodations and formats.

VAAP: Select ASOL The teacher and student review and select Aligned Standards of Learning (ASOL) in each content area from grade level blueprints. Consideration of ASOL for any test begins by reviewing the students grade level ASOL blueprint; before moving to lower or higher level blueprints.

The number of required ASOL selected is based on the content area reporting categories in the ASOL grade level blueprints. ONE ASOL must be defended from EACH reporting category within a grade level blueprint. VAAP: Select ASOL (contd)

VAAP: ASOL Per Content Area Reading – 2 Mathematics – 5 History – 4 Science – 4

VAAP : Identify Evidence Types Identify type of evidence that will best demonstrate individual achievement in the selected ASOL.

VAAP : Instruction in Content Teacher instructs the student in the appropriate content and the student generates evidence of achievement related to skills and/or knowledge listed in the selected ASOL.

Collect Evidence Throughout the school year, the student and teacher select the strongest evidence to demonstrate that the student can perform all or part of the stated skill. Data Identification System (DIS) Sticker required on each piece of evidence.

Evidence: The VGLA and VSEP requires evidence that the student can demonstrate a level of achievement related to the selected standards.

Types of Evidence A collection may consist of any of the following types of evidence: Work sample Audiotape Videotape Anecdotal Record Interview Charts/Graphs

Evidence Continued Evidence must demonstrate knowledge and/or skills in the SOL addressed. Students should submit evidence for all of the SOL assessed from the test blueprints. Evidence may prove more than one SOL. All evidence must be solely the students work completed in the presence of a teacher or authorized school personnel.

Evidence: Data Identification System (DIS) stickers DIS stickers are REQUIRED to be placed on each piece of evidence submitted for the VGLA and VSEP. DIS stickers will be provided based on enrollment counts to your DDOT Evidence without DIS stickers will NOT be considered in scoring entries.

Data Identification System (DIS) Sticker Content Area being submitted Standard of Learning being defended Bullet of SOL being defended (if applicable) Check one or both Content Area: SOL: Bullet: Inferred: Demonstrated Content Area: Mathematics SOL: 8.14 Bullet: c Inferred: Demonstrated Example: VGLA/VSEP DIS

COE Submission

5.4 The student will read fiction and nonfiction with fluency and accuracy. a)Use context to clarify meaning of unfamiliar words; b)Use knowledge of root words, prefixes, and suffixes; c) Use dictionary, glossary, thesaurus, and other word- reference materials. Evidence submitted must include everything in the stem as well as all of the bullets.

VGLA/VSEP DIS Content Area: Reading SOL: 5.4 Bullet: b Inferred: Demonstrated: X 5.4 b The student will read fiction and nonfiction with fluency and accuracy by using knowledge of root words, prefixes, and suffixes. 5.4 c The student will read fiction and nonfiction with fluency and accuracy by using a dictionary, glossary, thesaurus, and other word-reference materials. 5.4 a The student will read fiction and nonfiction with fluency and accuracy by using context to clarify meaning of unfamiliar words. VGLA/VSEP DIS Content Area: Reading SOL: 5.4 Bullet: c Inferred: Demonstrated: X VGLA/VSEP DIS Content Area: Reading SOL: 5.4 Bullet: a Inferred: Demonstrated: X

SOL Disaggregation 5.7 The student will demonstrate comprehension of information from a variety of print resources. b) Organize information on charts, maps, and graphs. 5.7 The student will demonstrate comprehension of information from a variety of print resources. b) Organize information on charts, maps, and graphs.

SOL Check Sheet Optional

SOL Dividers Optional

VGLA Checklist Optional

1.6 The student will identify and represent the concepts of one-half and one-fourth, using appropriate materials or a drawing. 2.4 The student will identify the part of a set and/or region that represents fractions for one-half, one- third, one-fourth, one-eighth, and one-tenth and write the corresponding fraction. Because it is not properly labeled Evidence May Not Be Scored Evidence May Not Be Scored

K.6The student will add and subtract whole numbers, using up to 10 concrete items. 1.9The student will create and solve story and picture problems involving one-step solutions, using basic addition and subtraction facts. Evidence Will Not Be Scored Evidence Will Not Be Scored Because this worksheet does not include directions or teacher comments about the activity.

3.4 The student will use strategies to read a variety of fiction and nonfiction materials. d) Use context to clarify meaning of unfamiliar words. Evidence May Not Be Scored Evidence May Not Be Scored Because it is not properly labeled Because it is not properly labeled

6.3 The student will b) identify and describe prime and composite numbers Should not be the sole piece of evidence for 6.3b Because this activity identifies but does not describe prime and composite numbers.

Required Components

Optional Components

Submit COE At the end of the testing window, the collection of evidence (COE) is submitted to the local Division Director of Testing. (Amy Merrihue & Committee)

Submit COE A signed affidavit must accompany each VGLA/VSEP area submission stating that the work is that of the student alone using his/her accommodations. Work samples submitted must be solely that of the student. In the presence of a teacher and/or paraprofessional.

Submit COE Affidavit of Student Performance I did not: fabricate, alter, or modify student work samples; present evidence that provides a negative image of the student; provide accommodation/assistive device that is not a part of daily instruction; and I am not aware that anyone else did so.

Affidavit Considerations Hand over hand instruction is NOT evidence of student performance Copying notes or information from other sources DOES NOT demonstrate individual student achievement of the content, but rather the students ability to copy information Information gained or restated during open- book, internet research, or guided reading activities DOES NOT demonstrate individual achievement with the content

VGLA Collection Components A VGLA collection submitted for scoring to the local scoring team must contain the following: A signed VGLA Affidavit of Student Performance that demonstrates the students sole ownership/authorship. Types of evidence that demonstrate individual achievement on all SOL addressed. A Virginia Grade Level Alternative (VGLA) Assessment Worksheet to be used for scoring.

VSEP Collection Components A VSEP Course Work Compilation submitted for scoring to the Virginia Department of Education must contain the following: A signed VSEP Affidavit of Student Performance that demonstrates the students sole ownership/authorship. A completed Course Work Compilation Form indicating evidence and SOL associations. Types of evidence that demonstrate individual achievement on all SOL addressed.

TIPS TO IMPROVE INSTRUCTION Label, Label, Label! Read the stem & bullet completely and address everything. Avoid shortcuts. Use SOL check sheets to guide instruction. We are all in this together, so LETS WORK TOGETHER!

Scoring VGLA and VSEP Submissions

VGLA Procedures The students VGLA collection and the signed affidavit confirming that the work is that of the student alone are submitted to the LEA scoring committee. A complete collection that provides evidence for all SOL from a given content/grade level that the student has addressed during the course of study must be submitted.

VGLA Scoring Teams Scoring teams must consist of at least three members. At least one or more members must have knowledge of the content area being scored. Scoring teams must come to consensus on score points assigned for each Standard Of Learning contained within the blueprint for a specific test. Scores for individual Standards Of Learning are weighted based on the general Blueprint established for each test.

VGLA Procedures Based on the documentation and collection review, the school division scoring team will assign the appropriate scores based on the scoring rubric identified by the Virginia Department of Education. The Division Director of Testing is responsible for maintaining a local scoring team. After receipt of all required materials, documentation, and collection evidence, the local scoring team will set up a date for review of submitted VGLA entries. The local scoring team will use the online scoring system to rate student individual achievement in each SOL addressed for specific content/grade level VGLA submitted collection.

VSEP: EOC and Modified Standard Diploma Grades 9-12 : Participation Criteria The student has a current IEP or 504 plan. The student is enrolled in a course or has passed a course that has a Standards of Learning End-of- Course test and/or the student is pursuing a Modified Standard Diploma and seeking certification for having met the literacy and/or numeracy requirements. The impact of the students disability demonstrates to the IEP team or 504 committee that the student will not be able to access the Standards of Learning assessments even with accommodations and therefore requires a substitute evaluation.

VGLA/VSEP Modified Standard Diploma Options If a student, as an 8 th grader, has passed the grade 8 Reading and/or mathematics test(s) using the VGLA; he or she may use the scores earned during that administration to meet the requirements for literacy and/or numeracy when identified as seeking an MSD; Scores awarded VGLA submissions by local scoring teams are acceptable for MSD purposes. Student VGLA submissions do NOT have to be submitted to the Department for review. Students in ninth grade or above earning an MSD who did not participate in the VGLA in eighth grade are required to participate in the VSEP to meet the MSD reading and math requirements.

VSEP Procedures The student and teacher use established procedures to identify collection components to demonstrate individual achievement and proficiency of SOL for the EOC grade level and content area(s) (and/or numeracy and/or literacy) considered for the VSEP. examine the addressed SOL for the assessment(s) being considered (Blueprint). select appropriate work samples that demonstrate content stated in the blueprint. reflect demonstration of student knowledge and skills related to the specific SOL. complete a Course Work Compilation that represents the student's level of individual achievement and proficiency.

VSEP Procedures The student and teacher MUST use a Course Work Compilation form to indicate evidence submitted for scoring. The CWC should mirror the Evaluation Plan submitted and approved by the VDOE. Additional evidence may be submitted using the CWC, but a CWC MUST contain evidence indicated and approved from the original Evaluation Plan Evidence should demonstrate the students level of individual achievement and proficiency with EOC SOL

Score Local scorers use a state-developed rubric to rate student achievement on the aligned standards included in each collection of evidence. Ratings are entered into online scoring sheet.

VSEP Scoring VSEP entries are scored during scoring events throughout the school year. Trained scorers will read and review each submitted entry. All entries are scored at least twice by different scorers with content area expertise. Scores for individual Standards Of Learning are weighted based on the general Blueprint established for each test.

VSEP Procedures The students VSEP Course Work Compilation form, evidence, and the signed affidavit confirming that the work is that of the student alone are submitted to the school division Director of Testing based on the established testing date(s) for each division. A complete Course Work Compilation provides evidence for all SOL from a given EOC and/or literacy and/or numeracy blueprint that the student has addressed during the course of study.

VSEP Procedures Based on the documentation and Course Work Compilation review, trained and authorized scorers will assign appropriate scores based on the scoring rubric. The Division of Assessment and Reporting and Pearson Educational Measurement will establish a scoring institute. All VSEP entries will be scored during the scoring institute, dates to be determined. The VSEP Scoring System will weight and calculate proficiency levels.

Report After local scorers complete score sheets, DDOT or designee enters scores into online scoring system. Real-time reporting will allow the DDOT to print copies of the students Official Score Report immediately after entering scores.

Report ( contd) DDOT distributes Official Score Reports to schools, parents, and students. Alerts resolved online. Summary reports for students will be made available online after receipt of the Division Authorization To Proceed (ATP) from the DDOT.

VGLA Reporting The online scoring system provides scoring and reporting for the Local School Division and directly to the Division of Assessment and Reporting. Division Directors of Testing will be given log- on information and procedures for accessing and reporting scores for VGLA Administrations during spring score training.

VSEP Reporting The computerized scoring system used during the scoring event provides real-time scoring to Department of Education authorized scoring teams. Pearson Educational Measurement will print out Official Score Reports during the scoring event. Scorers will sign Official Score Reports. Division Directors of Testing will receive Official Score Reports for VSEP students at the close of the scoring event.

VGLA Audit Procedures All school divisions will be subject to VDOE audits to monitor program implementation, scoring, and application of participation criteria. 10 to 15 percent of student submissions. provide VDOE audit staff with evidence used to establish ratings. agreement or non-agreement between submitted evidence and ratings provided. School divisions may appeal scores and/or audits through an established appeals process.

Divisions will receive audit rosters from Pearson. Student entries identified for audits should be set aside and maintained until instructed to send to the Division of Assessment and Reporting VGLA Audit Institute DDOTs will receive shipping materials, instructions, and labels prior to the audit institute. VGLA Audit Procedures (contd)

VSEP Procedures VSEP entries will not be audited. Each VSEP will be scored by state identified, trained, and authorized scorers. Each VSEP entry will be scored by two scorers. Inter-rater reliability will be established by examining the first and second scores on proficiency assigned to each VSEP entry. If required, VSEP entries will be read a third time by a third scorer to resolve disagreements in proficiency levels.

Review reports Appeal scoring, reporting, and/or process Who can initiate an appeal? Parent, Student, Teacher, Division Justification for appeals? Errors Timelines-30 days after reports/audits

Resources VAAP Procedural Manual Virginia Alternate and Alternative Test Administrators Manual ASOL Blueprints VDOE Office: Division of Assessment and Reporting Virginia Alternate Assessment Program (VAAP)

Questions