Interim and Diagnostic Assessments Dr. Stacey Murrell

Agenda Intro to Interims Intro to Diagnostics Differences between Interims and Diagnostics Big News Using DIAs and IABs Webinar Sneak Peek Questions/Answers

Interim Assessments

Interims are NOT The tests are NOT required or mandated by WVDE. The interims are NOT benchmarks. There is NOT a WVDE-set or mandated schedule for administering interims. There is NOT a WVDE-mandated plan for aligning curriculum to interims.

Purpose The purpose of the WV Interim Assessments is to support teaching and learning throughout the year. Experience a clone of the summative test Focus on targets/skills, fewer questions Receive reports that provide feedback on assessment claims and targets Available for ELA and math, grades 3-11

Non-public Tests Not Secure The interim assessments are not released to the public. WVDE purchased access to interim tests. The tests are not secure. This means teachers can talk about and discuss interims with their students. Teachers CAN project interims and diagnostics on a SmartBoard using the Teacher Item Previewer (more on this coming in PP)

Types of Interims There are two types of interim assessments. Both are fixed form. This means they are NOT adaptive. The Interim Comprehensive Assessments (ICAs) use the same test blueprints as the WV General Summative Assessment and assess the same standards. The Interim Assessment Blocks (IABs) focus on smaller sets of targets and are more flexible to better support instruction.

Administration Both interim assessment types are assigned by teachers and taken by students online. They will use the same delivery software as the general summative assessments. Teachers use the WV Assessment Portal. Students use the WV Student Secure Browser. Embedded designated supports and accommodations for students, such as text-to-speech are available to students taking interims and diagnostics.

Scheduling Considerations Teachers can fit the interims around their schedule. Once started, 45 days to complete an interim or diagnostic test. Once started,10 days to complete an interim performance task.

IABs Hand Scored Items and Total Items Count 7 ELA IABs 4 Math IABs That means each grade has 11 IABs. http://tinyurl.com/wvnxg-interims

ICAs Hand Scored Items and Total Items Count http://tinyurl.com/wvnxg-interims

Interim Comprehensive Assessments (ICAs) Have the same testing blueprint as the general summative assessment and mirrors the summative testing experience Have the same item types and formats, including performance tasks Give students an overall scale score, an overall performance level designation (Level 1, 2, 3, or 4), and claim performance designation (Below Standard, At/Near Standard, or Above Standard) Same data as summative student report

Interim Comprehensive Assessments (ICAs)

Interim Comprehensive Assessments (ICAs)

Why should we give an ICA? The data is stored in ORS. Longitudinal Report/Trend Report Trend from ICA to ICA (2014-2015, 2015-2016, etc.) Trend from ICA to Summative Clone of the summative test and its reporting

Interim Assessment Blocks (IABs) Smaller assessments that focus on sets of targets and can be used to support instruction (approx. 13-18 questions). Contain the same item types and formats, including performance tasks, as the general summative assessments. Students receive an overall score for the IAB. The results for the IABs are reported as “Below Standard,” “At/Near Standard,” and “Above Standard.”

Interim Assessment Blocks (IABs)

Interim Assessment Blocks (IABs)

When should I give an ICA or IAB? WVDE is not mandating administration. We can offer guidance, if you’d like. ICAs cover all the content standards, so the closer to the summative the better. More questions, students need more time. Hand scoring, teachers need more time. Reading reports and taking actions, teachers/teams/schools will need time. IABs (blocks) cover a cluster or domain, so consider throughout the year use, leading up to the ICA. Fewer questions, students may finish in a class period. 3 ELA blocks have NO hand scoring; all math IABs, but PT, have NO hand scoring. Consider using as pretest, posttest If there are 11 blocks available, what is a reasonable number to ask teachers to complete prior to taking ICAs?

Scoring Automatic Scoring Teacher Hand Scoring Items that are able to be automatically scored will be scored by the computer. Teacher Hand Scoring Constructed response items and performance task ELA essay/ math performance task response items are not able to be automatically scored; therefore, these items will be scored by teachers using a scoring rubric. NOTE: The WV General Summative items/essays are hand scored by individuals contracted by the test vendor, not the teachers of the students.

How to Hand Score Interims and Diagnostics Teachers use the Teacher Hand Scoring System (THSS) How-To Videos Available How to Hand Score a Math Item How to Hand Score an ELA Item How to Hand Score an ELA Essay How to Reassign a Hand Scored Item to Another Teacher Videos located in my OneDrive folder

WV Diagnostic Assessments

Diagnostics are NOT The tests are NOT required or mandated by WVDE. They are NOT benchmarks. There is NOT a WVDE-set or mandated schedule for administering diagnostics. There is NOT a WVDE-mandated plan for aligning curriculum to diagnostics.

Purpose The purpose of diagnostic assessments is to provide feedback on students’ performance. Reports will have the content standard that each test question is aligned to and how the class/student answered the question.

Developed Written by WV teachers using the same item writing specs as the general summative test and interim tests. There are 600 diagnostic questions, but that is not as robust as interims. We hope to add more diagnostics as we see that teachers and students find them helpful.

What are the Diagnostics? Structured like Interim Assessment Blocks (IABs). Approx. 2-25 questions per diagnostic. ELA Diagnostic Blocks are arranged by Clusters (Reading Literary, Reading Informational, Research) Math Diagnostic Blocks are arranged by the Claims (Concepts and Procedures, Problem Solving, Communicating Reasoning, and Modeling and Data Analysis)

WV Diagnostics

WV Diagnostics

Differences between ICAs and Diagnostics #1 ICAs give more detailed data about student performance. Clone of the summative, covers the same assessment claims and content standards and reports same data. Diagnostics just provide how students performed on each question, do not cover all claims and content standards.

#2 IAB and DIA Reporting Diagnostics will report out a Class/Student Item Analysis Report. Report shows the content standard or target, if no standard possible (Math Claims 2,3, and 4) that each question is aligned to and how students performed on that standard or target. IABs only indicate for each cluster or domain if students are below, at/near, or above standard.

#3 Grades 9 and 10 Grades 9 and 10 have their own Diagnostic tests. Written by WV 9th and 10th grade teachers. Interims are grade 11. Grade 9 and 10 students can use grade 11 interims. By default, grade 9 and 10 students can access grade 11 interims.

Interim Assessments Interim Comprehensive Assessments (ICAs) Interim Assessment Blocks (IABs) Not the same as Practice Tests. Access through the WV Portal Operational Test Administration

Big News #1 Teachers can give students off-grade level interim tests Only interims, NOT diagnostics Interim Comprehensive Assessments (ICAs) Interim Assessment Blocks (IABs) Teachers have to manually search student in TIDE, edit the interim test preference, and save it. Has to be done by the teacher and for each student individually. Could be time consuming. As soon as teacher hits save, student can be given an off-grade level interim test. Quick guide was emailed to you in Nov. and also located on Stacey’s OneDrive.

Big News #2 Interim and Diagnostic Teacher Item Previewer Teachers can VIEW and PROJECT ANY Interim and Diagnostic Test Click on the Card The answer keys for DIAs and IABs are in TIDE and also in Stacey’s OneDrive

Using Diagnostics Teachers select and give a diagnostic test They hand score any items, if any need hand scored See Word document DIA Hand Scored Items and Total Item Counts on Stacey’s OneDrive ELA literary and informational passages have been added to OneDrive, if teachers want to see the passages (they can also just look at Item Previewer)

Diagnostic Hand Scoring If teachers have a roster created by principal, they will see their reports instantly, after doing the hand scoring. Don’t forget teachers must hit “Mark as Complete” at bottom of Hand Scoring page Some have forgotten this step and called me

Diagnostic Reports- Class Level Screenshot

Diagnostic Answer Keys Available on Stacey’s OneDrive http://tinyurl.com/wvnxg-interims Also available in TIDE under General Information Tab

Diagnostic Answer Keys Located in Stacey’s OneDrive Teacher can review diagnostic test and answer keys Example, I’d locate #10 G5 Research question. See the answer, target, content standard, and how the question is written. Consider why 89% of my students picked the wrong answer

DIA Reading Passages For ELA DIAs Reading Literary or Reading Informational, the passages are all available in Word documents. Teachers can view/print/project the passages and work with the students’ reading strategies used to answer the questions. They are located in Stacey’s OneDrive and in TIDE under General Resources tab

Using an IAB Teachers select and give an IAB. Use the Item Total document in Stacey’s OneDrive for names and number of test questions. ELA blocks are by cluster (Reading Literary, Reading Informational, etc.) Math blocks are by domain and grade specific (G4 Fractions, Operational and Algebraic Thinking, etc.) They hand score any items, if any need hand scored (ELA Research, Edit/Revise, Listening = no hand scoring and Math all but PT = no hand scoring) Remember to select “Mark as Complete” in THSS

IAB Reports- Class Level Screenshot

IAB Answer Keys Located in Stacey’s OneDrive Teacher can review IABs using Item Previewer and Answer Keys

What’s Next? Review Test and Items with Class Use Interim and Diagnostic Teacher Item Previewer Project the test on SmartBoard. Students and teacher can discuss reasoning and rationale behind the correct and incorrect answers using the answer keys.

Additional Review Ideas Create practice questions/bell ringers using the same format of the DIAs and IAB test questions. Change the content of the questions to match your class materials or subject. Incorporate classroom resources, teacher resources, Digital Library instructional resources that contain the content standards or ELA clusters/math domains that class is showing difficulty in achieving proficiency. Have students retake the DIAs and/or IABs and analyze the data to see if students improved.

December 16 Webinar Spotlight on the WV Diagnostic Assessments 3:30-4:30pm webinar Purpose: This webinar will demonstrate how schools can use the data from the diagnostic assessments to determine strengths and weaknesses in students’ performance. Check DTC listserv email for URL and conference calling code Will be recorded and uploaded on Assessment OneDrive

Sneak Peek- Stay Tuned WV is tentatively scheduled to have interim reports enhanced in Winter 2016. ICA and IAB Reports will “drill down” similar to DIA reports. Teachers and schools will be able to see the content standard or assessment target that each question was aligned to and the percentage of students in the group who answered correctly or incorrectly.

Questions slmurrell@k12.wv.us Interim and diagnostic videos and resources available on WV Assessment Portal and Stacey’s OneDrive http://tinyurl.com/wvnxg-interims