1. Interim and Diagnostic Assessments
Dr. Stacey Murrell

2. Agenda Intro to Interims Intro to Diagnostics
Differences between Interims and Diagnostics
Big News
Using DIAs and IABs
Webinar
Sneak Peek
Questions/Answers

3. Interim Assessments

4. Interims are NOT The tests are NOT required or mandated by WVDE.
The interims are NOT benchmarks.
There is NOT a WVDE-set or mandated schedule for administering interims.
There is NOT a WVDE-mandated plan for aligning curriculum to interims.

5. Purpose
The purpose of the WV Interim Assessments is to support teaching and learning throughout the year.
Experience a clone of the summative test
Focus on targets/skills, fewer questions
Receive reports that provide feedback on assessment claims and targets
Available for ELA and math, grades 3-11

6. Non-public Tests Not Secure
The interim assessments are not released to the public.
WVDE purchased access to interim tests.
The tests are not secure. This means teachers can talk about and discuss interims with their students.
Teachers CAN project interims and diagnostics on a SmartBoard using the Teacher Item Previewer (more on this coming in PP)

7. Types of Interims
There are two types of interim assessments. Both are fixed form. This means they are NOT adaptive.
The Interim Comprehensive Assessments (ICAs) use the same test blueprints as the WV General Summative Assessment and assess the same standards.
The Interim Assessment Blocks (IABs) focus on smaller sets of targets and are more flexible to better support instruction.

8. Administration
Both interim assessment types are assigned by teachers and taken by students online.
They will use the same delivery software as the general summative assessments.
Teachers use the WV Assessment Portal.
Students use the WV Student Secure Browser.
Embedded designated supports and accommodations for students, such as text-to-speech are available to students taking interims and diagnostics.

9. Scheduling Considerations
Teachers can fit the interims around their schedule.
Once started, 45 days to complete an interim or diagnostic test.
Once started,10 days to complete an interim performance task.

10. IABs Hand Scored Items and Total Items Count
7 ELA IABs
4 Math IABs
That means each grade has 11 IABs.

11. ICAs Hand Scored Items and Total Items Count

12. Interim Comprehensive Assessments (ICAs)
Have the same testing blueprint as the general summative assessment and mirrors the summative testing experience
Have the same item types and formats, including performance tasks
Give students an overall scale score, an overall performance level designation (Level 1, 2, 3, or 4), and claim performance designation (Below Standard, At/Near Standard, or Above Standard)
Same data as summative student report

13. Interim Comprehensive Assessments (ICAs)

14. Interim Comprehensive Assessments (ICAs)

15. Why should we give an ICA?
The data is stored in ORS.
Longitudinal Report/Trend Report
Trend from ICA to ICA ( , , etc.)
Trend from ICA to Summative
Clone of the summative test and its reporting

16. Interim Assessment Blocks (IABs)
Smaller assessments that focus on sets of targets and can be used to support instruction (approx questions).
Contain the same item types and formats, including performance tasks, as the general summative assessments.
Students receive an overall score for the IAB. The results for the IABs are reported as “Below Standard,” “At/Near Standard,” and “Above Standard.”

17. Interim Assessment Blocks (IABs)

18. Interim Assessment Blocks (IABs)

19. When should I give an ICA or IAB?
WVDE is not mandating administration. We can offer guidance, if you’d like.
ICAs cover all the content standards, so the closer to the summative the better.
More questions, students need more time.
Hand scoring, teachers need more time.
Reading reports and taking actions, teachers/teams/schools will need time.
IABs (blocks) cover a cluster or domain, so consider throughout the year use, leading up to the ICA.
Fewer questions, students may finish in a class period.
3 ELA blocks have NO hand scoring; all math IABs, but PT, have NO hand scoring.
Consider using as pretest, posttest
If there are 11 blocks available, what is a reasonable number to ask teachers to complete prior to taking ICAs?

20. Scoring Automatic Scoring Teacher Hand Scoring
Items that are able to be automatically scored will be scored by the computer.
Teacher Hand Scoring
Constructed response items and performance task ELA essay/ math performance task response items are not able to be automatically scored; therefore, these items will be scored by teachers using a scoring rubric.
NOTE: The WV General Summative items/essays are hand scored by individuals contracted by the test vendor, not the teachers of the students.

21. How to Hand Score Interims and Diagnostics
Teachers use the Teacher Hand Scoring System (THSS)
How-To Videos Available
How to Hand Score a Math Item
How to Hand Score an ELA Item
How to Hand Score an ELA Essay
How to Reassign a Hand Scored Item to Another Teacher
Videos located in my OneDrive folder

22. WV Diagnostic Assessments

23. Diagnostics are NOT The tests are NOT required or mandated by WVDE.
They are NOT benchmarks.
There is NOT a WVDE-set or mandated schedule for administering diagnostics.
There is NOT a WVDE-mandated plan for aligning curriculum to diagnostics.

24. Purpose
The purpose of diagnostic assessments is to provide feedback on students’ performance.
Reports will have the content standard that each test question is aligned to and how the class/student answered the question.

25. Developed
Written by WV teachers using the same item writing specs as the general summative test and interim tests.
There are 600 diagnostic questions, but that is not as robust as interims.
We hope to add more diagnostics as we see that teachers and students find them helpful.

26. What are the Diagnostics?
Structured like Interim Assessment Blocks (IABs). Approx questions per diagnostic.
ELA Diagnostic Blocks are arranged by Clusters (Reading Literary, Reading Informational, Research)
Math Diagnostic Blocks are arranged by the Claims (Concepts and Procedures, Problem Solving, Communicating Reasoning, and Modeling and Data Analysis)

27. WV Diagnostics

28. WV Diagnostics

29. Differences between ICAs and Diagnostics
#1 ICAs give more detailed data about student performance. Clone of the summative, covers the same assessment claims and content standards and reports same data. Diagnostics just provide how students performed on each question, do not cover all claims and content standards.

30. #2 IAB and DIA Reporting
Diagnostics will report out a Class/Student Item Analysis Report. Report shows the content standard or target, if no standard possible (Math Claims 2,3, and 4) that each question is aligned to and how students performed on that standard or target.
IABs only indicate for each cluster or domain if students are below, at/near, or above standard.

31. #3 Grades 9 and 10
Grades 9 and 10 have their own Diagnostic tests. Written by WV 9th and 10th grade teachers.
Interims are grade 11. Grade 9 and 10 students can use grade 11 interims. By default, grade 9 and 10 students can access grade 11 interims.

32. Interim Assessments Interim Comprehensive Assessments (ICAs)
Interim Assessment Blocks (IABs)
Not the same as Practice Tests.
Access through the WV Portal
Operational Test Administration

33. Big News #1 Teachers can give students off-grade level interim tests
Only interims, NOT diagnostics
Interim Comprehensive Assessments (ICAs)
Interim Assessment Blocks (IABs)
Teachers have to manually search student in TIDE, edit the interim test preference, and save it.
Has to be done by the teacher and for each student individually. Could be time consuming.
As soon as teacher hits save, student can be given an off-grade level interim test.
Quick guide was ed to you in Nov. and also located on Stacey’s OneDrive.

34. Big News #2 Interim and Diagnostic Teacher Item Previewer
Teachers can VIEW and PROJECT ANY Interim and Diagnostic Test
Click on the Card
The answer keys for DIAs and IABs are in TIDE and also in Stacey’s OneDrive

35. Using Diagnostics Teachers select and give a diagnostic test
They hand score any items, if any need hand scored
See Word document DIA Hand Scored Items and Total Item Counts on Stacey’s OneDrive
ELA literary and informational passages have been added to OneDrive, if teachers want to see the passages (they can also just look at Item Previewer)

36. Diagnostic Hand Scoring
If teachers have a roster created by principal, they will see their reports instantly, after doing the hand scoring.
Don’t forget teachers must hit “Mark as Complete” at bottom of Hand Scoring page
Some have forgotten this step and called me

37. Diagnostic Reports- Class Level Screenshot

38. Diagnostic Answer Keys
Available on Stacey’s OneDrive
Also available in TIDE under General Information Tab

39. Diagnostic Answer Keys
Located in Stacey’s OneDrive
Teacher can review diagnostic test and answer keys
Example, I’d locate #10 G5 Research question.
See the answer, target, content standard, and how the question is written.
Consider why 89% of my students picked the wrong answer

40. DIA Reading Passages
For ELA DIAs Reading Literary or Reading Informational, the passages are all available in Word documents.
Teachers can view/print/project the passages and work with the students’ reading strategies used to answer the questions.
They are located in Stacey’s OneDrive and in TIDE under General Resources tab

41. Using an IAB
Teachers select and give an IAB. Use the Item Total document in Stacey’s OneDrive for names and number of test questions.
ELA blocks are by cluster (Reading Literary, Reading Informational, etc.)
Math blocks are by domain and grade specific (G4 Fractions, Operational and Algebraic Thinking, etc.)
They hand score any items, if any need hand scored (ELA Research, Edit/Revise, Listening = no hand scoring and Math all but PT = no hand scoring)
Remember to select “Mark as Complete” in THSS

42. IAB Reports- Class Level Screenshot

43. IAB Answer Keys Located in Stacey’s OneDrive
Teacher can review IABs using Item Previewer and Answer Keys

44. What’s Next? Review Test and Items with Class
Use Interim and Diagnostic Teacher Item Previewer
Project the test on SmartBoard.
Students and teacher can discuss reasoning and rationale behind the correct and incorrect answers using the answer keys.

45. Additional Review Ideas
Create practice questions/bell ringers using the same format of the DIAs and IAB test questions. Change the content of the questions to match your class materials or subject.
Incorporate classroom resources, teacher resources, Digital Library instructional resources that contain the content standards or ELA clusters/math domains that class is showing difficulty in achieving proficiency.
Have students retake the DIAs and/or IABs and analyze the data to see if students improved.

46. December 16 Webinar Spotlight on the WV Diagnostic Assessments
3:30-4:30pm webinar
Purpose: This webinar will demonstrate how schools can use the data from the diagnostic assessments to determine strengths and weaknesses in students’ performance.
Check DTC listserv for URL and conference calling code
Will be recorded and uploaded on Assessment OneDrive

47. Sneak Peek- Stay Tuned
WV is tentatively scheduled to have interim reports enhanced in Winter 2016.
ICA and IAB Reports will “drill down” similar to DIA reports.
Teachers and schools will be able to see the content standard or assessment target that each question was aligned to and the percentage of students in the group who answered correctly or incorrectly.

48. Questions slmurrell@k12.wv.us
Interim and diagnostic videos and resources available on WV Assessment Portal and
Stacey’s OneDrive