Chief Instructional Leader’s Website

Chief Instructional Leader’s Website
Welcome Back! Chief Instructional Leader’s Website

Professional Learning

Using Data to Make Decisions Regarding Professional and Personalized Learning: WV Summative Assessment Vaughn Rhudy, Executive Director Timothy Butcher, Coordinator WVDE Office of Assessment

Break 10:15-10:30 AM

Please Tweet your thoughts to: #WVCIL
Give us your thoughts… Please Tweet your thoughts to: #WVCIL

Using Data to Make Decisions Regarding Professional and Personalized Learning: WV Diagnostic Assessments, Interim Assessments, and Formative Assessment Resources in the Digital Library Stacey Murrell and Terri Sappington, Coordinators, WVDE Office of Assessment

Welcome to the Interim and Diagnostic Assessments Training
Office of Assessment

West Virginia Interim and Diagnostic Assessments
Dr. Stacey Murrell

Agenda Interim Assessments What interims are NOT
Interim Comprehensive Assessments (ICAs) Interim Assessment Blocks (IABs) What interims are NOT Purpose of interim assessments Hand scoring Reports Enhancements WV Diagnostics What diagnostics are NOT

Interims are NOT The tests are NOT required or mandated by WVDE.
The interims are NOT benchmarks. There is NOT a WVDE-set or mandated schedule for administering interims. There is NOT a WVDE-mandated plan for aligning curriculum to interims.

Purpose The purpose of the WV Interim Assessments is to support teaching and learning throughout the year. Experience a clone of the summative test Focus on targets/skills, fewer questions Receive reports that provide feedback on assessment claims and targets Available for ELA and math, grades 3-11

Question Development Developed using the same conditions (like bias and sensitivity), protocols, and review procedures as the West Virginia General Summative Assessment items. In , 40+ WV teachers wrote 800 questions for the summative and interim item banks. This means the interim items assess the WV NxG standards, were designed using principles of Universal Design, and provide evidence to support ELA/literacy and math claims.

Non-public Tests Not Secure
The interim assessments are not released to the public. WVDE purchased interim tests. The tests are not secure, but they should be kept offline (consider social media).

Types of Interims There are two types of interim assessments.
The Interim Comprehensive Assessments (ICAs) use the same test blueprints as the WV General Summative Assessment and assess the same standards. The Interim Assessment Blocks (IABs) focus on smaller sets of targets and are more flexible to better support instruction.

Interim Comprehensive Assessments (ICAs)
Have the same testing blueprint as the general summative assessment and mirrors the summative testing experience Have the same item types and formats, including performance tasks Give students an overall scale score, an overall performance level designation, and claim-level information- same as summative student report Claim Performance Results are reported as “Below Standard,” At/Near Standard,” and “Above Standard.”

Interim Assessment Blocks (IABs)
Smaller assessments that focus on sets of targets and can be used to support instruction (approx questions). Contain the same item types and formats, including performance tasks, as the general summative assessments. Students receive an overall score for the IAB. The results for the IABs are reported as “Below Standard,” “At/Near Standard,” and “Above Standard.”

Administration Both interim assessment types are assigned by teachers and taken by students online. They will use the same delivery software as the general summative assessments. Teachers use the WV Assessment Portal. Students use the WV Student Secure Browser.

Scoring Automatic Scoring Teacher Hand Scoring
Items that are able to be automatically scored will be scored by the computer. Teacher Hand Scoring Constructed response items and performance task ELA essay/ math performance task response items are not able to be automatically scored; therefore, these items will be scored by teachers using a scoring rubric. Teachers will need to complete their hand scoring of the constructed response items and performance task ELA essay/math extended response items before any reports can be generated for both the ICAs and IABs. NOTE: The WV General Summative items/essays are hand scored by individuals contracted by the test vendor, not the teachers of the students.

Interim Reports

Interim Comprehensive Assessments (ICAs)

Interim Assessment Blocks (IABs)

Interim Enhancements for 2015-2016
The test names are being changed to be more concise, consistent, and clear. Students will have unlimited opportunities to practice interim tests. Selecting an interim test will “look” different than when selecting a summative test. Less confusing.

WV Diagnostic Assessments

Diagnostics are NOT The tests are NOT required or mandated by WVDE.
They are NOT benchmarks. There is NOT a WVDE-set or mandated schedule for administering diagnostics. There is NOT a WVDE-mandated plan for aligning curriculum to diagnostics.

Purpose The purpose of diagnostic assessments is to provide feedback on students’ performance. Reports will have the content standard (WV NxG) that each test question is aligned to and how the class/student answered the question.

WV Diagnostics Available for grades 3-11 ELA Diagnostics
Reading Literary Texts Reading Informational Texts Research Math Diagnostics Concepts and Procedures Problem Solving and Modeling & Data Analysis Communicating Reasoning Performance Task

Questions Development
Written by WV teachers using the same item writing specs as the general summative test and interim tests. There are 600 diagnostic questions, but that is not as robust as interims. We hope to add more diagnostics as we see that teachers and students find them helpful.

WV Diagnostic Reports Mock Up Drafts

WV Diagnostics

Next Steps: Using Interims and Diagnostics
September 15, 2015 is the “opening” of both. All embedded designated supports and accommodations for students, such as text-to-speech will be available to students taking interims. Diagnostics only have embedded text-to-speech (P01). Remember, teachers will have to hand score any constructed response (ELA and math PTs) and essays (ELA) before reports will appear. Principals will have to associate teachers to students for the year by creating/managing rosters for the Online Reporting System. Must wait until your county has sent WVEIS promotional file and TIDE has uploaded the file.

Questions slmurrell@k12.wv.us Handouts available on Stacey’s OneDrive
This PowerPoint Interim Quick Guide for Teachers IABs Table of Hand Scored and Total Items ICAs Table of Hand Scored and Total Items Principals Creating and Managing Rosters Quick Guide

Smarter Balanced Digital Library: A Part of a Balanced
Assessment System CIL Meeting July 24, 2015 Terri Sappington, NBCT Assessment Coordinator West Virginia Department of Education Office of Assessment State Lead, State Leadership Team, Smarter Balanced Digital Library WV Teacher Involvement Coordinator, Smarter Balanced Assessment Consortium

Balanced Assessment System
Digital Library

Smarter Balanced Definition
Formative Assessment Smarter Balanced Definition Formative assessment: a deliberate process utilized by teachers and students during instruction to provide actionable feedback, used to adjust ongoing teaching and learning strategies to improve students’ attainment of curricular learning targets/goals.

Four Attributes Formative Assessment
The Digital Library resources are connected to these four formative assessment attributes.

Digital Library Resources
Assessment Literacy Modules Commissioned Professional Learning Modules Resources for educators, students and families Frame Formative Assessment within a Balanced Assessment System Articulate the Formative Assessment Process Highlight Formative Assessment Practices and Tools Exemplar Instructional Modules Commissioned Professional Learning Modules Instructional coaching for educators Instructional materials for students Demonstrate/support effective implementation of the formative assessment process Focus on key content and practice from the Common Core State Standards for Mathematics and English Language Arts Education Resources High-quality vetted instructional resources and tools for educators High-quality vetted resources and tools for students and families Reflect and support the formative assessment process Reflect and support the Common Core State Standards for Mathematics and English Language Arts Create Professional Learning Communities

How can educators use resources in the Digital Library?
Digital Library Resources How can educators use resources in the Digital Library? Advance their use of formative assessment practices. Better understand where students are in their learning. Identify any misconceptions. Make quick adjustments to instruction.

Touring the Digital Library

Go to the Digital Library
Enter username and password

Getting a Login If you are a new user or you do not remember your Digital Library password, Terri Sappington at If you are a new user or you do not remember your Digital Library password, please Terri Sappington at

Landing Page

This is the Digital Library Resources page. It displays all the resources that have been posted to the Digital Library.

Resource Cards Resources are displayed as cards that include the following information: Resource Title Image of primary material The first 140 characters of the resource summary Selected tags Number of views Number of downloads Star rating A check mark in the top right corner of a resource card indicates that a resource has been posted with distinction. This means that it received the highest recommendation from all three reviewers of the resource.

View Options There are two ways to view resources:
Grid View displays resources as cards. This is the default view, as seen in the previous slides. List View displays resources in a list, shown here. List view provides a less detailed display than Grid View. You can change the view option by choosing Grid View or List View on the right side of the window above the resource cards. Click Grid View to return to Grid View.

Using Filtering There are three ways you can search for resources in the Digital Library. First, you can filter using as many as eleven categories that are displayed above the resource cards. These include: Subject, Grade, Attribute of the Formative Assessment Process, Common Core State Standards, etc. If you do not want to use the filters, you can hide the categories by clicking Hide Categories in the top right of the filter section.

Using Filtering When you click on a filter category, a separate drop-down menu appears. This example shows the drop-down box for Resource Type. Check the boxes you want to customize your search.

Using Filtering Once you have selected your filters, they will appear below the filter options. Click Apply Filters to begin your search.

Using Filtering After applying your selected filters, you may choose to edit those filters by clicking Edit Filters. You can clear the filters by clicking Reset Filters.

Using the Search Option
A second way to search for resources is to use the search bar in the upper right corner of the screen. Type key words in the oval next to the magnifying glass. Press the enter or return key on your computer to begin your search. Resources containing these words will be displayed.

Sorting Resources The third way to search for resources is to use the Sort feature. You can change the way resources are listed using the sort box on the left side of the screen under the filter categories. By default, resources are listed with the newest showing first. When you click on Sort by: Newest, a drop-down menu appears that allows you to sort by Most Viewed or Highest Rated.

Interactive Modules Interactive modules are of 4 types: Assessment Literacy, ELA Exemplary Instructional, Math Exemplar Instructional, and Score Reports. They provide opportunities for Digital Library users to learn more about a balanced assessment system and how to implement the intent of the Common Core State Standards using the Formative Assessment Process. All of them include interactive learning events and most include an animated or live action vignette. When the project is complete, there will be 102 modules – look for more of them to become available throughout the Preview Period. To find these interactive modules, filter using the Module Types dropdown menu.

Interactive Modules Choose one of the four Module types (not all will be available in the initial Preview Period): Assessment Literacy Modules, ELA Exemplar Instructional Modules, Math Exemplar Instructional Modules Interim and Summative Score Report Modules Select the module type you are interested in by checking the box. Click Apply Filters.

Interactive Modules All available modules for the type you chose will appear. Click on the title of the module to access them.

Favorites The first step in favoriting a resource is to open it up.
Recall that you find resources when you are in the Digital Library Resource tab. Open a resource by clicking on the title in the card or list view.

Favorites After clicking on a resource, you are taken to the resource page. At the top of this page you will find the resource title, resource type, author, and owner. To the right of this information is a heart followed by Add to Favorites. Click this to add the resource to your favorites list.

Favorites Once clicked, the Heart turns from gray to red. Click it again to un-favorite the resource, or remove it from your favorites list. Check to confirm that your resource was added to your favorite list in the top right corner of the Digital Library. If successful, the number on the Favorites bar will increase and the words “Added to Favorites” will appear briefly beside the Search box.

Favorites Clicking on the Favorites bar in the upper right corner will take you to the Favorites tab on your Personal Profile page. Here, you will find all of the resources you have marked as Favorite. The list includes the Resource Type and the Date Added to your Favorites list.

Forums

More Information Available under “Digital Library” at the state’s Smarter Balanced website:

Support & Professional Learning
Available at the state’s Smarter Balanced website:

Part 3: Using the Digital Library and WVDE TREE After Analyzing Interim and Diagnostic Report Results

IAB Block Achievement Class Report
Above Standard Your test results clearly show that you understand and are able to apply your knowledge to the standards in this content area of your grade. At/Near Standard Your test results may be just above or just below the standard, but due to the error band, the result is too close to call. Below Standard Your test results clearly show that you have not yet met the standard in this content area for your grade.

Terri Go Live to Digital Library

Diagnostic Class Item Performance

Diagnostic Item #1 Stacey Go Live to WVDE TREE
Officer Buckle and Gloria

Closing tsapping@k12.wv.us slmurrell@k12.wv.us Office of Assessment

Smarter Balanced Digital Library: A Part of a Balanced
Assessment System CIL Meeting July 24, 2015 Terri Sappington, NBCT Assessment Coordinator West Virginia Department of Education Office of Assessment State Lead, State Leadership Team, Smarter Balanced Digital Library WV Teacher Involvement Coordinator, Smarter Balanced Assessment Consortium

Balanced Assessment System
Digital Library

Smarter Balanced Definition
Formative Assessment Smarter Balanced Definition Formative assessment: a deliberate process utilized by teachers and students during instruction to provide actionable feedback, used to adjust ongoing teaching and learning strategies to improve students’ attainment of curricular learning targets/goals.

Four Attributes Formative Assessment
The Digital Library resources are connected to these four formative assessment attributes.

Assessment Literacy Modules Commissioned Professional Learning Modules Resources for educators, students and families Frame Formative Assessment within a Balanced Assessment System Articulate the Formative Assessment Process Highlight Formative Assessment Practices and Tools Exemplar Instructional Modules Commissioned Professional Learning Modules Instructional coaching for educators Instructional materials for students Demonstrate/support effective implementation of the formative assessment process Focus on key content and practice from the Common Core State Standards for Mathematics and English Language Arts Education Resources High-quality vetted instructional resources and tools for educators High-quality vetted resources and tools for students and families Reflect and support the formative assessment process Reflect and support the Common Core State Standards for Mathematics and English Language Arts Create Professional Learning Communities