Assessment Update Webinar #1 August 27, 2015

Today’s Topics Score Release and Graduation Requirements Reports and Reporting Content-Related Developments THSS Digital Library Science Assessment Technology TIDE Customer Service

Score Release

Score Release from Spring 2015 Smarter Balanced Results Statewide by Grade and Content Participation and Refusal Rates Test Format (online/paper) Science Results (grades 5 & 8 and Biology) Graduation Exit Exam Status Math EOC Results ELA and Mathematics Exit Exam Threshold Scores Class of 2015 For the complete Annual State Assessment Score Release, visit http://www.k12.wa.us/Communications/PressReleases2015/StateTestResults .aspx

Consortium-wide 2014 Scores on Smarter Balanced ELA Field Test English Language Arts   Grade Field test Grade 3 38% Grade 4 41% Grade 5 44% Grade 6 Grade 7 Grade 8 HS (11) About 1/3 of the state took the Smarter Balanced field test in spring 2014, consortium-wide.

Statewide 2015 Scores on Smarter Balanced ELA Test English Language Arts   Grade Proficient Field test Grade 3 53% 38% Grade 4 56% 41% Grade 5 59% 44% Grade 6 55% Grade 7 Grade 8 HS (11) 52%

Consortium-wide 2014 Scores on Smarter Balanced Mathematics Field Test   Grade Field test Grade 3 39% Grade 4 37% Grade 5 33% Grade 6 Grade 7 Grade 8 32% HS (11)

Statewide 2015 Scores on Smarter Balanced Mathematics Tests   Grade Proficient Field test Grade 3 58% 39% Grade 4 55% 37% Grade 5 49% 33% Grade 6 47% Grade 7 50% Grade 8 48% 32% HS (11) 29%

Washington’s 2015 Proficiency Rates on Smarter Balanced Tests English Language Arts Mathematics Grade Proficiency of Tested Students Grade 3 53% 58% Grade 4 56% 55% Grade 5 59% 49% Grade 6 47% Grade 7 50% Grade 8 48% HS (11) 52% 29% These results do not factor in the refusals. These results are very positive. For those in the audience who were following the administration of the WASL in the late 1990s after the implementation of the new standards were , you will remember that proficiency rates were significantly lower as compared to Smarter Balanced These results do not include refusals.

Smarter Balanced Participation Rates (95% required for AYP) ELA Participation Mathematics Participation Grade Percent Grade 3 98.2% 98.1% Grade 4 Grade 5 Grade 6 98.0% 97.8% Grade 7 97.3% Grade 8 96.9% 96.6% Grade 10 97.1% NA Grade 11 53.3% 49.6% Grade 3-8 & 11 (AYP) 91.6% 90.9% NCLB requires 95% participation for AYP. Our grade 11 participation pulled down our overall participation rate to lass than 95%. We are waiting to hear from the feds what the ramifications are for WA. The Dept of Ed is waiting for data from all states before providing us with information.

Impact of Refusals on Proficiency Rates English Language Arts Mathematics Grade Proficiency of Tested Students Proficiency of All Enrolled Grade 3 53% 52% 58% 57% Grade 4 56% 55% 54% Grade 5 59% 49% 48% Grade 6 47% 46% Grade 7 50% Grade 8 HS (11) 26% 29% 14% Grade 11 is an anomaly. A refusal earns a score of zero. 14% is the number we must report to the feds. This number was calculated by including zero scores.

ELA Smarter Balanced College and Career Ready Proficiency Rates HS – grades combined 66% Grade 10 (with 97% participation) 74% Grade 11 (with 53% participation) 52% 10th grade participation was strong – students took exam in 10th grade for the exit exam requirement. Of those who took the test, 74% passed the College and Career Ready cut score. These scores will be banked for these students, who will not need to take the test in 11th grade for accountability. More about the exit exam pass rate coming up.

ELA Smarter Balanced College and Career Ready Proficiency Rates Grade 10 74%

Test Format for Smarter Balanced Tests ELA Online ELA Paper Mathematics Online Mathematics Paper Grades 3-5 97% 3% Grades 6-8 98% 2% Grade 10 74% 26% NA Grade 11 96% 4% All Grades 95% 5% 47 districts used paper/pencil on some level. We In 2015, districts were charged $6 per test for paper/pencil Smarter Balanced test booklets, except for grade 10 ELA. For 2015-2016, districts will be charged $6 for all Smarter Balanced booklets, including grade 10 ELA.

MSP Science – Grades 5 and 8 (Biology EOC delayed) Percent Proficient Science is not a part of the common core state standard standards. An update on a new science assessment is coming up in a few slides. MSP Science Biology EOC

Status on Assessment Graduation Requirements

2015 Proficiency Rates on New Mathematics EOC Exit Exams 2015 Percent Avg 2012, 2013, & 2014 Year 1 mathematics – Alg 1/ Int 1 57% Year 2 mathematics – Geo/Int 2 68% 69%

ELA and mathematics Exit Exam Threshold Scores Adopted by State Board Smarter Balanced Threshold Score Grade 11 Grade 10 English Language Arts 2548 Level 2 61.2% 80.1% Mathematics 2595 37.8% NA ELA 2299-2492 2493-2582 2583-2681 2682-2795 High School Score Ranges Level 1 Level 2 Level 3 Level 4 Mathematics 2280-2542 2543-2627 2628-2717 2718-2862

Progress Report for Class of 2015-12th Graders (as of August 11, 2015 CEDARS)* *High School Graduation Requirement for students in the class of 2015 is to meet standard on both an ELA and mathematics Assessment.

Reports and Reporting

Reports and Reporting Reports Due In District Everything but EOC: Week of 7 September EOC: Following week No special reporting sort for this year Report Card - Suppressed Data: http://reportcard.ospi.k12.wa.us/Suppression_Overview_3v3.docx Grade 10 ELA and EOC mathematics scores No reporting of graduation-only assessments “Graduation Only” is not “Non-Accountability” EOC data represents ‘pass rates’ not ‘proficiency’ New “Graduation Progress Report” tab

Paper Reporting Packing Specifications Score reports will be packaged in the following sequence: school, grade, content, student There is no option to apply a special sort to reports being delivered in September 2015. OSPI is working with AIR for enhancements in 2016. Reports will arrive on the following schedule Sept. 7-9: HSPE, off-grade, science MSP, and SBA Sept. 15-16: EOC mathematics and biology

Content-Related Developments

ELA Teacher Hand Scoring Materials - Update The Teacher Hand Scoring Materials are now located under the THSS Materials tab in TIDE. The comments, or annotations, that accompany each student response in the ELA Exemplar sets have been updated. The Performance Task at 8th grade has been replaced with a new Performance Task. For the 2014-2015 school year, Teacher Hand Scoring Materials were located under the Download Forms tab in TIDE. That tab is now renamed THSS Materials. The Exemplar sets include the item, actual student responses, and comments to explain how that response earned points. The item and student responses remain unchanged, however the comments have now been updated to provide clearer explanations. If you printed the Exemplar sets last year you will want to recycle those and access the refreshed versions. The sources in the 8th grade Interim Performance Task from the 2014-2015 school year lost permission rights so it has been replaced with a new 8th grade Performance Task. TIDE is currently open and these updated resources are available now.

Assessment Literacy Modules in the Digital Library

Key Assessment Literacy Modules in the Digital Library Assessment Coordinators Understanding the Smarter Balanced Assessment System Understanding the Smarter Balanced Interim Assessments Understanding the Smarter Balanced Summative Assessments Coaches and Classroom Teachers Understanding the Formative Assessment Process The Components of Effective Feedback Clarifying Intended Learning, Eliciting Evidence, Interpreting Evidence, Acting on Evidence (4 different modules)

New Science Tests: Major shifts New science tests aligned to the WA State 2013 Science Learning Standards (NGSS) will: Be administered online for all grades Have the science and engineering practices embedded throughout Be comprehensive for high school (Physical, Life, Earth and Space, and Engineering Design) Assess the 3rd, 4th, and 5th grade standards on the grade 5 test

New Science Tests: Development Overview Fall 2015: Begin development of assessment items Spring 2016: Limited pilot test Spring 2017: Full pilot test Spring 2018: Operational test in grades 5, 8 and 11

New Science Tests: Upcoming Activities Educator survey in mid-September: Prioritize the Performance Expectations for purposes of the summative tests Item Writing: Grade 5: October 12-16 Grade 8: October 19-23 Content Review: Grade 5 and 8: December 7-10

Technology

Secure Browser for 2015-16 is Available Available on WCAP Portal at http://wa.portal.airast.org Can be used for Practice Tests (or can use other supported browsers) Must be used for optional Interim Assessments Install Version 8.0 on Windows or Macintosh, will replace old browser from spring 2015 (version 7.2) Reminder: Mac OS X 10.4.4 is no longer supported (announced earlier) Note that Windows 10 is NOT supported at this time; MAY be supported later this year

TIDE: Order Module Proposed Changes for Spring 2016

“Track shipments” in TIDE for Spring 2016 “Track Shipments” tab will be displayed in TIDE. Track outbound shipment materials Tracking numbers for orders shipped from TIDE Integration with the shipping carriers to show status of shipment Display Packing Lists in TIDE This is the same packing list that will be shipped along with the actual materials. Display Shipping manifests in TIDE Display Security Checklists (if any)

Shipment tracking information (links to shipping sites) Packing list: same as the one shipped with materials Checklists for secure materials Return material tracking

Sample Packing List (PDF)

Sample Box List (PDF)

Sample Security List (PDF)

Proposed changes for Spring 2016 Integration of the tracking information, packing lists, security checklists and shipping manifests with individual orders. Above information available directly on the “Order History” and “Order Details” page in TIDE. Support for tracking return shipment of answer documents

Mockups of Proposed Changes

Track shipments and Reports

Direct access to tracking numbers

Direct access to all documents associated with the order

New “Order Detail” page will have all information associated with the order

Customer Service

Customer Service 2015-2016 Improvements Response Time Based on metrics from last year, modifications to Help Desk structure and knowledgebase will improve quality and timeliness of responses Additional customer service representatives added Retained staff over summer Knowledgebase Enhanced for faster searching of topics Updated to be state-specific Password Resets Most frequently requested support (44% or all requests) New interface will allow users to reset their own password or call dedicated agent to assist.

GovDelivery Best way to stay informed via OSPI emails Go to website to sign up at http://www.k12.wa.us/default.aspx Encourage your colleagues to do the same

Contacts AIR Help Desk for Technical, Network, and password issues AIR Help Desk: wahelpdesk@air.org 1-844-560-7366 OSPI Assessment Analysts for student data issues OSPI Assessment Analysts: assessmentanalysts@k12.wa.us 360-725-6109 OSPI Assessment Operations for assessment policy and test materials Assessment Operations Assessment@k12.wa.us (800) 725-4311, press option 3 WCAP Portal http://wa.portal.airast.org/ The Washington State Board of Education http://www.sbe.wa.gov/

February 27, 2014 Thank you!