1. Smarter Balanced Assessments 2014-15
Webinar #5
February 10, 2015

2. Today’s Topics Introduction/Newsflashes Digital Library
Interim Assessments
Summative Assessments
Portal

3. Alphabet Soup Assessment and Registration Tool (ART)
Digital Library User Sign-on
Test Information Distribution Engine (TIDE)
Managing and editing users/students
Registering students for tests
Selecting supports and accommodations
Processing and viewing test invalidations
Test Delivery System (TDS)
Test Administrator Interface
Student Interface
Teacher Hand Scoring System (THSS)
Online Reporting System (ORS)
Next I’m going to talk a little bit about the Test Delivery System, or TDS. The TA Interface and the Student Interface make up the Test Delivery System. These interfaces are what the proctors and the students use to administer and take tests. I’m going to do a brief demo of how a TA sets up a test session, how students get into that session, and how the students navigate through the test. But first just a few things to note. <next slide>

4. Training Training Webinars Technical Requirements
Tuesday, February 3, 3:00 pm PT
Thursday, February 5, 10:00 am PT
TIDE (Test Information Distribution Engine)
Friday, February 27, 3:00 pm PT
Thursday, February 19, 10:00 am PT – preceding TDS Webinar
Test Delivery System (TDS)
Thursday, February 19, 11:00 am PT – following TIDE Webinar
Thursday, February 26, 1:00 pm PT
Online Reporting System (ORS)
Tuesday, February 24, 3:00 pm PT
Thursday, February 26, 10:00 am PT
Teacher Hand Scoring System (THSS)
Wednesday, February 25, 2:00 pm PT

5. Bring Your Own Device (BYOD)
BYOD is an option some districts may want to utilize by allowing students to use their own (technology) devices.
Intended for districts that have already implemented BYOD and have sufficient district capacity to ensure equity of access.
OSPI has developed a policy for districts. The document is posted to the portal.

6. Secure Browser Updates
Secure App that supports iOS 8 on iPad released 1/26 ("AIRSecureTest" on App Store)
All other Secure Apps & Secure Browsers posted in Dec. are already up-to-date
No additional changes or updates are expected prior to Summative Assessment window

7. Digital Library Educator resources for formative assessment practices
10/13/2018
Digital Library
Educator resources for
formative assessment practices
to improve instruction

8. Digital Library Modules now available in the Digital Library:
31 math Exemplar Instructional Modules
31 ELA Exemplar Instructional Modules
30 Assessment Literacy Modules
10 Score Report Modules

9. 10/13/2018
Interim Assessments

10. Interim Assessments Timeline
Interim Assessments are available
Comprehensive Interim (ICA)
Interim Assessment Blocks (IAB)
Teacher Hand Scoring System (THSS) opened January 27
Written responses are hand scored by the teacher/educator (selected responses are machine scored.)
Overall score will be generated after hand scoring is complete.
Exemplars are provided for teachers to practice scoring
Training Guides are provided to give teachers materials to support the scoring
Administration times vary depending on the grade and block. In general, a non-PT block requires approximately one hour and a PT block requires up to two hours.

11. Teacher Hand Scoring System Materials
10/13/2018
Teacher Hand Scoring System Materials
Materials used by educators to score Smarter Balanced interim assessment items
Washington State Office of Superintendent of Public Instruction
10/13/2018
Washington State Office of Superintendent of Public Instruction

12. Snapshot of Materials’ Location
10/13/2018
Snapshot of Materials’ Location 2 1
When teachers log in to the Teacher Hand Scoring System (THSS) to score responses, each item will have an Exemplar Tab and a Training Guide Tab.
Washington State Office of Superintendent of Public Instruction
10/13/2018
Washington State Office of Superintendent of Public Instruction

13. Training Guide - ELA Cover page: Instructions by claim
10/13/2018
Training Guide - ELA
Cover page: Instructions by claim
Stimulus or sources
Item stem
Rubric(s)
Condition code document
Claim and target chart
Washington State Office of Superintendent of Public Instruction
10/13/2018
Washington State Office of Superintendent of Public Instruction

14. Take a Look at ELA Training Guides
10/13/2018
Take a Look at ELA Training Guides
This screenshot is only a placeholder.
Washington State Office of Superintendent of Public Instruction
10/13/2018
Washington State Office of Superintendent of Public Instruction

15. Exemplars - ELA Prep Set Check Set Key to Check Set Scores
~10 student response papers
Ordered 2, 1, 0
Includes metadata, item stem, student response, and scoring comments (when available)
Check Set
Randomly ordered
Include metadata, item stem, and student response
Key to Check Set Scores
Included scores and scoring comments (when available)
Washington State Office of Superintendent of Public Instruction
10/13/2018

16. Take a Look at ELA Exemplars
10/13/2018
Take a Look at ELA Exemplars
This screenshot is only a placeholder.
Washington State Office of Superintendent of Public Instruction
10/13/2018
Washington State Office of Superintendent of Public Instruction

17. Training Guide - Mathematics
Cover page
Stimulus for Performance Task
Metadata table
Item stem
Dependent item stem (if applicable)
Rubric and exemplar response
Condition code document
Washington State Office of Superintendent of Public Instruction
10/13/2018

18. Take a Look at Mathematics Training Guides
10/13/2018
Take a Look at Mathematics Training Guides
This screenshot is only a placeholder.
Washington State Office of Superintendent of Public Instruction
10/13/2018
Washington State Office of Superintendent of Public Instruction

19. Exemplars - Mathematics
10/13/2018
Exemplars - Mathematics
Prep Set
~5-10 student response papers
Ordered full credit, partial credit, no credit
Includes metadata, item stem, student response(s) to dependent item(s) (if applicable), student response, and scoring comments
Check Set
Randomly ordered
Includes metadata, item stem, student response(s) to dependent item(s) (if applicable), student response
Key to Check Set Scores
Included scores and scoring comments
This is so small, would it be better on two slides/
Washington State Office of Superintendent of Public Instruction
10/13/2018
Washington State Office of Superintendent of Public Instruction

20. Take a Look at Mathematics Exemplars
10/13/2018
Take a Look at Mathematics Exemplars
This screenshot is only a placeholder.
Washington State Office of Superintendent of Public Instruction
10/13/2018
Washington State Office of Superintendent of Public Instruction

21. Snapshot of Materials’ Location
10/13/2018
Snapshot of Materials’ Location
Prep and Check Sets
Instructions and Information
When teachers log in to the Teacher Hand Scoring System (THSS) to score responses, each item will have an Exemplar Tab and a Training Guide Tab.
Washington State Office of Superintendent of Public Instruction
10/13/2018
Washington State Office of Superintendent of Public Instruction

22. Interim Assessments Interim Assessment Blocks (IABs) for ELA
The non-PT ELA blocks have questions.
Each ELA block contains a different amount of hand scored items:
Listening, Research and Edit/Revise blocks are all machine scored
Brief Write blocks are all hand scored
Reading Lit and Reading Info blocks have1-2 hand scored items per block
All PT blocks have three questions and a full write.
Two Research items and the Full Write are hand scored.
One Research item is machine scored.

23. Interim Assessment Blocks: ELA
ELA Block
# of items
Response type
Estimated Time*
Reading Lit
13-15
Mostly machine scored, a few hand scored
45 min -1 hour
Reading Info
14-16
Brief Write
6 brief writing tasks
All hand scored
Edit/Revise
13-16
All machine scored
30 min
Listening
Research
17-18
All Performance Tasks
3 items and 1 full write
Mostly hand-scored
1-2 hours, including 30 minutes for the classroom activity.
*Estimated time is based on 1-2 minutes to answer a MC question and up to 5 to answer a constructed response. Plus time to read stimulus/sources.

24. Interim Assessment Blocks, 2014-15: Math, Grades 3-5
Math Blocks
# of items
Response type
Estimated Time*
Grade 3
Operations & Alg. Thinking
Fractions
Measurement & Data
13–16
All machine scored
30 min–45 min
Grade 4
Number & Operations in Base 10
Grade 5
Geometry
Grades 3 & 4
Performance Task 6
Mostly hand scored
1:30 hour, including 30 minutes for the classroom activity.
*Estimated times for the CAT are based on 1–2 minutes to answer a Claim 1 question and 2–6 minutes to answer a Claim 2, 3, or 4 question.

25. Interim Assessment Blocks, 2014-15: Math, Grades 6-8
Math Blocks
# of items
Response type
Estimated Time*
Grade 6
Ratios & Proportional Relationships
Number System
Expressions & Equations
Geometry
13–16
All machine scored
30 min–45 min
Grade 7
Grade 8
Expressions & Equations – I
Expressions & Equations – II
Functions
Grades 6, 7, & 8
Performance Task 6
Mostly hand scored
1:30 hour, including 30 minutes for the classroom activity.
*Estimated times for the CAT are based on 1–2 minutes to answer a Claim 1 question and 2–6 minutes to answer a Claim 2, 3, or 4 question.

26. Interim Assessment Blocks, 2014-15: Math, High School
Math Blocks
# of items
Response type
Estimated Time*
Algebra & Functions
Linear Functions
Quadratics
13–16
All machine scored
30 min–45 min
Geometry
Right Triangle Ratios
High School
Performance Task 6
Mostly hand scored
2:00 hour, including 30 minutes for the classroom activity.
*Estimated times for the CAT are based on 1–2 minutes to answer a Claim 1 question and 2–6 minutes to answer a Claim 2, 3, or 4 question.

27. IAB Reporting Individual student scores are available for each block.
Reporting for each block is based on three classifications related to the overall scale score cut point between levels 2 and 3: “Below Standard,” “At/Near Standard,” and “Above Standard.”
Each IAB (as well as ICA) can be administered unlimited times to a classroom.

28. Practice and Training Tests
The Smarter Balanced Practice and Training tests are available now on the WCAP portal:
Practice and Training tests provide both test administrators and students a thorough review of the test in preparation for the summative assessment.
Most often, the Practice and Training tests can be administered in lieu of the interims, especially with Practice Test using the secure browser.

29. Practice and Training Test options
This is how students can take practice tests at home, for example, or how a member of the public can take a practice test
Guest student Guest session
Requires a Test Administrator with a user account in TIDE
Guest student Real session
Requires the student to be present in TIDE and requires a Test Administrator with a user account in TIDE
This most closely mimics the operational environment
Real student Real session
There are a few different ways for proctors and students to practice taking tests
As a guest “student” taking a test in a guest session, no TA is required. This is how parents or other members of the public can take tests at home to see what they’re like.
In order to set up a “real” training session, a TA needs to log in to the training site with his/her credentials from TIDE. For this option, anyone can be a student – a teacher, principal, student, etc. They just sign in as a guest.
In this last option, the TA logs in to the training site with her or her user credentials, and the student logs in using their credentials as well. The benefit to doing it this way is that it’s just like how it works for the operational tests. And students get to practice using whatever accommodations are assigned to them in TIDE (as well as anything the TA sets for the student in the TA interface at the time of testing).

30. Summative Assessments
10/13/2018
Summative Assessments

31. Summative Assessments
Test Administrator Certification
Student Readiness
Reporting

32. Test Administrator Certification
Test Administrator (TA) certification module will be posted to the portal
Narrated
Interactive
Takes approximately 30 minutes
Short quiz at end of module
Provides a Certificate
Certification module is not required by OSPI but recommended that districts use as part of TA training

33. Student Readiness for Smarter Balanced
Ensure students have at least two opportunities at school for guided practice with assessment tools and question types
Use sample performance tasks or optional Interim Assessments to give students experience with math and ELA performance tasks
Provide student keyboarding/data input opportunities in grades K-2 to ensure readiness for grade 3 online assessments

34. Student Readiness - continued
Provide additional keyboarding opportunities for grades 3-6 to ensure readiness for Smarter Balanced writing tasks
Partner with libraries and community organizations to promote equity of access to technology for students outside of school time
Consider loaning machines or providing useable surplus machines to needy students
K-2 checklist – Educational Technology

35. K12 Checklist – Education Technology

36. Computer Adaptive Test: Information on Item and Response Types

37. Summative Reporting
Scores are available in the Online Reporting System within three weeks of completing online tests and submitting paper/pencil tests.
Paper/Pencil tests are submitted by school (ELA and math) except for grade 3 ELA. Grade 3 ELA paper/pencil tests can be submitted in batches before other grades/content areas are completed, in order to have results within three weeks of receipt.

38. What Folks Seem to Want To Know (aside from everything)
Pre-ID
Where do I find student lists?
Where to edit test flags?
NEW DETAILED DOCUMENT ON PORTAL!
Reports and Data
What gets reported?
What do the reports look like?
NEW USER GUIDE AND MODULE ON PORTAL!
Is there a one-page document that explains everything?

39. Pre-ID New Document on the Portal: PreIDdetailsSpring2015.pdf
All test windows, all pre-ID rules, all pre-ID timelines
Includes where to go to find lists of students since pre-ID ongoing now (rather than a series of static exports)
Non-EOC standard paper materials generated based on records in TIDE on 1/30
Accommodated forms/kits data sent 2/9
How to do ‘New and Moved’ for paper administrations
EOC Registration (including accommodated forms) still open through 16 March

40. Available Data in ORS Content Specifications:
ORS Module is available – provides great screenshots and descriptions in better detail; these screenshots are literally lifted from those modules
State assessments have never reported below ‘claim’ level before now; claims are still reported at the student level
Target Level Data is only available in aggregate, only from adaptive tests, and only once a critical mass of students has been reached – roughly a classroom worth of students.
Assessments aren’t built to have one pass/fail item per standard or target
Long term goal is to link target data back to digital library resources (don’t want to over-promise too much too early)
Content Specifications:
ELA and Math Assessment offices Content offices also preparing supplementary documents

41. Home Page Dashboard: Report Tables
General rule: click the thing you want to see to get to the next most granular level
The Home Page Dashboard page displays aggregate data for each subject in a separate table.
Grade displays the grade to which the score data belongs.
Number of Students Tested displays the number of students to date who have completed and submitted their tests for scoring.
Percent Proficient displays the percentage of students to date who have scored proficient on each test.
To access score reports for a particular subject and grade-based test, click a cell for the selected grade and subject. You will only see the tests administered by your district or school. Once a cell is selected, you will be directed to the selected Subject Detail Report.

42. Subject Detail Report
This example shows the information a district user will see on the Subject Detail Report. It shows the list of schools in the district and their aggregate score data.
You can sort the data, show/hide columns, disaggregate data by subgroups and/or test events, and show or hide comparison data.
To disaggregate the score data by a specific demographic subgroup category, from the [Breakdown By] filter, select a group and click [Go]. The report expands to display the data for each subgroup. For example, you can select gender to see the score data for All, Female, and Male students.
To disaggregate the score data by a specific test event, from the [Test Event] filter, select an accommodation and click [Go]. The report expands to display the data for each subgroup.
To drill down to a more detailed level, such as Teacher List, click the magnifying glass next to the school name, then select [View Personnel] on the exploration menu that pops up.

43. Individual Student Reports
The students’ individual score report presents a graphic representation of proficiency, along with a parent-friendly description of what it means. It includes more detailed diagnostic information and comparison scores for the class, teacher, school, district, and state. It also includes student performance on each claim along with a description of each claim.
You can batch print individual student reports in a PDF. The PDF reports can be accessed from the [My Inbox] of Test Management Center.

44. Your One-Page To-Do List:
READ AND WATCH EVERYTHING (AND DON’T PANIC)

45. Portal

46. WCAP Portal
Please share widely with all district and school personnel OSPI’s Smarter Balanced page at as well as AIR’s WCAP portal at

47. WCAP Portal

48. February 27, 2014
Thank you!