1. RESEARCH AND EVALUATION Test Coordinator Meeting December 18, 2014

2. RESEARCH AND EVALUATION Agenda Welcome/Introductions Technology Update Smarter Balanced Interim Assessments ICA-Interim Comprehensive Assessment IAB-Interim Assessment Blocks Washington Comprehensive Assessment Program – WCAP Questions??? Closing Remarks Time:4 to 6 p.m. Location:CAB Auditorium

3. RESEARCH AND EVALUATION Welcome and Introductions Research and Evaluation Pat Cummings Director of Research & Evaluation Linda Medford Coordinator Student Assessment Lindsay Franklin Assessment Specialist Special Guest Thea Turnley-Student System Specialist Curriculum and Instruction Roy Tatlonghari Instructional Facilitator Nicolle Wambold Instructional Facilitator Technology Glenn Desseau Manger Technology Field Technicians

4. Technology Update Software deployments are occurring between 6 a.m. – 9 a.m., depending on site schedules. Remember: Connect all new COWs to power and data every night. Connect all laptops in new COWs to power and data every night. Contact HELP at 253.571.4357 or HELP@Tacoma.k12.wa.us for assistance.HELP@Tacoma.k12.wa.us

5. Technology Update Number of Schools with SBAC Software Deployed26 Elementary Schools22 Middle Schools3 High Schools1 Total Number of Managed Cart Laptops1,708 Laptops with Software700 Success Rate41% Percentage of district machines with SBAC software 25% Total number to date3000

6. SBAC Interim -Comprehensive and Blocks Interim Assessments Timeline  Interim Assessments will be available Jan 6 (more information to come after the Test Administration Manual is completed and the secure browser is installed)  Jan 6 – Comprehensive Interim  Jan 27 – Interim Assessment Blocks  Initial release will include fixed forms; adaptive forms will be available as the item pool allows Interim Assessments Interim Comprehensive Assessment (ICA) Interim Assessment Blocks (IAB) Comprehensive (ICA) are almost identical to the end- of-year Smarter Balanced assessments. They take as long to administer (total of 7 to 8 hours), and report scores as composite scale scores, achievement levels and ‘claims”total of 7 to 8 hours Blocks (IAB) are short tests organized by “claims” Examples or current thinking on test design: ELA Math (Grades 3-5) Math (Grades 6-7) Math (Grade 8) Math High School  There are two types of Interim Assessments:  Comprehensive  Blocks

7. Interim Comprehensive Assessments (ICAs) Interim Comprehensive Assessments (ICAs) use the same blueprints as the summative assessments and assess the same standards. They will be provided as fixed forms and will become adaptive when item counts are adequate. The ICAs include the same item types and formats, including performance tasks, as the summative assessments, and yield results on the same vertical scale. The ICAs yield overall scale scores, overall performance level designations, and claim-level information. Interim Comprehensive Assessment (ICA)

8. ICA Reporting ICA reporting is the same as for the summative assessment:  Overall scale score with error band endpoints and achievement level per content area/subject.  Claim score reporting is based on three classifications related to the overall scale score cut point between levels 2 and 3. Interim Comprehensive Assessment (ICA)

9. Interim Assessment Blocks (IABs) Interim Assessment Blocks (IABs) focus on smaller sets of targets and therefore provide more detailed information for instructional purposes. The blocks are available either as fixed forms or with the use of a computer adaptive algorithm. The IABs yield overall information for each block. Interim Assessment Blocks (IAB)

10. IAB Reporting Individual student scores are available for each block. Reporting for each block is based on three classifications related to the overall scale score cut point between levels 2 and 3: 1.Below Standard 2.At/Near Standard 3.Above Standard Interim Assessment Blocks (IAB)

11. IABs for ELA Grades 3 – 5 IABs for ELA Grade 3 – 5 1Read Literary Texts 2Read Informational Texts 3Edit/Revise 4Brief Writes 5Listen/Interpret 6Research 7Narrative Performance Task* Gr 4 and 5 only in 2014-2015 8Opinion Performance Task* N/A in 2014-2015 9Informational Performance Task* Gr 3 only in 2014-2015 * This is a full Performance Task as students experience in the summative assessment

12. IABs for Mathematics Grade 3 1Operations and Algebraic Thinking 2Numbers and Operations in Base 10 Not available in 2014-2015 3Fractions 4Measurement and Data 5Mathematics Performance Task* * This is a full Performance Task as students experience in the summative assessment

13. IABs for Mathematics Grade 4 1Operations and Algebraic Thinking 2Numbers and Operations in Base 10 3Fractions 4Geometry- Not available in 2014-2015 4Measurement and Data 5Mathematics Performance Task* * This is a full Performance Task as students experience in the summative assessment

14. IABs for Mathematics Grade 5 1Operations and Algebraic Thinking 2Numbers and Operations in Base 10 3Fractions 4Geometry 5Measurement and Data - Not available in 2014-2015 6Mathematics Performance Task* - Not available in 2014-2015 * This is a full Performance Task as students experience in the summative assessment

15. IABs for ELA Grades 6-8 1Read Literary Texts 2Read Informational Texts 3Edit/Revise 4Brief Writes 5Listen/Interpret 6Research 7Narrative Performance Task* Not available in 2014-2015 8Opinion Performance Task* Not available in 2014-2015 9Informational Performance Task* * This is a full Performance Task as students experience in the summative assessment

16. IABs for Mathematics Grades 6-8 IABs for Mathematics Grades 6-7 1Ratios and Proportional Relationships 2Number System 3Expressions and Equations 4Geometry - Not available at Gr 7 in 2014-2015 5Statistics and Probability - Not available in 2014-2015 6Mathematics Performance Task* IABs for Mathematics Grade 8 1 Expressions and Equations – I (and Proportionality) - Available with #2 as a single Expressions & Equations Block in 2014-2015 2Expressions and Equations - II 3Functions 4Geometry 5Mathematics Performance Task* * This is a full Performance Task as students experience in the summative assessment

17. IABs for ELA High School 1Read Literary Texts 2Read Informational Texts 3Edit/Revise 4Brief Writes 5Listen/Interpret 6Research 7Explanatory Performance Task* Not available in 2014-2015 8Argument Performance Task* * This is a full Performance Task as students experience in the summative assessment

18. IABs for Mathematics High School Algebra and Functions 1Linear Functions 2Quadratics 3Exponentials – Not available in 2014-2015 4Polynomials – Not available in 2014-2015 5Radicals – Not available in 2014-2015 6Rationals – Not available in 2014-2015 7Trigonometric – Not available in 2014-2015 Geometry 8Transformations – Not available in 2014-2015 9Right Triangle Ratios 10Three-Dimensional Geometry – Not available in 2014-2015 11Proofs – Not available in 2014-2015 12Circles – Not available in 2014-2015 13Applications – Not available in 2014-2015

19. IABs for Mathematics High School Other 14Interpreting Categorical and Quantitative Data – Not available in 2014-2015 15Probability – Not available in 2014-2015 16Making Inferences and Justifying Conclusions – Not available in 2014-2015 17Mathematics Performance Task* * This is a full Performance Task as students experience in the summative assessment

20. Preparing for New Test Scores  Smarter Balanced assessments measure the full range of the Common Core State Standards. They are designed to let teachers and parents know whether students are on track to be college- and career-ready by the time they graduate.  Because the new standards set higher expectations for students--and the new tests are designed to assess student performance against these higher expectations--our definition of grade level performance is higher than it used to be.  As a result, it’s likely that fewer students will meet grade level standards, especially for the first few years. Results should improve as students have additional years of instruction aligned to the new standards and become better equipped to meet the challenges they present.  This does not mean that our students are “doing worse” than they did last year. Rather, the scores represent a “new baseline” that provides a more accurate indicator for educators, students, and parents as they work to meet the rigorous demands of college and career readiness.

21. Option #1 for SBAC Interim Assessments TBD Comprehensive (ICA)  Available first week January  Almost identical to the end-of-year Smarter Balanced assessments except is fix and not adaptive  Total of 7 to 8 hours (most likely longer)  Teacher have to score items (how many and what training is need not yet available)  Report scores as composite scale scores, achievement levels and ‘claims’  Teacher training materials regarding this option not yet available

22. Option #2 for SBAC Interim Assessments TBD Blocks (IAB)  Available last week of January  Short tests organized by “claims” (not all claims are available… information it trickling out)  Test are 1 to 2 hours for each subject (ELA/Math)  Teacher have to score items (which items and what training is need not yet available)  Report scores as met standard only  Assessment map (what specific items are tested) is not available  Whether the Block will include a performance activity is not available  Teacher training materials regarding this option not yet available

23. Option #3 for SBAC Interim Assessments TBD Practice Test (Kent Model... must do all three options)  Option is available now.  Includes a classroom teaching activity (for each grade and subject.. 30 to 60 minutes) & a performance task (computer based- 60 minutes) that is connected to the activity.  Is followed with the complete online practice test that teaches all the tools (approximately one hour). Comments:  Do not get scores back  Worked very well last year in other districts  Can do anytime  Can be controlled and monitor from district (we send schedule and copies of performance tasks)  Provides exposure to both tools (online) and performance activities  Training is activities are easier to manage and can be consolidated  Less stressful for teachers and students  The Portal has yet to link the practice test so we do not know if students will log in as guest or through their student account  After the WCAP Portal test is available we will review and determine if more scripted teacher training materials are necessary to supplement the activity… this will be in a model similar to Emily Bannon’s Digital Library tutorial.

24. Washington Comprehensive Assessment Program – WCAP Portal Located on the Web: http://wa.portal.airast.org/ Student and Families Coming Soon Test Administrators Test Coordinators Technology Coordinators

25. WCAP - Test Administrators General Information – Teacher Fact Sheet User Guides and Manuals Online Reporting System – ORS User Guide – coming soon Guidelines on Tools, Supports, Accommodations for State Assessments Test Information Distribution Engine – TIDE – coming soon Smarter Balanced Usability, Accessibility, and Accommodations Guidelines – coming soon Smarter Balanced Accessibility and Accommodations Implementation Guide – coming soon Smarter Balanced Test Administration Manual TAM – coming soon

26. WCAP - Test Administrators (Continued) Assessment Resources Grades 3-5 Grades 6-8 High School  Classroom Activities for ELA and Math  Smarter Balanced Usability, Accessibility, and Accommodations Guidelines – coming soon  Smarter Balanced Accessibility and Accommodations Implementation Guide – coming soon

27. Modules  Test Information Distribution Engine (TIDE) Training Module – coming soon  ORS Training Module – coming soon  Smarter Balanced Performance Task Training Module  Smarter Balanced Accessibility and Accommodations Training Module – coming soon  Embedded Universal Tools and Online Features Module – coming soon  Test Administrator Online System Interface Module [PPTX] Test Administrator Online System Interface Module  Student Testing Interface Training Module – coming soon WCAP - Test Administrators (Continued)

28. WCAP – Test Coordinators General Information – Smarter Balanced Field Test Report User Guides and Manuals Online Reporting System – ORS User Guide – coming soon Guidelines on Tools, Supports, Accommodations for State Assessments Test Information Distribution Engine – TIDE – coming soon Smarter Balanced Usability, Accessibility, and Accommodations Guidelines – coming soon Smarter Balanced Accessibility and Accommodations Implementation Guide – coming soon Smarter Balanced Test Administration Manual TAM – coming soon

29. Assessment Resources Grades 3-5 – Grades 6-8 – High School Classroom Activities for ELA and Math Smarter Balanced Usability, Accessibility, and Accommodations Guidelines – coming soon Smarter Balanced Accessibility and Accommodations Implementation Guide – coming soon Achievement Level Descriptors (ALD) Glossary of Terms [PDF] Achievement Level Descriptors (ALD) Glossary of Terms Smarter Balanced Adaptive Software[PDF] Smarter Balanced Adaptive Software Smarter Balanced Infographics Chart Smarter Balanced Infographics Chart WCAP – Test Coordinators (Continued)

30. Modules  Test Information Distribution Engine (TIDE) Training Module – coming soon  ORS Training Module – coming soon  Smarter Balanced Performance Task Training Module  Smarter Balanced Accessibility and Accommodations Training Module – coming soon  Embedded Universal Tools and Online Features Module – coming soon  Test Administrator Online System Interface Module [PPTX] Test Administrator Online System Interface Module  Student Testing Interface Training Module – coming soon WCAP – Test Coordinators (Continued)

31. WCAP – Technology Coordinators General Information What is a CAT? [PPTX] What is a CAT? Smarter Balanced Performance Task Training Module [PPTX] Smarter Balanced Performance Task Training Module

32. Technical Information Online System Requirements Guidelines [DOCX] Online System Requirements Guidelines Braille Requirements Documents for Online Systems – coming soon System Support Sunset Document – coming soon Technical Specifications for the Online System [DOCX] Technical Specifications for the Online System Technology Requirements for the Online Systems Training Module[PPTX] Technology Requirements for the Online Systems Training Module What is a CAT? [PPTX] What is a CAT? Smarter Balanced Performance Task Training Module [PPTX] Smarter Balanced Performance Task Training Module Secure Browser Installation Guide[DOCX]Secure Browser Installation Guide Smarter Balanced Accessibility and Accommodations Training Module – coming soon Embedded Universal Tools and Online Features Module – coming soon Student Testing Interface Training Module – coming soon WCAP – Technology Coordinators (Continued)

33. Test Information Distribution Engine - TIDE TIDE Tasks Upload/edit staff records and roles Load accommodations and test settings Managing student rosters (only your enrolled students) Additional Materials Orders – coming soon CEDARS tasks NOT TIDE TASKS Adding/deleting students Editing student demographics or biographic info Flagging exempted students (home/private/F1 if enrolled)

34. TIDE (Continued)

35. What OSPI will do?  Load initial staff records to TIDE  DAC=DC; Designees=DA  Emails will arrive as TIDE goes live 12/19 (unless TIDE is delayed by testing)  Load unique student records to TIDE  Provide list in WAMS of shared and/or dual primary SSIDs for review TIDE (Continued)

36. What to do right now?  Prep local security settings for emails Separate email coming from OSPI  Alert teachers that emails will be generated 3 day expiration on temp password Can use ‘forgot password’ without security questions after temp password expires  Upload staff records with roles TIDE (Continued)

37. Digital Library – Training Video

38. Information on SBAC Field Test Plan for training well in advance of testing. Evaluate how well the training is going with teachers and administrators, and revise or regroup as needed. Test equipment early and check all laptops that will be used for testing at least a few weeks before online test administration. Be sure computers are completely shut off and restarted once a week and also restarted the morning of testing before the test session. Make sure there are enough headphones for test sessions. Trouble-shoot any technical issues with the practice and training tests. The teacher/proctor needs to be very active and watch students testing.

39. Students’ Advice for Teachers Preparing Students for the SBAC Be calm know that your class is going to do well. Have them do a couple practice sessions so they know what to do when they actually take the test. They always need to walk around the room or classroom so they can see if the student needs help because sometimes a student is raising their hand and the teacher does not see. Do not get your kids worried about the test. Tell them it is just like any other test. Remember to tell them to relax and just do their best. Also, tell them to check their work multiple times so they can check each question and make sure they got it correct. Make sure students know that there is a spell check and dictionary available when they are working on the essay. Encourage the student to go slow, take their time, and read every question closely. I would tell them to take time to prepare the class for the test because I feel like I did not have enough time to learn and review all the things that were in the test. Advice I would give to my teacher who is preparing this next year is kind of nothing. The teachers did a great job!

40. Modal response was “in between easy and hard.” Grade 8 and 11 students reported more hard and very hard responses than younger grade levels. “In general, I thought the Smarter Balanced Assessment was” by Grade Level

41. The spell check, writing tools, highlighter, calculator, zoom, and English dictionary were used by at least 40% of students taking the field test. The other tools were used to a lesser extent. “Please tell us how you felt about each of the online tools” (Percent that used and found each tool helpful in green)

42. RESEARCH AND EVALUATION ?????????????? Questions

43. RESEARCH AND EVALUATION Pat Cummings, Director pcummin@tacoma.k12.wa.us 253-571-1280 Linda Medford, Coordinator Student Assessment lmedfor@tacoma.k12.wa.us 253-571-1193 Lindsay Franklin, Assessment Specialist lfrankl@tacoma.k12.wa.us 253-571-1190