Annual Assessment and Accountability Meeting Updates August 29, 2018 Susie Lee Bureau of K-12 Student Assessment

Paper-Based Transition In Spring 2019, the following tests are paper-based only: Grades 4–6 ELA Writing Grades 3–6 ELA Reading and Mathematics Grades 5 & 8 Science Combined Test and Answer Book for ELA/M Separate Test Book and Answer Book for Science Grade 7 ELA Writing moves online

Paper-Based Transition for Grades 3–6 Remember when…

Paper-Based Transition for Grades 3–6 Daily Session Schedule Multiple grade levels can be administered on the same day Providing a daily schedule Same protocol as in the past Allows for a more secure, standardized administration All districts/schools must adhere to the PBT guidance Any deviation must be requested, in writing, and describe a specific hardship or need (not preference) that requires flexibility.

Spring 2016 March 28–April 8: Grade 3 R, Grades 3 & 4 M (3 tests) ~ 600,000 books June 10 – Results reported 9 weeks (PBT) 5 weeks (CBT) Spring 2019 May 1–14 – Grades 4–6 R; Grades 3–6 M (7 tests) ~ 1,400,000 books June 30 – Reporting requirement 6 ½ weeks (PBT) 4 ½ weeks (CBT) +~800,000 books; - 3 weeks Proper packaging, labeling, and returning on time

Paper-Based Transition for Grades 3–6 School Staff Security and Forms Locked Storage PreID Labels Books with no labels will not be processed Packaging and Returns Shipping from schools Students Item types Test Item Specifications and Practice Tests will be updated this fall New Practice Resources

Calibration Calibration school selection is a scientific process that creates a sample that is representative of the entire state. This includes demographics and a range of performance School cooperation is crucial to complete the calibration analyses in a timely fashion for scoring and reporting. contributes towards Florida having valid and reliable assessments and results.

Calibration Calibration schools receive special materials that contain “anchor sets” – these item sets are scored and evaluated statistically to set scoring parameters for the test. An anchor set is a “mini-test” that models the item parameters of the entire test. They also “anchor” the test to previous years to ensure that item parameters are the same or extremely similar from year to year.

Calibration Once tests for calibration schools are processed, psychometric teams from FDOE, our contractors, and a third, independent party evaluate the results. Then, post-equating is used to place IRT-processed scores on the assessment scales and to ensure that the resulting scores are comparable to those of previous years.

Calibration Making scores comparable allows comparisons between, for example, the achievement of grade 6 students in 2017 and the achievement of Grade 6 students in 2018. Each assessment is designed to be of similar difficulty each year; however, slight differences in test difficulty (the content of the test items) may influence student scores. Without equating, it would be difficult to determine whether differences in scores between years are the result of these slight differences in the test difficulty or differences in students’ true levels of knowledge and skill.

Calibration Grades 3–5 ELA/Mathematics Grades 6–10 ELA/Mathematics Entire school selected Materials return with striped labels Grades 6–10 ELA/Mathematics One subject/grade level test per school Grade 6 – materials return with striped labels Grades 7–10 – test during week one

Statewide Assessment Program Guide “The Statewide Assessment Program Guide is a very useful document all in one place.  We shared this document with district and school staff.  It helps explain the details of the FSA to parents especially confusion over how the Writing component is included in the ELA test.  We love this comprehensive document.” – Richard Baum, Director Student Assessment and Research Broward County Schools

Statewide Assessment Program Guide Test Content Development Administration Scoring and Equating Reporting Resources History and Uses

Uniform Assessment Calendars Complete 2018-19, post on district website, and send link to the department by October 1, 2018. 2018-19 and 2019-20 templates are available on the FDOE website: http://www.fldoe.org/accountability/assessments/k-12- student-assessment/assessment-schedules.stml Contact Catherine Altmaier with any questions.

NAEP Spring 2017 Results Spring 2019 NAEP Participation State-Level Year for Grades 4 and 8 Reading and Mathematics NAEP Participation Communication Incentives Results

Questions?