Statewide Assessment Update Vince Dean, Ph.D. Director, Office of Standards & Assessment January 30, 2013 SIFN
The Assessment Challenge How do we get from here......to here? All students leave high school career and college ready Common Core State Standards specify K-12 expectations for career and college readiness...and what can an assessment system do to help? 2
Transitions – MEAP SBAC – MME SBAC – MEAP-Access (for students with disabilities for whom both MEAP/MME and MI-Access are inappropriate) SBAC – MI-Access (for students with significant cognitive disabilities) Functional Independence (for students with mild cognitive disabilities) Supported Independence (for students with moderate cognitive disabilities) Participation (for students with severe cognitive disabilities) DLM – Michigan English Language Proficiency Assessment (ELPA) WIDA/ASSETS 3
●25 states representing 40% of K-12 students in U.S. ●21 governing, 4 advisory states ●Washington state is fiscal agent ●WestEd provides project management services SBAC - A Consortium of States 4
A Balanced Assessment System Common Core State Standards specify K-12 expectations for career and college readiness Common Core State Standards specify K-12 expectations for career and college readiness All students leave high school career and college ready Teachers and schools have information and tools they need to improve teaching and learning Interim assessments Flexible, open, used for actionable feedback Summative assessments Benchmarked to career and college readiness Teacher resources for formative assessment practices to improve instruction 5
A Balanced Assessment System
Timeline Formative Processes, Tools, and Practices Development Begins Writing and Review of Pilot Items/Tasks (including Cognitive Labs and Small-Scale Trials) Field Testing of Summative and Interim Items/Tasks Conducted Content and Item Specifications Development Pilot Testing of Summative and Interim Items/Tasks Conducted Preliminary Achievement Standards (Summative) Proposed and Other Policy Definitions Adopted Operational Summative Assessment Administered Procurement Plan Developed Writing and Review of Field Test Items/Tasks (throughout the school year) Writing and Review of Field Test Items/Tasks (throughout the school year) Final Achievement Standards (Summative) Verified and Adopted Common Core State Standards Adopted by All Member States Summative Master Work Plan Developed and Work Groups Launched
Smarter Balanced Sample Items ●October 9 th release of online tool holding 50+ items −Mathematics −ELA −Samples from all 7 grades (3-8 and 11) ●Item type conversations ●New level of rigor expected by the Common Core State Standards 8
Smarter Balanced Sample Items 9
10
11
12
Performance Tasks ●New item type for Michigan ●Measure concepts other item types do not cover very well (e.g., research) ●Up to an estimated 125 minutes needed ●Performance Tasks may include a Classroom Activity ●Six sample Performance Tasks ●Teacher Preparation & Resources ●Specifications ●Scoring Rubrics 13
Smarter Balanced Pilot Test Scientific Sample – 620 Michigan schools targeted Volunteer Schools – Released forms open to everyone Lessons Learned – Item development – Systems interoperability – Scoring needs – Translation methodology 14
Smarter Balanced Next Steps Item development for spring 2014 field test Hire a scoring service provider and build AI scoring engine Continue developing: – CAT specifications – Reporting system – Digital library – Interim system 15
Find Out More Smarter Balanced can be found online at: SmarterBalanced.org 16
DLM – Dynamic Learning Maps 17
DLM Timeline 18
DLM Features Accessibility options readily available – Computer based assessment system – Keyboard-entered responses – Drag-and-drop responses – Responses using touchscreen technology when available – Alternate academic achievement standards aligned with the Common Core State Standards 19
ASSETS – Assessment Services Supporting ELs through Technology Systems (ASSETS) 20
Future: ◦ 2013/14 School Year: Michigan ELPA World-Class Instructional Design & Assessment Consortium (WIDA) W-APT: WIDA ACCESS Placement Test – screener ( WIDA Assessing Comprehension and Communication in English State-to-State for English Language Learners (ACCESS) – summative Based on WIDA English Language Development Standards, aligned to the CCSS 21 ASSETS Cont.
Future: ◦ 2015/16 School Year: WIDA W-APT & WIDA ACCESS WIDA ASSETS ASSETS will be a fully online screener/interim/summative assessment system 22 ASSETS Cont.
ASSETS Timeline 23
Alternate ACCESS Currently available Designed for ELs who are also SWDs Based on alternate performance indicators and alternate proficiency levels 24
Michigan Developed Interim Assessment Timelines Grade Level(s) and Content Area Fall 2012Spring 2013Fall 2013Spring 2014Fall 2014Spring 2015 K-2 ReadingCog Lab Item writing and committee reviews Pilot test (fixed form) Field test CAT Fully operational CAT Pretest Fully operational CAT posttest K-2 WritingCog Lab Item writing and committee reviews Pilot test (fixed form) Field test CAT Fully operational CAT Pretest Fully operational CAT posttest K-2 Mathematics Cog LabItem writing and committee reviews Pilot test (fixed form) Field test CATFully operational CAT Pretest Fully operational CAT posttest
Michigan Developed Interim Assessment Timelines Grade Level(s) and Content Area Fall 2012 Spring 2013 Fall 2013Spring 2014Fall 2014Spring 2015 High School Reading MMC course-based descriptor revisions and SBAC Interim Plans Item writing Item writing and pilot recruitment Pilot test (fixed form) Field Test (CAT) High School Writing MMC course-based descriptor revisions and SBAC Interim Plans Item writing Item writing and pilot recruitment Pilot test (fixed form) Field Test (CAT) High School Math MMC course-based descriptor revisions and SBAC Interim Plans Item writing Item writing and pilot recruitment Pilot test (fixed form) Field Test (CAT) Grades 3-8 Science Item writing and pilot recruitment Pilot test (fixed form) Field Test CAT pretest Operational CAT posttest High School Science Item writing and pilot recruitment Pilot test (fixed form) Field Test CAT pretest Operational CAT posttest Grades 3-8 Social Studies Item writing and pilot recruitment Field test (fixed form) Fully operational fixed form pretest Fully operational fixed form posttest Fully operational fixed form pretest Fully operational fixed form posttest High School Social Studies Item writing and pilot recruitment Field test (fixed form) Fully operational fixed form pretest Fully operational fixed form posttest Fully operational fixed form pretest Fully operational fixed form posttest
Technology Readiness Progress Bruce Umpstead, OEII & Dave Judd, BAA Spring 2015, online assessment to the extent possible Smarter Balanced and Michigan accountability assessments will have paper/pencil version at least through spring 2017 Michigan interim assessments are optional so no paper/pencil version 27
SBAC Survey Completion Rate 3
Operating System 5 January 28, 2013
Andrew Middlestead – MME, MEAP, SBAC Test Development Manager Jennifer Paul – ELPA, WIDA, SBAC ELL Assessment Consultant Linda Howley – MI-Access, DLM Accessibility Specialist John Jaquith – MI-Access Students with Disabilities Assessment Consultant Contact Information 30