1. Quality Assurance in a Chaotic World Jennifer Dugan Minnesota Department of Education Director, Statewide Testing Leading for educational excellence and equity. Every day for every one.

2. New Vendor for Title I and graduation assessments New Vendor for Title III assessments Minnesota government service interruption for three weeks Redesign of MDE web site A Year Ago education.state.mn.us 2

3. Discuss established QA processes –Rationale –Intention Develop processes to continue QA –Quality conversations are critical in developing quality assurance processes Create new QA processes, as necessary Overarching Theme education.state.mn.us 3

4. Item images Metadata Audio for online tests (transitioned from recorded audio to text to speech) Mastery of standards, test specifications, and development specifications Item Pool education.state.mn.us 4

5. Tutorials Item Samplers (released items) Manuals Test Monitor Directions Test Administration education.state.mn.us 5

6. Test Construction processes Item scoring process Item level data –Import historical to Item Bank –Agree on scoring processes moving forward Psychometrics education.state.mn.us 6