1. Science MCA-III Updates Minnesota Department of Education Science Assessment Specialist Jim WoodDawn Cameron jim.wood@state.mn.usdawn.cameron@state.mn.us 651.582.8541651.582.8551

2. MCA Update Scorable Item Samplers in 2012-13 Test Design and Simulations Text to Speech Reporting: Data and Resources education.state.mn.us 2

3. Item Samplers – Teacher Guides education.state.mn.us 3

4. Item Samplers – Score reports http://www.mnstateassessments.org/itemsamplers.html education.state.mn.us 4 Score ReportTeacher Guide

5. Test Design and Navigation education.state.mn.us 5

6. Science Grades 5, 8 and high school MCA-III Statewide scores went up from 2012 Increase in performance was realized as standards were more consistently implemented across the state. education.state.mn.us 6 2013 MCA Assessment Results Summary

7. education.state.mn.us 7 2013 State Proficiency Level

8. education.state.mn.us 8

9. 9

10. 10

11. education.state.mn.us 11 Comparison of 2012 and 2013 St. Paul

12. education.state.mn.us 12 Information found in MDE Data Center

13. Interpreting Science MCA-III Test Scores –Overall scale scores (G01-99) –Scale scores match with the ALD’s Strand, Sub-Strand levels –Reported using a different scale score system (1-9) –Standard Deviation –Standard Error of the Mean= SD/√n education.state.mn.us 13 Putting it all together

14. education.state.mn.us 14 Benchmark Analysis 6.1.3.1.1

15. All data is relative to the state data Watch the dotted lines – different colors may overlap in their standard deviation Keep an eye on the CLES metric when comparing schools education.state.mn.us 15 CAUTION!!! P-values and standard deviation

16. Food for Thought Save time for evaluation of data, individually and as a team What inferences can and cannot be made from results? Formative vs. Summative strengths –What are you going to do with this data

17. Test Development Process Test Specs Storyboard Writing Item Review Field Test Items Data Review Operational Item Pool Operational Test Bias Review Achievement Levels Storyboard Review Bias Review Item Writing education.state.mn.us 17

18. Get involved! Assessment Advisory Panels—ongoing Register to be invited to panels at http://education.state.mn.us  Educator Excellence  Testing Resources  Register for Advisory panels education.state.mn.us 18

19. education.state.mn.us 19

20. Broken down by Sub-strand education.state.mn.us 20 HS Benchmark Graphs 2013

21. Grade 5Grade 8 0.45 – 16%0.45 – 14%0.50 – 50% 0.55 – 90%0.55 – 91% High School 0.45 – 15% 0.50 – 50% 0.55 – 95% education.state.mn.us 21 Interpretation of CLES