1. Highlights from TIMSS 2011 Jack Buckley National Center for Education Statistics Washington, DC December 11, 2012

2. Overview  What is TIMSS and which education systems participate?  How are U.S. students performing compared to their international peers in:  4th- and 8th-grade mathematics?  4th- and 8th-grade science?  How are students performing in participating U.S. states? 2

3. What is TIMSS? 3 * In 1999, no grade 4 assessment. Trends in International Mathematics and Science Study (TIMSS) 4th- and 8th-grade mathematics and science assessment Developed by the TIMSS & PIRLS International Study Center at Boston College, under contract to the International Association for the Evaluation of Educational Achievement (IEA)

4. 4 44 education systems 37 education systems 47 education systems57 education systems77 education systems 2011

5. TIMSS Participating States 5 9 states participated as separate entities to obtain scores in TIMSS States participated as part of the nation and as their own entity NCES funded participation at grade 8 of all states except Florida as part of a study to statistically link NAEP (National Assessment of Educational Progress) and TIMSS. Florida used Race to the Top funds to fund participation in TIMSS at grades 4 and 8. TIMSS grade 4TIMSS grade 8 Florida North Carolina Florida North Carolina Alabama California Colorado Connecticut Indiana Massachusetts Minnesota

6. U.S. TIMSS national and state sample sizes 4th grade Schools: 369 Students: 12,569 8th grade Schools: 501 Students: 10,477 4th grade (FL, NC) Schools: 46 – 77 Students: 1,792 – 2,661 8th grade (AL, CA, CO, CT, FL, IN, MA, MN, NC) Schools: 53 – 82 Students: 1,712 – 2,614 6

7. MATHEMATICS

8. TIMSS 2011 Mathematics Framework 8 TIMSS Mathematics Content dimensions Grade 4 Number Geometric Shapes and Measures Data Display Grade 8 Number Algebra Geometry Data and Chance Cognitive dimensions Knowing Applying Reasoning

9. What is on the TIMSS mathematics assessment? 9 Percentage of 4th- graders answering correctly: U.S.: 76% Int’l Avg.: 65%

10. 10 What is on the TIMSS mathematics assessment? Percentage of 8th- graders answering correctly: U.S.: 87% Int’l Avg.: 70%

11. 11 U.S. average score (541) higher than the TIMSS scale average (500) Higher than U.S. Not measurably different than U.S. Lower than U.S.

12. 12 U.S. average score (509) higher than the TIMSS scale average (500) Higher than U.S. Not measurably different than U.S. Lower than U.S.

13. 13 *p <.05. Change in average scores is significant. NOTE: Education systems ordered according to average mathematics score in 2011.

14. 14 *p <.05. Change in average scores is significant. NOTE: Education systems ordered according to average mathematics score in 2011.

15. 15 *p <.05. Change in average scores is significant. NOTE: Education systems ordered according to average mathematics score in 2011.

16. TIMSS international mathematics benchmarks Grade 4Grade 8 Advanced (625) Students can apply their understanding and knowledge in a variety of relatively complex situations and explain their reasoning. Students can reason with information, draw conclusions, make generalizations, and solve linear equations. High (550) Students can apply their knowledge and understanding to solve problems. Students can apply their understanding and knowledge in a variety of relatively complex situations. Intermediate (475) Students can apply basic mathematical knowledge in straightforward situations. Low (400) Students have some basic mathematical knowledge. Students have some knowledge of whole numbers and decimals, operations, and basic graphs. 16

17. Percentages of U.S. 4th-graders reaching TIMSS mathematics benchmarks were higher than international medians in 2011 17 NOTE: All U.S. percentages are significantly higher than the corresponding TIMSS international median at the.05 level of statistical significance.

18. Higher than U.S. (p <.05) Not measurably different than U.S. (p <.05) NOTE: Education systems with lower percentages of students reaching the Advanced benchmark than the percentage of U.S. students reaching the Advanced benchmark are not included in figure. 18 Seven systems had higher percentages of 4th- grade students reaching Advanced than the U.S.

19. 19 NOTE: All U.S. percentages are significantly higher than the corresponding TIMSS international median at the.05 level of statistical significance. Percentages of U.S. 8th-graders reaching TIMSS mathematics benchmarks were higher than international medians in 2011

20. NOTE: Education systems with lower percentages of students reaching the Advanced benchmark than the percentage of U.S. students reaching the Advanced benchmark are not included in figure. 20 Eleven systems had higher percentages of 8th- graders reaching Advanced than the U.S. Higher than U.S. (p <.05) Not measurably different than U.S. (p <.05)

21. SCIENCE

22. TIMSS 2011 Science Framework 22 TIMSS Science Content dimensionsGrade 4 Earth science Life science Physical science Grade 8 Biology Chemistry Earth science Physics Cognitive dimensions Knowing Applying Reasoning

23. What is on the TIMSS science assessment? 23 Percentage of 4th- graders answering correctly: U.S.: 90% Int’l Avg.: 73%

24. What is on the TIMSS science assessment? 24 Percentage of 8th- graders answering correctly: U.S.: 76% Int’l Avg.: 61%

25. U.S. average score (544) higher than the TIMSS scale average (500) 25 Higher than U.S. Not measurably different than U.S. Lower than U.S.

26. 26 U.S. average score (525) higher than the TIMSS scale average (500) Higher than U.S. Not measurably different than U.S. Lower than U.S.

27. 27 *p <.05. Change in average scores is significant. NOTE: Education systems ordered according to average science score in 2011.

28. 28 *p <.05. Change in average scores is significant. NOTE: Education systems ordered according to average science score in 2011.

29. 29 *p <.05. Change in average scores is significant. NOTE: Education systems ordered according to average science score in 2011.

30. 30 *p <.05. Change in average scores is significant. NOTE: Education systems ordered according to average science score in 2011.

31. TIMSS international science benchmarks 31 Grade 4Grade 8 Advanced (625) Students can apply knowledge and understanding of scientific processes and relationships and show some knowledge of the process of scientific inquiry. Students communicate an understanding of complex and abstract concepts in biology, chemistry, physics, and earth science. High (550) Students apply their knowledge and understanding of the sciences to explain phenomena in everyday and abstract contexts. Students demonstrate understanding of concepts related to science cycles, systems, and principles. Intermediate (475) Students have basic knowledge and understanding of practical situations in the sciences. Students recognize and apply their understanding of basic scientific knowledge in various contexts. Low (400) Students have some elementary knowledge of life science and physical science. Students can recognize some basic facts from the life and physical sciences.

32. 32 NOTE: All U.S. percentages are significantly higher than the corresponding TIMSS international median at the.05 level of statistical significance. Percentages of U.S. 4th-graders reaching TIMSS science benchmarks were higher than international medians in 2011

33. NOTE: Education systems with lower percentages of students reaching the Advanced benchmark than the percentage of U.S. students reaching the Advanced benchmark are not included in figure. 33 Higher than U.S. (p <.05) Not measurably different than U.S. (p <.05) Three systems had higher percentages of 4th- grade students reaching Advanced than the U.S.

34. 34 Percentages of U.S. 8th-graders reaching TIMSS science benchmarks were higher than international medians in 2011 NOTE: All U.S. percentages are significantly higher than the corresponding TIMSS international median at the.05 level of statistical significance.

35. NOTE: Education systems with lower percentages of students reaching the Advanced benchmark than the percentage of U.S. students reaching the Advanced benchmark are not included in figure. 35 Higher than U.S. (p <.05) Not measurably different than U.S. (p <.05) Twelve systems had higher percentages of 8th- graders reaching Advanced than the U.S.

36. Summary of change in average U.S. scores over time 36 TIMSS Mathematics 2007-2011 TIMSS Science 2007-2011 TIMSS Mathematics 2007-2011 TIMSS Science 2007-2011 Grade 4 Grade 8 Change over time in U.S. average scores was statistically significant. Change over time in U.S. average scores was not measurably different.

37. For more information 37 TIMSS at NCES: http://nces.ed.gov/timss/ International Data Explorer: http://nces.ed.gov/timss/idetimss/ Contact: Stephen Provasnik NCES Stephen.Provasnik@ed.gov 202-502-7480