0 TIMSS 2007 Ina V.S. Mullis and Michael O. Martin 47 th IEA General Assembly Amiens, France 9-12 October, 2006

1 TIMSS 2007 Mathematics and Science Grades 4 and 8 Trends 1995, 1999, 2003, 2007 Baseline for New Countries

2 Mathematics Content Domains Fourth-GradePercentages Number50% Geometric Shapes and Measures35% Data Display15% Eighth-Grade Number30% Algebra30% Geometry20% Data and Chance20%

3 Science Content Domains Fourth-GradePercentages Life Science45% Physical Science35% Earth Science20% Eighth-Grade Biology35% Chemistry20% Physics25% Earth Science20%

4 Countries Participating Algeria Armenia Australia Austria Bahrain Bosnia Botswana Bulgaria Canada, Alberta Canada, B.C. Canada, Ontario Canada, Quebec Chinese Taipei Colombia Cyprus Czech Republic Denmark Djibouti Egypt El Salvador England Georgia Ghana Oman Palestinian Auth. Qatar Romania Russian Federation Saudi Arabia Scotland Serbia Singapore Slovak Republic Slovenia Spain, Basque Country Sweden Syrian Arab Republic Thailand Tunisia Turkey Ukraine United States United States, Massachusetts United States, Minnesota Yemen, Rep. of Honduras Hong Kong, SAR Hungary Indonesia Iran Israel Italy Japan Jordan Kazakhstan Korea, Rep. of Kuwait Latvia Lebanon Lithuania Malaysia Malta Moldova Mongolia Morocco Netherlands New Zealand Norway

5 Major Accomplishments Since Last General Assembly Conducted Field Test –100,000 Students Finalized Main Survey Instruments Began Data Collection in Southern Hemisphere

6 TIMSS 2007 SMIRC Mathematics Experts Kiril Bankov, Bulgaria Hanako Senuma, Japan Khattab Mohammad Abu Lebdeh, Jordan Robert Garden, New Zealand Liv Sissel Gronmo, Norway Mary Lindquist, United States

7 TIMSS 2007 SMIRC Science Experts Ahmed Mohammed Rafea, Bahrain Chen-yung Lin, Chinese Taipei Jophus Anamuah-Mensah, Ghana Gabriela Noveanu, Romania Galina Kovaleva, Russian Federation Jackie Heaton, Scotland Audrey Champagne, United States

8 TIMSS 2007 QIRC Sue Thomson, Australia Serge Baillergeon, Quebec Solaiman El-Khodary El-Sheikh, Egypt Martina Meelissen, The Netherlands Boey Kok Leong, Singapore Barbara Japelj, Slovenia Patrick Gonzales, United States

9 TIMSS 2007 Assessment Specialists Mathematics Coordinator –Graham Ruddock, NFER Science Coordinator –Christine O’Sullivan, K-12 Consulting Special “Task Force” Consultants in Mathematics and Science –Intensive Week-long Working Sessions

10 TIMSS 2007 Assessment Specialists Staff at TIMSS & PIRLS ISC –Content/Measurement Experience –Production/Graphics Experience NRCs – National Research Coordinators –Wealth of Knowledge and Experience

11 Overview of Year’s Activities Finalized Field-test Instruments 3 rd NRC Meeting for Final Review of Instruments and Procedures –Ljubljana, Slovenia, November 2005 Materials for TIMSS 2007 Field Test Posted on Web –December 2005

12 Translation and Verification Translation and Verification Began –January 2006 Layout and Verification Began –January 2006 Translation Verification and Layout Verification Completed –April 2006

13 Scoring Training for Field Test Pilot Test in Six English-Speaking Countries –January 2006 Task Forces Met to Develop Training Materials –February 2006 Training Materials Posted on Website –February th NRC Meeting to Conduct Scoring Training –March 2006

14 Conducted Field Test March-April th Grade –46 Countries –60,000 Students –1,200 Schools 4 th Grade –33 Countries –40,000 Students –1,000 Schools

15 Analyzed and Reviewed Field- test Results Mathematics and Science Data Processed and Analyzed for Grades 4 and 8 –July 2006 School, Teacher, and Student Questionnaire Data Processed and Analyzed for Grades 4 and 8 –July rd SMIRC Meeting to Review Results and Propose a Set of Items for Data Collection –St. Petersburg, July 2006

16 Analyzed and Reviewed Field- test Results (cont.) 2 nd QIRC Meeting to Review Results and Recommend Questionnaires for Data Collection –Hamburg, July 2006 Posted Recommended Items, Questionnaires, and Field-test Statistics for NRC Review –July 2006

17 Analyzed and Reviewed Field- test Results (cont.) 5 th NRC Meeting to Review and Approve Items and Questionnaires for TIMSS 2007 Data Collection –Riga, Latvia, August 2006 Final Instruments Posted on Website –August 25, 2006

18 Data Collection – Southern Hemisphere Translation and Verification –September-October 2006 Layout and Verification –September-October 2006 Arabic Translation –August-November 2006

19 Data Collection – Southern Hemisphere (cont.) Scoring Training Materials Prepared –September-October 2006 Training Materials Posted on Web for Southern Hemisphere Countries –October 2006 Scoring Training Meeting –Melbourne, October 2006

20 Data Collection – Southern Hemisphere (cont.) TIMSS 2007 Begins Data Collection Now!!

21 Data Collection – Northern Hemisphere Translation Verification –January-March th NRC Meeting for Scoring Training –Amman, Jordan, March 2007 Data Collection March – June 2007

22 TIMSS 2007 Ina V.S. Mullis and Michael O. Martin 47 th IEA General Assembly Amiens, France 9-12 October, 2006