1. Data harmonization in International Surveys on Education
27. prosince prosince 2018
Data harmonization of educational research
Data harmonization in International Surveys on Education
Petr Soukup

2. Structure of the presentation
27. prosince prosince 2018
Data harmonization of educational research
Structure of the presentation
Short intro to educational reseach
Preparation phase
Data collection
Data entry and coding
Data cleaning and weighting

3. Short intro to educational research
27. prosince prosince 2018
Data harmonization of educational research
Short intro to educational research

4. Basic info about big educational studies
27. prosince prosince 2018
Data harmonization of educational research
Basic info about big educational studies
PISA
TIMMS
ICCS

5. Data harmonization of educational research
27. prosince prosince 2018
Data harmonization of educational research
PISA - basic info
The OECD Programme for International Student Assessment
Target group: 15-year-olds
Basic topics: mathematical literacy, reading, computer literacy
Waves: every 3rd year (CR 2000, 2003, 2006, 2009, 2012 – in preparation)
Currently 65 countries (2009)

6. Data harmonization of educational research
27. prosince prosince 2018
Data harmonization of educational research
TIMMS - basic info
Trends in International Mathematics and Science Study
Target group: 4th and 8th grade
Basic topics: mathematics, science
Waves: every 4th year (CR 1995, 1999, 2003, 2007, 2011 – in preparation)
Currently more than 60 countries

7. Data harmonization of educational research
27. prosince prosince 2018
Data harmonization of educational research
ICCS - basic info
International Civic and Citizenship Education Study
Target group: 8th grade
Basic topics: civic and citizenship education
Waves: no waves, similar project CIVED 1999
Currently 38 countries

8. Data harmonization of educational research
27. prosince prosince 2018
Data harmonization of educational research
Preparation phase

9. Data harmonization of educational research
27. prosince prosince 2018
Data harmonization of educational research
Preparation phase
Framework and Survey operation manuals
Translation and back translation (key terms and full research instruments)
Sampling – 1st stage usually research center, 2nd stage usually by software
Usefull tools for people who will carry out the research: school coordinator manual, test administrator manual
Quality control manual
Field trial

10. Data harmonization of educational research
27. prosince prosince 2018
Data harmonization of educational research
Data collection

11. Data harmonization of educational research
27. prosince prosince 2018
Data harmonization of educational research
Data collection
Organized in the same time (usually during 1 month according to international schedule)
Internationally use the same research instruments (translation verification) with the same appearance (layout verification)
School coordinator, test administrator and quality controller ensure the quality and comparability of data

12. Data harmonization of educational research
27. prosince prosince 2018
Data harmonization of educational research
Data entry and coding

13. Data harmonization of educational research
27. prosince prosince 2018
Data harmonization of educational research
Data entry and coding
Data entry - internationally use the same software, double punch of all data, error rate computation
Case management system - internationally use the same software
Coding of open-ended tasks (international guide, double coding)
Coding of occupation, branch of industry

14. Data harmonization of educational research Data cleaning and weighting
27. prosince prosince 2018
Data harmonization of educational research
Data cleaning and weighting

15. Data cleaning, weighting, etc.
27. prosince prosince 2018
Data harmonization of educational research
Data cleaning, weighting, etc.
Data cleaning entry - internationally by Data Processing Center (data clarification process)
Data weighting - internationally or individually in countries
Preparation of scales – usually IRT methodology, all data together by Data Processing Center
Result: International data file(s) for general public (can be downloaded from OECD or IEA web sites)

16. Thank you for your attention
27. prosince prosince 2018
Data harmonization of educational research
Thank you for your attention