Data harmonization in International Surveys on Education 27. prosince 201827. prosince 2018 Data harmonization of educational research Data harmonization in International Surveys on Education Petr Soukup
Structure of the presentation 27. prosince 201827. prosince 2018 Data harmonization of educational research Structure of the presentation Short intro to educational reseach Preparation phase Data collection Data entry and coding Data cleaning and weighting
Short intro to educational research 27. prosince 201827. prosince 2018 Data harmonization of educational research Short intro to educational research
Basic info about big educational studies 27. prosince 201827. prosince 2018 Data harmonization of educational research Basic info about big educational studies PISA TIMMS ICCS
Data harmonization of educational research 27. prosince 201827. prosince 2018 Data harmonization of educational research PISA - basic info The OECD Programme for International Student Assessment http://www.pisa.oecd.org Target group: 15-year-olds Basic topics: mathematical literacy, reading, computer literacy Waves: every 3rd year (CR 2000, 2003, 2006, 2009, 2012 – in preparation) Currently 65 countries (2009)
Data harmonization of educational research 27. prosince 201827. prosince 2018 Data harmonization of educational research TIMMS - basic info Trends in International Mathematics and Science Study http://www.iea.nl Target group: 4th and 8th grade Basic topics: mathematics, science Waves: every 4th year (CR 1995, 1999, 2003, 2007, 2011 – in preparation) Currently more than 60 countries
Data harmonization of educational research 27. prosince 201827. prosince 2018 Data harmonization of educational research ICCS - basic info International Civic and Citizenship Education Study http://www.iea.nl Target group: 8th grade Basic topics: civic and citizenship education Waves: no waves, similar project CIVED 1999 Currently 38 countries
Data harmonization of educational research 27. prosince 201827. prosince 2018 Data harmonization of educational research Preparation phase
Data harmonization of educational research 27. prosince 201827. prosince 2018 Data harmonization of educational research Preparation phase Framework and Survey operation manuals Translation and back translation (key terms and full research instruments) Sampling – 1st stage usually research center, 2nd stage usually by software Usefull tools for people who will carry out the research: school coordinator manual, test administrator manual Quality control manual Field trial
Data harmonization of educational research 27. prosince 201827. prosince 2018 Data harmonization of educational research Data collection
Data harmonization of educational research 27. prosince 201827. prosince 2018 Data harmonization of educational research Data collection Organized in the same time (usually during 1 month according to international schedule) Internationally use the same research instruments (translation verification) with the same appearance (layout verification) School coordinator, test administrator and quality controller ensure the quality and comparability of data
Data harmonization of educational research 27. prosince 201827. prosince 2018 Data harmonization of educational research Data entry and coding
Data harmonization of educational research 27. prosince 201827. prosince 2018 Data harmonization of educational research Data entry and coding Data entry - internationally use the same software, double punch of all data, error rate computation Case management system - internationally use the same software Coding of open-ended tasks (international guide, double coding) Coding of occupation, branch of industry
Data harmonization of educational research Data cleaning and weighting 27. prosince 201827. prosince 2018 Data harmonization of educational research Data cleaning and weighting
Data cleaning, weighting, etc. 27. prosince 201827. prosince 2018 Data harmonization of educational research Data cleaning, weighting, etc. Data cleaning entry - internationally by Data Processing Center (data clarification process) Data weighting - internationally or individually in countries Preparation of scales – usually IRT methodology, all data together by Data Processing Center Result: International data file(s) for general public (can be downloaded from OECD or IEA web sites)
Thank you for your attention 27. prosince 201827. prosince 2018 Data harmonization of educational research Thank you for your attention