Open Science=Open Methodology Oshrat Hochman & Christof Wolf

Slides:



Advertisements
Similar presentations
Innovation data collection: Advice from the Oslo Manual South East Asian Regional Workshop on Science, Technology and Innovation Statistics.
Advertisements

Eurostat T HE E UROPEAN PROCESS OF ENHANCING ACCESS TO E UROSTAT DATA A LEKSANDRA B UJNOWSKA E UROSTAT.
Documentation and Additional Resources Alexander Mack.
Eurostat Georgiana Ivan Jean-Louis Mercy Eurostat, European Commission European Conference on Quality in Official Statistics Vienna, 3-5 June 2014 Measuring.
Eurostat M ODES OF ACCESS TO EU MICRODATA IN THE NEW LEGAL FRAMEWORK A LEKSANDRA BUJNOWSKA E UROSTAT S TATISTICAL OFFICE OF THE E UROPEAN U NION.
February 1, 2011 Workshop: Persistent Identifiers for the Social Sciences 1 SOEP and DOI Requirements and Challenges Jan Goebel.
Statistik.atSeite 1 Norbert Rainer Quality Reporting and Quality Indicators for Statistical Business Registers European Conference on Quality in Official.
Implementation of the EU regulation on access to European microdata Aleksandra Bujnowska Eurostat.
Keeping Children Safe Summer School.... Pathways to information 15 th September 2011
© Federal Statistical Officewww.forschungsdatenzentrum.de Workshop „Integrating European Census Microdata“ Barcelona, July 2005 Country Report for.
Armenia Twinning 2011 Component F – Information Society, 2 – 6 May DEVELOPMENT OF INFORMATION SOCIETY STATISTICS IN LITHUANIA Statistics.
   Tom W. Smith NORC at the University of Chicago
Data and information on disability and employment
Comments on Integrating designs for economic variables
The Generic Statistical Information Model (GSIM) and the Sistema Unitario dei Metadati (SUM): state of application of the standard Cecilia Casagrande –
Legal, political and methodological issues in confidentiality in the ESS Maria João Santos, Jean-Marc Museux Eurostat.
WORKSHOP GROUP ON QUALITY IN STATISTICS
Working Group Meeting: Statistics on Crime and Criminal Justice 15 March 2017, Luxembourg Ongoing work on developing the ICCS manual and translations.
NCN module on cultural participation:
The second wave of the new design of the Dutch EU-SILC: Possibilities and challenges Judit Arends.
Access to European microdata for scientific purposes
Isabelle Rémond-Tiedrez European Commission Eurostat Antonio F Amores
The European Statistical Training Programme (ESTP)
ITEM 4 - PROPOSALS OF THE TASK FORCE TO UPDATE THE TUS GUIDELINES
Public use files for ESS microdata
Working Group - Geographic Information Systems for statistics
WORKSHOP ON THE DATA COLLECTION OF OCCUPATIONAL DATA Luxembourg, 28 November 2008 Occupation as a core variable in social surveys Sylvain Jouhette
Gara Rojas González – Eurostat F3 (EU-SILC)
DDI-RDF Discovery Vocabulary _ Use Cases and Vocabularies
Work Schedule Methodological Issues Variables Constant
Secondary Data Analysis Lec 10
Passenger Mobility Statistics 10 April 2014
Adult Education Survey : recommendations of the TF AES
WORKSHOP ON CORE VARIABLES
HBS business needs for future
Passenger Mobility Statistics 10 April 2014
Item 6.2 Participation in education and training in the last 12 months
LAMAS Working Group 29 June-1 July 2016
Education and Training Statistics Working Group – 2-3 June 2016
Meeting of the Directors of Social Statistics October 2016
TG EHIS January 2012 Item 4.1 of the agenda EHIS wave 2 Implementing Regulation Bart De Norre, Eurostat.
The change of data sources in the Spanish SILC
Education and Training Statistics Work programme 2004
ESDS Workshop on best practices
LAMAS Working Group 6-7 December 2017
Workshop on the data collection of occupational data
Passenger Mobility Statistics 21 May 2015
Item 7: ISCED 2011 in TUS Eurostat-F5 10 April 2013 WG meeting on TUS.
Adult Education Survey progress report Point 6
Agenda item 5.3 EHIS - Implementing Regulation
Encoding tools used by the Belgian Statistical office
The modules of the EU Labour Force Survey
Eurostat ETS Working Group - Luxembourg, April 2013
Conclusions of the meeting
The Next Generation of the Microdata Information System MISSY: An Integrated Solution for the Documentation of European Microdata European DDI User Conference,
High level working group on statistical confidentiality
Item 4.2 – Towards the 2016 AES Philippe Lombardo Eurostat-F5
Agenda item 4.2 Task Force on migrants’ health
SOEP and DOI Requirements and Challenges
Update on microdata access
Education and Training Statistics Working Group June 2014
Item 4.2 EUROMOD latest developments
Access to European microdata for scientific purposes
Item 2.2 Scientific Use Files for the Time Use Survey
Euromod Item 4.2 of the agenda
SILC draft implementing and delegated acts Item 3.4 of the agenda
Meeting of the Directors of Social Statistics March 2017
Item 5 Modernisation of the EU-SILC Production
Stratification, calibration and reducing attrition rate in the Dutch EU-SILC Judit Arends.
FACTAGE Training on Differential Mortality
Presentation transcript:

Open Science=Open Methodology Oshrat Hochman & Christof Wolf

Open Science “All European researchers will be able to deposit, access and analyze European scientific data through a European Open Science Cloud.” European Commission

Open Science Access to publications, Access to data, Access to source code,

Open Science Access to publications, Access to data, Access to source code

Scientific use files of EU official statistics Reduced problem of item non-response Representativeness Comparability across countries Comparability across time

But: The data is not collected primarily for scientific purposes.

The Metadata in GESIS GML

The Metadata system in GML All the available metadata about the different datasets in one place

The next step… “Non-reproducible single occurrences are of No significance to science” (Popper)

Open Science Access to publications, Access to data, Access to source code, Access to Methodology

Challenges: Comparability Data collection mode: register, interview, proxy Formulation of question, timing, subjectivity Operationalization: ex-post harmonization of indicators Formulation, categorization into the ex post harmonized variables  Information on deviations from the guidelines is reported in the Eurostat and national quality reports.

Addressing the challenges Flag variable: Survey, Proxy or register? English translations of all country questionnaires Country specific description of the operationalization of the variables to be harmonized: how was the original classification applied in the harmonized variables?  First step: for key harmonized (target or generated) variables like income, socioeconomic status, education, etc.

Thank you for your attention http://www.gesis.org/en/missy http://www.gesis.org/en/institute/competence-centers/rdc-german-microdata-lab/

Variable level Information

Additional Collection mode and operationalization examples Variations in order of questions

Data collection mode Register data is likely to be less up to date than survey data. It may also be operationalized differentially than the survey items. Register data is objective while survey items are subjective.

Operationalization Wirth 2016 (EU SILC): Childcare in the household should according to EU SILC guidelines be measured with the following categories: Preschool or equivalent; Primary school; Extracurricular childcare; Kindergartens or similar; Unstructured childcare; Childcare through grandparents or other relatives.

In some countries, childcare also includes additional categories like parental child care (DE), or is differentiated by whether childcare is salaried or not (AT). Parental childcare, appears then under the SILC category “other”, yet this category implies additional childcare solutions in other countries. We do not know how the paid/unpaid childcare categories are entered into the SILC official categories.

Similar problems also exist in EU LFS Items for employment – e.g. hours worked Items for marital status – e.g. cohabitation Items for drop-outs from school or vocational training programs