SOEP and DOI Requirements and Challenges

Slides:



Advertisements
Similar presentations
FDZ-RV Research Data Centre of the German Pension Insurance Integration of Metadata in FDZ-RV 1 Integration of Metadata in FDZ-RV (Research Data Centre.
Advertisements

Archiving Trevor Croft MICS3 Data Archiving, Dissemination and Further Analysis Workshop Geneva - November 6th, 2006.
Overview of Preliminary and Final Reports MICS3 Data Analysis and Report Writing Workshop.
The English Longitudinal Study of Ageing (ELSA) Data & Documentation 2008 Jibby Medina NatCen.
Documentation and Additional Resources Alexander Mack.
ICCS 2009 IDB Seminar – Nov 24-26, 2010 – IEA DPC, Hamburg, Germany Using the IEA IDB Analyzer to merge and analyze data.
Access to and specifics of detailed national LFS data – the case of Slovenia Sebastian Kočar Social Science Data Archives University of Ljubljana 4th DwB.
Panel Micro-Databases for Socio- Economic Research in Europe: ECHP, CHER, CNEF & EPUNet.
Institute of Transport Research - Berlin-Adlershof 1 Clearing House for Transport Data & Transport Models IASSIST Strength in Numbers, Ottawa (Canada)
EPUNet Training Course 2005 Day 1 Tutors: Olaf Jürgens and Christian Schmitt Berlin, April 11th to April 15th 2005.
The MetaDater Model and the formation of a GRID for the support of social research John Kallas Greek Social Data Bank National Center for Social Research.
IASSIST Conference 2006 – Ann Arbor, May Metadata as report and support A case for distinguishing expected from fielded metadata Reto Hadorn S I.
1 The planned use of DDI 3.0 within a German Research Data Center IASSIST, Session “Tools and Implementations of DDI 3.0”, May 27, 2009 Dana Müller.
World Bank, Africa Region, Africa Household Survey Databank - The World Bank - Africa.
Introduction to EU-SILC
DOI Registration for Social and Economic Data da|ra Brigitte Hausstein GESIS Leibniz-Institute for the Social Sciences, Berlin.
FORMS OF COOPERATION BETWEEN NATIONAL STATISTICAL INSTITUTES AND DATA ARCHIVES Sebastian Kočar (ADP, UL) First Regional Workshop – Microdata Access in.
February 1, 2011 Workshop: Persistent Identifiers for the Social Sciences 1 SOEP and DOI Requirements and Challenges Jan Goebel.
Die ZBW ist Mitglied der Leibniz-Gemeinschaft Statistical Research Data on the Semantic Web SWIB 2012 Cologne, Germany Daniel Bahls Leibniz Information.
Creating a collection of standardized datasets on household consumption Olivier Dupriez World Bank, Development Data Group 6 June.
Tourism Statistics and Tourism Satellite Accounts in Turkey
Finding Microlevel Data for Economists at Princeton University: Education and Labor.
ELSA ELSA datasets and documentation available from the archive or by special arrangement Kate Cox National Centre for Social.
SOC 503 Techniques & Methods of Social Science Data Resources at Princeton University.
Working with EU-SILC: data files, variables and data management Practical computing session I – Part 1 Heike Wirth GESIS – Leibniz Institut für Sozialwissenschaften.
“Mobility into and out of poverty in 14 European countries” Author-Presenter: Eirini Andriopoulou ATHENS UNIVERSITY OF ECONOMICS AND BUSINESS DEPARTMENT.
Multiple Indicator Cluster Surveys Data Processing Workshop Overview of SPSS structural check programs and frequencies MICS Data Processing Workshop.
3: Understanding Society 2010 Previously the British Household Panel Survey Institute for Social and Economic ResearchInstitute for Social and Economic.
© Federal Statistical Officewww.forschungsdatenzentrum.de Workshop „Integrating European Census Microdata“ Barcelona, July 2005 Country Report for.
NTTS Satellite Event on multi-indicator Systems and partially ordered sets Multidimensional well-being and deprivation how to aggregate and how to synthesize.
EU-SILC Survey Process in the Czech Republic presentation for EU-SILC Methodological Workshop November 7th Martina Mysíková, Martin Zelený Social.
Open Science=Open Methodology Oshrat Hochman & Christof Wolf
Using Secondary Datasets
Prepared by: Galya STATEVA, Chief expert
Country report Germany
An Overview of Data-PASS Shared Catalog
Statistics Netherlands Division Social and Spatial Statistics
SowiDataNet - A User-Driven Repository for Data Sharing and Centralizing Research Data from the Social and Economic Sciences in Germany Monika Linne, 30.
Giving in the Netherlands Panel Study
IASSIST , Toronto (Canada)
Connecting Researchers with Data: Discovery, Documentation, Access and Security Cornell Institute for Social and Economic Research (CISER); German Institute.
Conducting of EU - SILC in the Republic of Macedonia, 2010
Questasy: Documenting and Disseminating Longitudinal Data Online with DDI 3 Edwin de Vet 11/14/2018.
Third Annual Financial Capability and Asset Building (FCAB) Convening Event: Afternoon Panel Wednesday, January 10, 2018, 1:30 pm – 5:30 pm     FCAB Over.
Census Hub in practice Working Group "European Statistical Data Support" Luxembourg, 29 April 2015.

Third Annual Financial Capability and Asset Building (FCAB) Convening Event: Afternoon Panel Wednesday, January 10, 2018, 1:30 pm – 5:30 pm     FCAB Over.
Connecting Researchers with Data: Discovery, Documentation, Access and Security Cornell Institute for Social and Economic Research (CISER); German Institute.
Use of the business register in the Dutch labour statistics
UIS Culture Statistics: Program of Work Meeting of the WG Culture Statistics  Eurostat, Luxembourg November 2016 José Pessoa Head of Culture Statistics,
Introduction to IPUMS NYTS and IPUMS YRBSS
Social protection network asisp:
Effect of Panel Length and Following Rules on Cross-Sectional Estimates of Income Distribution: Empirical Evidence from FI-SILC Marjo Pyy-Martikainen Workshop.
Tue 8-10, Period III, Jan-Feb 2018
A Question Database for the German Longitudinal Election Study
Introduction to IPUMS NYTS and IPUMS YRBSS
in the data production process
HBS business needs for future
Education and Training Statistics Working Group – 2-3 June 2016
DATA ACCESS IASSIST workshop on Access Policies and Licensing for Archives and Repositories Eric Balster (CentERdata) Cologne, May 28, 2013.
“Mobility into and out of poverty in 14 European countries”
Workshop on the data collection of occupational data
Database in digital format PMWG Meeting, Luxembourg, 24/25 April 2003
Implementing DDI in a Survey Organisation
Questasy: Documenting and Disseminating Longitudinal Data Online with DDI 3 Edwin de Vet 5/21/2019.
Quick statistics - how to deal with quality?
HILDA Survey Melbourne Institute of Applied Economic and Social Research The Household, Income and Labour Dynamics in Australia (HILDA) Survey is a household-based.
Access to European microdata for scientific purposes
Data Analysis and Reporting
Do declining response rates negatively affect sample composition
Presentation transcript:

SOEP and DOI Requirements and Challenges Jan Goebel

Content SOEP Overview Problems Conclusions

SOEP Overview Socio-Economic Panel Study (SOEP) is a representative longitudinal study of private households in Germany Annual survey since 1984 of about 10,000 households (around 20,000 persons) Some of the many topics include household composition, occupational biographies, employment, earnings, health and indicators of subjective well-being

SOEP is an ongoing Survey Common with all panel surveys Each year we distribute an enhanced version with new and changed data Question are changing, new topics, ... → We do a lot but not just replication! Even changes for „archived data“, like a change in the coding scheme of ISCO

SOEP is not one dataset but a complex data structure The SOEP currently (User DVD) consists of: More than 320 data files About 40.000 Variables Granulation to choose for citation? Complete SOEP distribution of one year? „Connected“ SOEP parts, e.g. Individual questionnaires, HH-questionnaires, generated datasets Each data file Each Variable (for each year or only once, longitudinal concept?)

„The SOEP” is available in different versions European user: 100% Version (English, German, different formats for SAS/SPSS/Stata/ASCII) Non-EU user: 95% Version (of cases) International comparative research: Part of the CNEF (Cross National Equivalent File) SOEP Geocodes (supplementary CD): Regional Planning Regions, Community types, etc. Country codes, Community codes, zip codes, microm: only by remote execution or at the Research Data Center (RDC SOEP) SOEP Pretests SOEP Related Studies

SOEP can change during the period, because of updates Updates of weighting schemes or even bug fixes (also possible for older waves) Sometimes more than one update between distributions (cumulative updates?) How can a user know what version she is using? Message-Digest Algorithm (MD5) Secure Hash Algorithm (SHA-2) Universal Numeric Fingerprint (UNF) Does rounding matter? German/English Labels, different formats (SPSS, STATA, …) Only update of a label bug?

Conclusions Nesting of DOI should be possible: Print DOI SOEP example SOEP DOI Edited book Survey SOEP DVD 10.1000/soep.26 Article in book Data file SOEP dataset $PGEN 10.1000/soep.26.hgen Table in article in book Variable SOEP dataset $pgen variable ihinc$$ 10.1000/soep.26.hgen.ihinc It should be possible for a user to identify the data, including version  The metadata of a DOI should include a SHA for each data file and format, which must also be persistent, like SHA-2 Commitment about the persistence of the data provider It is not enough to identify the data source to make an scientific empirical analysis reproducible, you normally need the syntax also

Thank you for your attention!