Using DDI in Harmonizing Survey Data

Slides:

Advertisements

Similar presentations

FDZ-RV Research Data Centre of the German Pension Insurance Integration of Metadata in FDZ-RV 1 Integration of Metadata in FDZ-RV (Research Data Centre.

Advertisements

ICPSR-SRO Shared Data Model Project Mary Vardigan Director, DDI Alliance.

MICS4 Survey Design Workshop Multiple Indicator Cluster Surveys Survey Design Workshop Data Archiving.

New Services for Data Creators and Providers Louise Corti, Head ESDS Qualidata/ Outreach & Training Alasdair Crockett, ESDS Data Services Manager.

Nesstar, ESDS International and ESDS Qualidata online demonstrations ASLIB visit to the UK Data Archive Wednesday 24 November 2004 Louise Corti, Associate.

Metadata Management at GESIS-ZA Reiner Mauer GESIS – Data Archive and Data Analysis CESSDA-Expert Seminar Odense, September 11th 2008.

Metadata at ICPSR Sanda Ionescu, ICPSR.

1 Implementing DDIEditor in the Danish Data Archive - Demonstration and gained experience Part of session: Recent Developments in the DDI Implementation.

Developments in Data Discovery at ICPSR George Alter Director, ICPSR University of Michigan.

Meta Dater Metadata Management and Production System for surveys in Empirical Socio-economic Research A Project funded by EU under the 5 th Framework Programme.

INTER-UNIVERSITY CONSORTIUM FOR POLITICAL AND SOCIAL RESEARCH Social Science Data and Resources for Researchers Converting Legacy Documentation to DDI:

Mari Kleemola and Jouni Sivonen: Learning NESSTAR IASSIST2001 Amsterdam, May 2001 Finnish Social Science Data Archive.

Hannele Keckman-Koivuniemi and Mari Kleemola : Data Processing in FSD : CHALLENGES IN A NEW ARCHIVE IASSIST2003 Ottawa,

Demonstration of a Blaise Instrument Documentation System “BlaiseDoc” Gina-Qian Cheung May 25, 2005 Institution for Social Research University of Michigan.

The Metadata Toolbox: A User’s Perspective on DDI J.M. Eisenhauer Smith, Data Analyst/Archivist Center for Demography of Health and Aging University of.

Trials and Tribulations of creating DDI Codebooks at the University of Guelph A.Michelle Edwards and Carol Perry, Data Resource Centre, University of Guelph.

Evelyn Brislinger, Wolfgang Zenk-Möltgen

Embedding - for better collaborations - Toshiyuki Takahei RIKEN.

FORMS OF COOPERATION BETWEEN NATIONAL STATISTICAL INSTITUTES AND DATA ARCHIVES Sebastian Kočar (ADP, UL) First Regional Workshop – Microdata Access in.

DDI Lifecycle: Moving Forward Outcome of the Recent Workshop in Dagstuhl Joachim Wackerow.

February 1, 2011 Workshop: Persistent Identifiers for the Social Sciences 1 SOEP and DOI Requirements and Challenges Jan Goebel.

Data Management: Documentation and Metadata for Engineering and Physical Sciences Ivey Glendon, Metadata Librarian Jeremy Bartczak, Intellectual Access.

DLI Training April 2004 Kingston Ontario. DDI What, Why, How?

Data Management: Documentation & Metadata Sherry Lake, Senior Data Consultant Bill Corey, Data Consultant Jeremy Bartczak, Intellectual Access & Metadata.

Social Science Data Bases CSU Fresno October 30, 2009.

Software Development Cycle What is Software? Instructions (computer programs) that when executed provide desired function and performance Data structures.

ABINIT INPUT MAKER By Simon Pesant and BenjaminTardif 29/01/2007.

SIMO SIMulation and Optimization ”New generation forest planning system” Antti Mäkinen Dept. of Forest Resource Management / University of Helsinki.

Evolution of Data Documentation Providing Social Science Data Services Jim Jacobs, 2008.

Colectica: A Platform for DDI 3 based Metadata Management Design. Collect. Share.

WILD Wiring the Learning Infrastructure: Connecting Digital Learning Resources to the Curriculum – A Semantic Web Service for Curriculum Mapping.

DDI AND EXPERIENCES AT ICPSR Prepared for Expert Seminar Finnish Social Science Data Archive Tampere, Finland September 1-2, 2000.

Archiving microdata Standards and good practices United Nations Statistics Commission New York, February 26, 2009 Olivier Dupriez World Bank, Development.

The Data Documentation Initiative: more discussion Chuck Humphrey University of Alberta Atlantic DLI Workshop 2005, Acadia University.

COLECTICA FOR EXCEL: USING DDI LIFECYCLE WITH SPREADSHEETS NADDI 2013.

Scion Macros How to make macros for Scion The Fast and Easy Guide.

Metadata standards Using DDI to Inform, Organize, and Drive Survey Data Production.

Publishing DDI-Related Topics Advantages and Challenges of Creating Publications Joachim Wackerow EDDI16 - 8th Annual European DDI User Conference Cologne,

The Library of Online Harmonisations

USER’S GUIDE SERVICE CAPABILITIES Explore the eLibrary

Improving data services by creating a question database

George Alter, ICPSR (PI)

به نام خدا كاربرد كامپيوتر در مهندسي صنايع نرم افزار spss

An Introduction to Visual Basic .NET and Program Design

European Commission’s Forth Framework Telematics Applications Program

What’s New in Colectica 5.3 Part 1

Questasy: Documenting and Disseminating Longitudinal Data Online with DDI 3 Edwin de Vet 11/14/2018.

ICPSR: Resources for Instructors Finding and Analyzing Data 9/26/2012

VISUAL BASIC – CHAPTER ONE NOTES An Introduction to Visual Basic

ICPSR Tools for the Metadata Portal

DDI for the Uninitiated

What’s New in Colectica 5.3 Part 2

Enhancing ICPSR metadata with DDI-Lifecycle

Enabling direct data access to social science research data

DDI-RDF Discovery Vocabulary _ Use Cases and Vocabularies

Updates on the XSLT stylesheets for DDI

EDDI12 – Bergen, Norway Toni Sissala

From information to data, and back again

Ørnulf Risnes Ricco Førgaard Archana Bidargaddi

Experimenting with DDI-L at the French Center of Socio-Political Data

Virology: An Interactive Guide

Implementing DDI in a Survey Organisation

Questasy: Documenting and Disseminating Longitudinal Data Online with DDI 3 Edwin de Vet 5/21/2019.

SOEP and DOI Requirements and Challenges

The DASISH Questionnaire Design Documentation Tool (QDDT)

Steps towards a Single Point of Access for Survey Questions across Europe: The Euro Question Bank Project Wolfgang Zenk-Möltgen Azadeh MahmoudHashemi GESIS.

Science is fun. Science is fun. Science is fun. Science is fun. Science is fun. Science is fun. Science is fun. Science is fun. Science is fun. Science.

Trust & Understanding Building Bridges: Mapping the XML

Presentation transcript:

Using DDI in Harmonizing Survey Data Markus Tuominen & Juha Ranta Case of Finnish Social Science Data Archives Suomi-monitori project EDDI16 December 6, 2016 Cologne, Germany License: CC BY 4.0

Tietoarkisto | www.fsd.uta.fi

Tietomilli-mielipidepuntari Final product of Suomi-monitori project (2016 ongoing) Opening archived datasets for public use Easy to use interface to analyze longitudinal data online Interactive visualizations with D3 JavaScript library www.fsd.uta.fi/tietomilli Tietoarkisto | www.fsd.uta.fi

Access to FSD data online 835 questions 1590 variables 20 datasets from mainly two series Tietoarkisto | www.fsd.uta.fi

Tool to analyze data online Tietoarkisto | www.fsd.uta.fi

Compare your values Tietoarkisto | www.fsd.uta.fi

Data in FSD Datasets in FSD are carefully documented using DDI Codebook FSD archives DDI descriptions in XML-format In our project we used existing DDI descriptions to produce harmonized data Tietoarkisto | www.fsd.uta.fi

Trends and Harmonization Data series in FSD are well documented but sadly not longitudinally in variable level We compared every question in the newest wave to other questions in the same series with in-house software in order to find longitudinal instances of a variable Tietoarkisto | www.fsd.uta.fi

Trends and Harmonization After assuming an instance of a question the program prompts user to verify Tietoarkisto | www.fsd.uta.fi

Trends and Harmoni-zation Produces SPSS syntax based on user input Tietoarkisto | www.fsd.uta.fi

Used fields in DDI-document <var> <qstn> <qstnLit>question text</qstnLit> <catgry> <catValu>answer as value</catValu> <labl level="category">answer as text</labl> <catStat>frequency of the answer</catStat> Tietoarkisto | www.fsd.uta.fi

Challenges faced Same question formatted differently between study waves qstnLit –field sometimes contained instructions for answering the question which produced difficulties in comparing short questions No keywords for variables Tietoarkisto | www.fsd.uta.fi

Conclusions Differently formatted questions still remains an unresolved issue Tools that use DDI Codebook can greatly help in harmonizing longitudinal survey data <qstnLit> should contain only the question Visualizing data is fun Tietoarkisto | www.fsd.uta.fi