Evolution of Data Documentation ICPSR 2012. Evolution of Data Documentation.

Slides:

Advertisements

Similar presentations

Workshop on Metadata Standards and Best Practices November th, 2007 Session 4 The Data Documentation Initiative Technical Overview Pascal Heus Open.

Advertisements

3rd International Digital Curation Conference Washington, DC, Dec 2007 Paper Presentations: Interoperability, Metadata & Standards Data Documentation Initiative:

ICPSR-SRO Shared Data Model Project Mary Vardigan Director, DDI Alliance.

DLI Training Nesstar Workshop

Data Documentation Initiative (DDI) Workshop Carol Perry Ernie Boyko April 2005 Kingston Ontario.

DDI Tags Why are we here? Some of the questions Some possible solutions Need for input and discussion.

Depositing Data for Archiving Libby Bishop ESDS Qualidata, University of Essex Changing Families, Changing Food Meeting University of Sheffield 15 March.

DDA and metadata handling Questions Variables Study description Adresses Administrative data related to studies.

Foundational Objects. Areas of coverage Technical objects Foundational objects Lessons learned from review of Use Case content Simple Study Simple Questionnaire.

Metadata at ICPSR Sanda Ionescu, ICPSR.

Developments in Data Discovery at ICPSR George Alter Director, ICPSR University of Michigan.

Access to and specifics of detailed national LFS data – the case of Slovenia Sebastian Kočar Social Science Data Archives University of Ljubljana 4th DwB.

INTER-UNIVERSITY CONSORTIUM FOR POLITICAL AND SOCIAL RESEARCH Social Science Data and Resources for Researchers Converting Legacy Documentation to DDI:

Looking into the future… DDI workshop IASSIST 2006 Jim Jacobs.

Fitting a survey life cycle in the DDI Irene Wong Chuck Humphrey IASSIST Edinburgh May 2005.

Organizing Groups Why, When and How to do it. Brief history of the need for groups In the old days of MARC records you could either be a machine readable.

Arja Kuula: The DDI and Qualitative data IASSIST2001 Amsterdam, May 2001 Finnish Social Science Data Archive.

Hannele Keckman-Koivuniemi and Mari Kleemola : Data Processing in FSD : CHALLENGES IN A NEW ARCHIVE IASSIST2003 Ottawa,

IASSIST Conference 2006 – Ann Arbor, May Metadata as report and support A case for distinguishing expected from fielded metadata Reto Hadorn S I.

Object Oriented DDI Pasqualino “Titto” Assini (UKDA) Emiel Kaper (CBS) DDI Meeting 17/5/2001 Amsterdam IASSIST/IFDO Conference.

Managing the Metadata Lifecycle The Future of DDI at GESIS and ICPSR Peter Granda, ICPSR Meinhard Moschner, GESIS Mary Vardigan, ICPSR Joachim Wackerow,

Documentation Tools in the Survey Lifecycle. Outline What is NSFG Webdoc? Instrument documentation != Survey documentation Data Cleaning/Processing in.

Reducing Metadata Objects Dan Gillman November 14, 2014.

 Name and organization  Have you worked with DDI before? (2 or 3)  If not, are you familiar with XML?  What kind of CAI systems do you use?  Goals.

Data Management: Documentation & Metadata Types of Documentation.

The education variables in the European Social Survey: Advantages in using the DDI for documentation Hilde Orten and Hege Midtsæter Norwegian Social Science.

ESCWA SDMX Workshop Session: Role in the Statistical Lifecycle and Relationship with DDI (Data Documentation Initiative)

1 The planned use of DDI 3.0 within a German Research Data Center IASSIST, Session “Tools and Implementations of DDI 3.0”, May 27, 2009 Dana Müller.

The Field (California) Poll. What is the Field Poll? The Field Poll was established in 1947 by Mervin Field. An independent non-partisan survey of California.

Research data workflow Practice in Slovenian Social Science Data Archives SERSCIDA WP4 – WORKSHOP Ljubljana September 2013.

Survey Data Management and Combined use of DDI and SDMX DDI and SDMX use case Labor Force Statistics.

Distributed Access to Data Resources: Metadata Experiences from the NESSTAR Project Simon Musgrave Data Archive, University of Essex.

Applying DDI to a Longitudinal Study of Aging. Overview of Presentation  Content of MIDUS  Importance of DDI as Data Management  Process of Creating.

Data Management: Documentation and Metadata for Engineering and Physical Sciences Ivey Glendon, Metadata Librarian Jeremy Bartczak, Intellectual Access.

DLI Training April 2004 Kingston Ontario. DDI What, Why, How?

Metadata Portal Project: Using DDI to Enhance Data Access and Dissemination Mary Vardigan Assistant Director, ICPSR Director, DDI Alliance.

Collaborative Markup of Library and Research Data Examples from Ontario Council of University Libraries (OCUL)

Data Management: Documentation & Metadata Sherry Lake, Senior Data Consultant Bill Corey, Data Consultant Jeremy Bartczak, Intellectual Access & Metadata.

Data documentation and metadata for data archiving and sharing Managing research data well workshop London, 30 June 2009 Manchester, 1 July 2009.

DDI-RDF Leveraging the DDI Model for the Linked Data Web.

Inter-University Consortium for Political and Social Research Social Science Research and Instructional Council June, 2015.

Quantitative analysis Sonia Williams Northern College of Acupuncture 19 th February 2011.

Introduction to Metadata, the DDI and the Metadata Editor Presentation to the SERPent project team by Margaret Ward 3 March 2010.

United Nations Regional Seminar on Census Data Archiving for Africa, Addis Ababa, Ethiopia, September, 2011 Documentation and Cataloguing in Data.

Metadata Management and Tools August 1, 2013 Data Curation Course.

Evolution of Data Documentation Providing Social Science Data Services Jim Jacobs, 2008.

Colectica: A Platform for DDI 3 based Metadata Management Design. Collect. Share.

DDI and the Lifecycle of Longitudinal Surveys Larry Hoyle, IPSR, Univ. of Kansas Joachim Wackerow, GESIS - Leibniz Institute for the Social Sciences.

Colectica Feature Overview. Current Focus: Data Collection.

Looking into the future… Providing Social Science Data Services Jim Jacobs.

The Data Documentation Initiative: more discussion Chuck Humphrey University of Alberta Atlantic DLI Workshop 2005, Acadia University.

COLECTICA FOR EXCEL: USING DDI LIFECYCLE WITH SPREADSHEETS NADDI 2013.

General concepts: DDI Irena Vipavc Brvar, ADP SEEDS Kick-off meeting, Lausanne, May 2015.

Managing data to maximise value Supporting flexible and efficient production of official statistics Adam Brown December 2012.

Inter-University Consortium for Political and Social Research.

Documenting and Harmonizing MIDUS with DDI 3 and Colectica.

Data Stewardship Lifecycle A framework for data service professionals Protectors of data.

>> Metadata What is it, and what could it be? EU Twinning Project Activity E.2 26 May 2013.

A DDI Primer: An Overview and Examples of DDI in Action Barry Radler Distinguished Researcher (UW-Madison Institute on Aging) Jared Lyle Director (DDI.

Metadata standards Using DDI to Inform, Organize, and Drive Survey Data Production.

Looking into the future… Providing Social Science Data Services Jim Jacobs.

What’s New in Colectica 5.3 Part 1

ICPSR Census Metadata Repository

Data Management: Documentation & Metadata

ICPSR Tools for the Metadata Portal

Enhancing ICPSR metadata with DDI-Lifecycle

Comments, Prototypes, Headers & Multiple Source Files

Work Schedule Methodological Issues Variables Constant

PA430 - Data coding March 7/8, 2000.

Introducing the Data Documentation Initiative

Presentation transcript:

Evolution of Data Documentation ICPSR 2012

Evolution of Data Documentation

Codebooks!

 Description of study  Description of files  Description of variables  Survey instrument  Classification Standard

Codebooks!  Location of variables in the data file

Codebooks!  Values, Labels, Frequencies…

PDF Osiris dictionary SPSS cards CBLT Book Osiris SPSS Problems of early digital codebooks (part 1)

PDF Osiris dictionary SPSS cards CBLT Book Osiris SPSS (user has to re-create information in order to re-use information) Machine “readable” but not Machine “actionable”

DDI 1 and DOCUMENT DESCRIPTION 2.0 STUDY DESCRIPTION 3.0 DATA FILES DESCRIPTION 4.0 VARIABLE DESCRIPTION 5.0 OTHER STUDY-RELATED MATERIALS Built to emulate early code BOOKS and digital Codebooks…

Problems of early digital codebooks (part 2)  Static, inflexible.  Meant to document the end point of research -- Views research as linear.  Hard to re-use the information for new research.

Problems of DDI 1 and 2  Emulated the Code Book  Not flexible enough  We could do so much more…

Three Stages of Technological Change Type of ChangeCharacterized by ModernizationDoing what we’ve always done, but using technology to do more and to increase efficiency InnovationDoing things we’ve wanted to do, but could not do without the technology TransformationDoing things that we didn’t imagine until technology made it possible.

Three Stages of Technological Change Type of ChangeCharacterized by Early digital codebooks Doing what we’ve always done, but using technology to do more and to increase efficiency DDI 1 and 2Doing things we’ve wanted to do, but could not do without the technology DDI 3Doing things that we didn’t imagine until technology made it possible.

Three Stages of Technological Change Type of ChangeCharacterized by Early digital codebooks Making codebooks machine readable DDI 1 and 2Making codebooks re-usable, even machine actionable… DDI 3Re-thinking “documentation” Re-thinking the research process

DDI 1 and 2  Document Description  Study Description  Data Files Description  Variable Description  Other Study-Related Materials

DDI 1 and 2  Document Description  Study Description  Data Files Description  Variable Description  Other Study-Related Materials  Study Concept  Data Collection  Data Processing  Data Distribution  Data Archiving  Data Discovery  Data Analysis  Repurposing DDI 3