Marion Wittenberg – DANS Merja Karjalainen – SND.

Slides:



Advertisements
Similar presentations
Questasy Technical Overview Alerk Amin. Data Dissemination Requirements Data collection Multiple languages One system –Data and metadata –Administrators.
Advertisements

The ISCED Standard for Coding of Education and DDI-Lifecycle
DDI3 Uniform Resource Names: Locating and Providing the Related DDI3 Objects Part of Session: DDI 3 Tools: Possibilities for Implementers IASSIST Conference,
William C. Block & Stefan Kramer Cornell Institute for Social and Economic Research (CISER) Report on Dagstuhl Workshop on Managing Metadata for Longitudinal.
Learn How to Create DDI Metadata A Technical Introduction.
Group & Resource Package - Potentials to re-use metadata with DDI 3 - Uwe Jensen, GESIS – cessda Expert Seminar Nov Ljubljana, Slovenia Group &
GSIM, CSPA, and Related Activities of the High-Level Group
DDI URN Enabling identification and reuse of DDI metadata IDSC of IZA/GESIS/RatSWD Workshop: Persistent Identifiers for the Social Sciences Joachim Wackerow.
A database-driven tool to create items, variables and questionnaires NEPS Metadata Editor.
Managing the Metadata Lifecycle The Future of DDI at GESIS and ICPSR Peter Granda, ICPSR Meinhard Moschner, GESIS Mary Vardigan, ICPSR Joachim Wackerow,
Reducing Metadata Objects Dan Gillman November 14, 2014.
 Name and organization  Have you worked with DDI before? (2 or 3)  If not, are you familiar with XML?  What kind of CAI systems do you use?  Goals.
Q: What objects documented by DDI should be citable? All versionable objects, some may not be used Q: What elements are needed in DDI and CDISC to support.
The education variables in the European Social Survey: Advantages in using the DDI for documentation Hilde Orten and Hege Midtsæter Norwegian Social Science.
Modernizing the Data Documentation Initiative (DDI-4) Dan Gillman, Bureau of Labor Statistics Arofan Gregory, Open Data Foundation WICS, 5-7 May 2015.
Representing and utilizing DDI in relational databases A new DDI best practices working paper Ingo Barkow, Senior researcher, Leibniz Institute for Educational.
ESCWA SDMX Workshop Session: Role in the Statistical Lifecycle and Relationship with DDI (Data Documentation Initiative)
Locating objects identified by DDI3 Uniform Resource Names Part of Session: Concurrent B2: Reports and Updates on DDI activities 2nd Annual European DDI.
National Adaptation Forms International Study Centre Data Management Seminar Hamburg, July 2008.
Survey Data Management and Combined use of DDI and SDMX DDI and SDMX use case Labor Force Statistics.
Experiences with the Design and Development Process of DDI Requirements for Future Work Ideas for Improvement Joachim Wackerow.
2nd Annual European DDI Users Group Meeting Utrecht, 8-9 December 2010 (DDI-CVG)
METADATA DRIVEN SURVEY RESEARCH Alerk Amin, CentERdata Jeremy Iverson, Colectica.
DDI: Capturing metadata throughout the research process for preservation and discovery Wendy Thomas NADDI 2012 University of Kansas.
3 rd Annual European DDI Users Group Meeting, 5-6 December 2011 The Ongoing Work for a Technical Vocabulary of DDI and SDMX Terms Marco Pellegrino Eurostat.
DDI at the Swedish National Data Service
PHDD – An RDF Vocabulary for the Physical Data Description Work in Progress Joachim Wackerow and Thomas Bosch (both GESIS – Leibniz Institute for the Social.
DDI-RDF Discovery Vocabulary A Metadata Vocabulary for Documenting Research and Survey Data Linked Data on the Web (LDOW 2013) Thomas Bosch.
Object Description by Data Records DDI Moving Forward - IASSIST Sprint, May 2014 Joachim Wackerow Larry Hoyle.
National Institute for Public Health and the Environment Cologne, 19/25-October 2003Meeting of Heads of WHO FIC CC1 Applicability of Dutch ICD-10 Electronic.
Supporting Reusability John McDaris Geoscience Assistant/Project Manager Science Education Resource Center Carleton College Northfield,
Developing Best Practices for the DDI Introduction: Why Best Practices? Arofan Gregory.
Leveraging the DDI Model for Linked Statistical Data in the Social, Behavioural, and Economic Sciences DC Thomas Bosch GESIS – Leibniz.
DDI-RDF Leveraging the DDI Model for the Linked Data Web.
Colectica: A Platform for DDI 3 based Metadata Management Design. Collect. Share.
DDI and the Lifecycle of Longitudinal Surveys Larry Hoyle, IPSR, Univ. of Kansas Joachim Wackerow, GESIS - Leibniz Institute for the Social Sciences.
Survey Data Management and the Combined Use of DDI and SDMX Arofan Gregory Chris Nelson Metadata Technology Eurostat, June
Wendy Thomas – DDI Technical Implementation Committee (TIC)
Copyright 2010, The World Bank Group. All Rights Reserved. Managing processes Core business of the NSO Part 1 Strengthening Statistics Produced in Collaboration.
Synchronise work on DEXs and reference data between PLCS pilots and OASIS/PLCS Workshop #3 10 – 11 November 2004.
DDI Lifecycle and Qualitative Data: Development of a Formal Model Arofan Gregory Joachim Wackerow.
DC Architecture WG meeting Wednesday Seminar Room: 5205 (2nd Floor)
TIC Updates EDDI 2010 Wendy Thomas – 6 Dec Schedule and Process Changes Production schedule is moving to: – Summer / Winter release schedule January.
Writing a HOWTO Guide for DDI An approach for getting started.
>> Metadata What is it, and what could it be? EU Twinning Project Activity E.2 26 May 2013.
Publishing DDI-Related Topics Advantages and Challenges of Creating Publications Joachim Wackerow EDDI16 - 8th Annual European DDI User Conference Cologne,
Incorporating W3C’s DQV and PROV in CISER’s Data Quality Review and
The Library of Online Harmonisations
DDI and GSIM – Impacts, Context, and Future Possibilities
Topic 2 (ii) Metadata concepts, standards, models and registries
Documenting, Maintaining, and Sharing
DDI Extensions for Qualitative Data NADDI 2013
Panel – The Generic Longitudinal Business Process Model NADDI 2013
A DDI3.2 Style for Data and Metadata Extracted from SAS
Alternatives for Representing Coding of Qualitative Data in DDI
Wendy Thomas NADDI 2012 University of Kansas
Logical information model LIM Geneva june
Towards common metadata using GSIM and DDI 3
The DASISH Questionnaire Design Documentation Tool:
DDI-RDF Discovery Vocabulary _ Use Cases and Vocabularies
DDI-L in the Production of Official Statistics
An update on Rogatus Supporting the survey workflow with open standards and tools Ingo Barkow (DIPF) – Senior Researcher, Data Manager David Schiller (IAB)
Question Banks, Reusability, and DDI 3.2 (Use Parameters)
in the data production process
Create Your Own Information Systems on the Basis of DDI-Lifecycle
EDDI2016 Esra Akdeniz, Wolfgang Zenk-Möltgen
The Next Generation of the Microdata Information System MISSY: An Integrated Solution for the Documentation of European Microdata European DDI User Conference,
Exchanging Data Management Plans with DDI
The DASISH Questionnaire Design Documentation Tool (QDDT)
DDI and GSIM – Impacts, Context, and Future Possibilities
Presentation transcript:

Marion Wittenberg – DANS Merja Karjalainen – SND

EDDI Gothenburg 5-6 December 2011  Alerk Amin - Centerdata  Johan Fihn - SND  Larry Hoyle - University of Kansas  Merja Karjalainen - SND  Hilde Orten - NSD  Bodil Stenvig _ DDA  Joachim Wackerow - GESIS  Marion Wittenberg - DANS

 Work in progress  DDI Working Paper Series – Longitudinal Best Practice II, No. 2  This paper is part of a series that focuses on DDI usage and how the metadata specification should be applied in a variety of settings by a variety of organizations and individuals. Support for this working paper series was provided by the authors’ home institutions; by GESIS - Leibniz Institute for the Social Sciences; by Schloss Dagstuhl - Leibniz Center for Informatics; and by the DDI Alliance. EDDI Gothenburg 5-6 December 2011

 better support for comparability between different studies  facilitating the management of references to classifications and other resources  Foundational Metadata - metadata that are agreed as de facto standards EDDI Gothenburg 5-6 December 2011

 Exclusive publication of reusable items outside the context of a study  All identifiable items can be reused  Elements that use a scheme are better candidates for reuse.  Examples: ◦ Category ◦ Code ◦ Concept ◦ Question ◦ Universe ◦ Variable EDDI Gothenburg 5-6 December 2011

 Reuse of a combination of Variable, Code and Categories  Separate presentation of Hilde Orten and Joachim Wackerow The ISCED Standard for Coding of Education and DDI-Lifecycle EDDI GOTHENBURG 5-6 DECEMBER 2011

 the reusable item/element can be referenced by the user to be used in the original form or  it can be customized to fit into the purpose of the user EDDI GOTHENBURG 5-6 DECEMBER 2011

Two different mechanisms for doing this:  One mechanism applies to Categories, Concepts, Questions, Universes, and Variables  The other mechanism applies only to Codes, as DDI implements the CodeMap differently than the other maps. EDDI GOTHENBURG 5-6 DECEMBER 2011

1. Create a new Scheme of the appropriate type 2. Use a SchemeReference to include the original scheme 3. Use Exclude for items that are removed 4. Add new items to the customized scheme 5. Modify items. As there is no explicit way to document a modification in DDI, the solution is to exclude the original item, add the customized item, and document the modifications between these two elements. 6. Create Comparison elements to document items that are excluded/added/modified EDDI GOTHENBURG 5-6 DECEMBER 2011

1. Create a new CodeScheme of the appropriate type 2. Use a CodeSchemeReference to include the original scheme 3. List the items that are reused without modification in the customized scheme 4. Add new items to the customized scheme 5. Modify items. As there is no explicit way to document a modification in DDI, the solution is to exclude the original item, add the customized item, and document the modifications between these two elements. 6. Create Comparison elements to document items that are excluded/added/modified EDDI GOTHENBURG 5-6 DECEMBER 2011

Customized scheme can contain a mix of unmodified elements from the original scheme, and the new/modified elements.  Unmodified elements > refer to the ID/URN in the original scheme  New/modified element > refer to the ID/URN in the customized scheme, with the new agency. EDDI GOTHENBURG 5-6 DECEMBER 2011

 Reuse of individual questions ◦ reuse without any customizations ◦ re-use with customizations  Reuse of a battery of questions EDDI GOTHENBURG 5-6 DECEMBER 2011

 Without any customizations > reference the QuestionItem directly from his QuestionConstruct  Re-use with customizations > 1.Create a new QuestionScheme 2.Add a new QuestionItem using the same metadata as the original QuestionItem, but add the translation. This new QuestionItem will be a customized copy of the original QuestionItem, but have a new ID. 3.Create Comparison elements to document the new customized QuestionItem EDDI GOTHENBURG 5-6 DECEMBER 2011

1. Create a new QuestionScheme, a new ControlConstructScheme and a new InterviewerInstructionScheme 2. Use QuestionSchemeReference, ControlConstructSchemeReference and InterviewerInstructionSchemeReference to include the original schemes 3. Use Exclude for any QuestionItems, QuestionConstructs or Instructions that are removed 4. Add any additional QuestionItems, QuestionConstructs or Instructions to the new schemes. 5. Modify the items which should be translated, e.g. QuestionItem or Instruction a.Exclude the original QuestionItem or Instruction as described above b.Add new QuestionItems or Instructions with the new translations as described in step 4 of the generic model. c.Use the Comparison element to document the modifications. This is described in the following step. 6. Create Comparison elements to document the QuestionItems or Instructions that have been modified. EDDI GOTHENBURG 5-6 DECEMBER 2011

 No support in DDI for referencing Concepts for an entire ControlConstructScheme (block of questions)  There is no Include element in QuestionSchemeReference  There is no Exclude element in CodeSchemeReference  The definition of a QuestionScheme should change from (QuestionItem | MultipleQuestionItem)+ to (QuestionItem | MultipleQuestionItem)* EDDI GOTHENBURG 5-6 DECEMBER 2011

 In ItemMap, the SourceItem and TargetItem should be references (including a version)  It is not possible to include a Comparison element in a StudyUnit. Ideally, you would also include a QuestionMap in a QuestionScheme  IncludedCodeReference is currently a string, but it should be something better for referring to a specific item/version.  It is not possible to “extend”/”modify” elements EDDI GOTHENBURG 5-6 DECEMBER 2011

EDDI Gothenburg 5-6 December 2011 Thank you! Any questions?