An Archive’s Perspective to DDI3 Mari Kleemola Information Services Manager Finnish Social Science Data Archive CESSDA Expert Seminar Ljubljana, 9.11.2009.

Slides:

Advertisements

Similar presentations

Innovation data collection: Advice from the Oslo Manual South East Asian Regional Workshop on Science, Technology and Innovation Statistics.

Advertisements

Data Documentation Initiative (DDI) Workshop Carol Perry Ernie Boyko April 2005 Kingston Ontario.

Metadata Management at GESIS-ZA Reiner Mauer GESIS – Data Archive and Data Analysis CESSDA-Expert Seminar Odense, September 11th 2008.

Gerrit de Bolster September 24, 2013 Generating Blaise from DDI.

IASSIST / IFOD: Mobile Data and the Life Cycle – Tampere, Finland May 26-29, 2009 Lifecycle & Comparative Studies Metadata Needs of the Future CESSDA RI.

CHARMCATS: Harmonisation demands for source metadata and output management CESSDA Expert Seminar: Towards the CESSDA- ERIC common Metadata Model and DDI3.

Regional Coordinators Meeting September 28-30, 2009 Washington DC Data Process, Management, and Transmission Chart, and Access Policy Nada Hamadeh Statistics.

Barbara M. Altman Emmanuelle Cambois Jean-Marie Robine Extended Questions Sets: Purpose, Characteristics and Topic Areas Fifth Washington group meeting.

ESSnet on SDMX phase II Laura Vignola ISTAT Rome, 3-4 December 2012.

An Leabharlann UCD Órna Roche UCD James Joyce Library Metadata Documenting your data

Sami Borg and Helena Laaksonen : Acquisition policies for a new data archive IASSIST2005 Edinburgh, May 2005

National Digital Repository ® Preserving the imperfect: reflections from NDAD and elsewhere Kevin Ashley Head of Digital Archives Group ULCC.

Developments in Data Discovery at ICPSR George Alter Director, ICPSR University of Michigan.

& Slovak Archive of Social Data “SASD” and DDI 3 IASSIST/IFDO Conference, Tampere, Juraj.

Group & Resource Package - Potentials to re-use metadata with DDI 3 - Uwe Jensen, GESIS – cessda Expert Seminar Nov Ljubljana, Slovenia Group &

STARDAT DATA ARCHIVING SUITE European Survey Research Association (ESRA), July 18 – 22, 2011, Lausanne, Switzerland Monika Linne, Evelyn Brislinger, Wolfgang.

Multilingual thesaurus Controlled vocabularies Taina Jääskeläinen CESSDA Expert Seminar 9-10 November 2009.

Meta Dater Metadata Management and Production System for surveys in Empirical Socio-economic Research A Project funded by EU under the 5 th Framework Programme.

Building Digital Library using DSpace Dr. M.Krishnamurthy, Librarian Indian Statistical Institute 8 th Mile Mysore Road R.V.College Post Bangalore

Mari Kleemola and Jouni Sivonen: Learning NESSTAR IASSIST2001 Amsterdam, May 2001 Finnish Social Science Data Archive.

Arja Kuula: The DDI and Qualitative data IASSIST2001 Amsterdam, May 2001 Finnish Social Science Data Archive.

Hannele Keckman-Koivuniemi and Mari Kleemola : Data Processing in FSD : CHALLENGES IN A NEW ARCHIVE IASSIST2003 Ottawa,

Archiving our Social Science Digital History ECURE 2005 March 1, 2005.

NARA – Roper Center Collaboration: USIA Office of Research Surveys Michael Carlson National Archives and Records Administration Marc Maynard.

CESSDA Expert-Seminar 2004 Data Processing and Publishing Enhancing Dataset Quality - Plausibility – strategies of data checking Meinhard Moschner ZA,

The International Household Survey Network IHSN IHSN Secretariat PARIS21 Steering Committee, 14 November 2007.

Jon Curwin and Roger Slater, QUANTITATIVE METHODS: A SHORT COURSE ISBN © Thomson Learning 2004 Jon Curwin and Roger Slater, QUANTITATIVE.

Data Documentation Initiative (DDI): Goals and Benefits Mary Vardigan Director, DDI Alliance.

ESCWA SDMX Workshop Session: Role in the Statistical Lifecycle and Relationship with DDI (Data Documentation Initiative)

Research data workflow Practice in Slovenian Social Science Data Archives SERSCIDA WP4 – WORKSHOP Ljubljana September 2013.

1 Introduction to Modeling Languages Striving for Engineering Precision in Information Systems Jim Carpenter Bureau of Labor Statistics, and President,

FORMS OF COOPERATION BETWEEN NATIONAL STATISTICAL INSTITUTES AND DATA ARCHIVES Sebastian Kočar (ADP, UL) First Regional Workshop – Microdata Access in.

For education and learning QUALITY MANAGEMENT & EVALUATION OF LEARNING OUTCOMES Dr. Anu Räisänen Councellor of Education FNB

Making Grey Literature Available through Institutional Repositories LeRoy J. LaFleur, Social Sciences Bibliographer Nathan A. Rupp, Metadata Librarian.

IB Computer Science Section 1: Systems life cycle and software development.

IMS Proof of Concept for Data Capture using Metadata Bryan Fitzpatrick Rapanea Consulting Limited June 2014.

DDI-RDF Discovery Vocabulary A Metadata Vocabulary for Documenting Research and Survey Data Linked Data on the Web (LDOW 2013) Thomas Bosch.

Technical Overview of SDMX and DDI : Describing Microdata Arofan Gregory Metadata Technology.

Do We Need to Preserve Research Data? Taina Jääskeläinen FSD Forskning – Arkiv – Forskning 31 May 2007.

P. Schirmbacher Humboldt-Universität zu Berlin The Changing Process of Scholarly Publishing or the Necessity of a New Culture of Electronic.

Professional Administrative Support for Adult Learning Pro- SAL PROJECT INFORMATION.

Metadata management: DDI and Nesstar at the Czech Social Science Data Archive Jindrich Krejci & Yana Leontiyeva Data without Boundaries, Ljubljana 24 &

EVA Workshop, 26 March 2003, Florence, Italy1 COINE Cultural Objects In Networked Environments Anthi Baliou University of Macedonia,Library Thessaloniki,

Colectica: A Platform for DDI 3 based Metadata Management Design. Collect. Share.

Secure Epidemiology Research Platform (SERPent) Kick Start Meeting - April 15 th, 2010 Pascal Heus

DDI and the Lifecycle of Longitudinal Surveys Larry Hoyle, IPSR, Univ. of Kansas Joachim Wackerow, GESIS - Leibniz Institute for the Social Sciences.

ILO Department of Statistics Edgardo Greising

DDI AND EXPERIENCES AT ICPSR Prepared for Expert Seminar Finnish Social Science Data Archive Tampere, Finland September 1-2, 2000.

Looking into the future… Providing Social Science Data Services Jim Jacobs.

CIMES, a tool for describing European Official Statistics Microdata P resented by Raphaëlle Fleureux, Cyril Jayet/ CNRS-RQ DwB 1st Regional Workshop, Ljubljana,

General concepts: DDI Irena Vipavc Brvar, ADP SEEDS Kick-off meeting, Lausanne, May 2015.

CoRD Meeting 12 March 2003 STIPES (Lot 4) STIPES = Statistical Inquiries from Popular European Software.

Metadata and eGovernment The Danish Approach and Experience Palle Aagaard National IT and Telecom Agency, Denmark ERPANET training Seminar September 3-5,

ESSnet project "Automated data collection and reporting in accommodation statistics" Objectives, achievements and results Köln,

Building Capacities for Establishment of Social Science Digital Data Archives Aleksandra Bradić-Martinović, Institute of Economic Sciences, Belgrade Achievements.

Presented By Margaret Hellen Atiro Uganda Bureau of Statistics at the United Nations Regional Seminar on Census Data Archiving 20 – 23 Sep 2011, Addis.

TIC Updates EDDI 2010 Wendy Thomas – 6 Dec Schedule and Process Changes Production schedule is moving to: – Summer / Winter release schedule January.

Writing a HOWTO Guide for DDI An approach for getting started.

1 Handbook on Population and Housing Census Editing Department of Economic and Social Development United Nations Statistics Division Studies in Methods,

1 XML and XML in DLESE Katy Ginger November 2003.

Publishing DDI-Related Topics Advantages and Challenges of Creating Publications Joachim Wackerow EDDI16 - 8th Annual European DDI User Conference Cologne,

Tom W. Smith NORC at the University of Chicago

Multilingual Web Services Possibilities and Pitfalls

The International Privacy Law Library

ESSnet project "Automated data collection and reporting in accommodation statistics" Objectives, achievements and results

Enabling direct data access to social science research data

Question Banks, Reusability, and DDI 3.2 (Use Parameters)

in the data production process

Prepared by Peter Boško, Luxembourg June 2012

Steps towards a Single Point of Access for Survey Questions across Europe: The Euro Question Bank Project Wolfgang Zenk-Möltgen Azadeh MahmoudHashemi GESIS.

Presentation transcript:

An Archive’s Perspective to DDI3 Mari Kleemola Information Services Manager Finnish Social Science Data Archive CESSDA Expert Seminar Ljubljana,

My Starting Points Need to evaluate DDI3 for FSD’s purposes –plans to change our metadata system –need to produce various kinds of metadata DDI2 for long-term preservation (probably) DDI3 for Cessda (but no decisions made yet) ? for KDK (The National Digital Library project) … CESSDA PPP WP8 task 8.2.2

Things to look at… Preservation Multilinguality Groups Reusables, referencing Comparison FSD’s current practises/processes

Test case: ISSP 2006 Finnish data FSD the (primary) financier of data collection and involved in instrument translation etc. Collected by Statistics Finland Two questionnaires: fi and sv, and documentation in Finnish and in English A single study that belongs to several groups/series

ISSP 2006 multinational file ISSP multinational series FSD2248 ISSP FIN 2006 Additional questions Q. in Finnish Q. in Swedish FSD2410 FSD2330 FSD2133 FSD2039 Finnish ISSP studies ISSP SWE 2006 ISSP GER 2006

Subset: variables documented Variables/Questions (see PPP document DR Evaluation of DDI 3.0) Archive and ID variables - Technical variables –FSD specific Substantial variables - types –Simple question: Variable V4 : Q1: Obey laws without exception –Question with items (little battery): V5 Q2a: Public protest meetings V6 Q2b: Protest demonstrations V7 Q2c: National anti-government strike ISSP demographics and interview char. - types –SEX: R: Sex Country specific Question / Variables –Ctry. specific: degree –Country specific education: Finland In addition the following (for FSD’s test purposes): –(K2) Year of birth (integer) - the ISSP variable AGE is calculated from this variable –(K20) WRKSUP : R: Supervises others at work (a filter variable) –(K21) Is R responsible for… (a battery with three subitems and a different universe due to the filter K20, not in the basic ISSP 2006 questionnaire) –(K22) WRKTYPE : R: Workg f priv.,pub sector, selfempl. Total: 18 variables

Tools I tried… DeXtris CESSDA Core DDI 3 Editor-Lite All gave valuable insight to DDI3… … but decided to start from scratch – with the help of Oxygen, Dagstuhl2008 materials, DDI Alliance website (Best Practices, ”table”, Cessda core,…), DDI3 Help Center, SPSSOMS12toDDI30, PPP WP8 paper, and our existing DDI2.1 file

Main problems Almost zero knowledge of XML schemas Lack of time Lack of supporting resources (ie. technical staff) The complexity of DDI3

Working with ”Simple questionnaire example”

Results of Exercise DDI3.0 XML file –It’s valid, it’s got 3771 lines, but what to do with it? Managed to include all our DDI2.1 metadata Need tools to produce DDI3 metadata DDI3 is very flexible, so think carefully –what is reusable (create resource packages) –what can be inherited (use groups) Note: the way your’e going to use the metadata affects the way you group Probably best to use DDI2.1-type documentation for preservation FSD need DDI3 functionalities, but it probably won’t pay off to DDI3 all our studies More questions than answers (many answered at Dagstuhl)

To Do To research more carefully –Grouping –Inheritance –Comparison module –Language issues Input from FSD technical staff needed Plan FSD actions to move from DDI2 to DDI3 European co-operation (CESSDA)

Thank you!