Group & Resource Package - Potentials to re-use metadata with DDI 3 - Uwe Jensen, GESIS – cessda Expert Seminar Nov. 2009 - Ljubljana, Slovenia Group &

Slides:



Advertisements
Similar presentations
Metadata and the UK Data Archive CESSDA Expert Seminar Odense September 2008 Margaret Ward Lenin Ageer.
Advertisements

Metadata Management at GESIS-ZA Reiner Mauer GESIS – Data Archive and Data Analysis CESSDA-Expert Seminar Odense, September 11th 2008.
SDMX in the Vietnam Ministry of Planning and Investment - A Data Model to Manage Metadata and Data ETV2 Component 5 – Facilitating better decision-making.
An Archive’s Perspective to DDI3 Mari Kleemola Information Services Manager Finnish Social Science Data Archive CESSDA Expert Seminar Ljubljana,
Why, what were the idea ? 1.Create a data infrastructure, 2.Data + the knowledge products that are produced on the basis of data a) Efficiant access to.
IASSIST / IFOD: Mobile Data and the Life Cycle – Tampere, Finland May 26-29, 2009 Lifecycle & Comparative Studies Metadata Needs of the Future CESSDA RI.
CHARMCATS: Harmonisation demands for source metadata and output management CESSDA Expert Seminar: Towards the CESSDA- ERIC common Metadata Model and DDI3.
CESSDA Question Databank Tender, results and future Maarten Hoogerwerf, CESSDA expert seminar 2009.
WP 3: Survey Quality Eric Harrison City University London Knut Kalgraff Skjåk Norwegian Social Science Data Services IASSIST May May, Cologne.
Access to and specifics of detailed national LFS data – the case of Slovenia Sebastian Kočar Social Science Data Archives University of Ljubljana 4th DwB.
STARDAT DATA ARCHIVING SUITE European Survey Research Association (ESRA), July 18 – 22, 2011, Lausanne, Switzerland Monika Linne, Evelyn Brislinger, Wolfgang.
Multilingual thesaurus Controlled vocabularies Taina Jääskeläinen CESSDA Expert Seminar 9-10 November 2009.
Meta Dater Metadata Management and Production System for surveys in Empirical Socio-economic Research A Project funded by EU under the 5 th Framework Programme.
IISP Conference: From National Archives towards United Structure of Social Science. Moscow, December 9, 2005 Comparative Survey Research and Study Documentation.
Inside View of DDI Version 3.0: Structural Reform Group Report Presented to IASSIST 25 May 2005 Edinburgh Scotland UK.
Survey Metadata Documentation Sue Ellen Hansen, Gina-Qian Cheung, Kirsten Alcser, Grant Benson, Ashley Bowers, Karl Dinkelmann, Youhong Liu, Beth-Ellen.
DDI 3.0 Conceptual Model Chris Nelson. Why Have a Model Non syntactic representation of the business domain Useful for identifying common constructs –Identification,
The MetaDater Model and the formation of a GRID for the support of social research John Kallas Greek Social Data Bank National Center for Social Research.
Präsentationstitel IAB-ITM Find the right tags in DDI IASSIST 2009, 27th-30th Mai 2009 IAB-ITM Finding the Right Tags in DDI 3.0: A Beginner's Experience.
Codebook Centric to Life-Cycle Centric In the beginning….
Managing the Metadata Lifecycle The Future of DDI at GESIS and ICPSR Peter Granda, ICPSR Meinhard Moschner, GESIS Mary Vardigan, ICPSR Joachim Wackerow,
DDI Does it have a life beyond IASSIST? IASSIST/IFDO 2005 Edinburgh Edinburgh February 11, 2004 Ernie Boyko NESSTAR Americas Ottawa May, 2005.
1IASSIST 2009, Tampere Maarten Hoogerwerf Pitfalls of Enhanced Publications.
CESSDA Expert-Seminar 2004 Data Processing and Publishing Enhancing Dataset Quality - Plausibility – strategies of data checking Meinhard Moschner ZA,
 Name and organization  Have you worked with DDI before? (2 or 3)  If not, are you familiar with XML?  What kind of CAI systems do you use?  Goals.
The education variables in the European Social Survey: Advantages in using the DDI for documentation Hilde Orten and Hege Midtsæter Norwegian Social Science.
IPUMS to IHSN: Leveraging structured metadata for discovering multi-national census and survey data Wendy L. Thomas 4 th Conference of the European Survey.
Background Data validation, a critical issue for the E.S.S.
Data Documentation Initiative (DDI): Goals and Benefits Mary Vardigan Director, DDI Alliance.
ESCWA SDMX Workshop Session: Role in the Statistical Lifecycle and Relationship with DDI (Data Documentation Initiative)
Implementing Digital Object Identifiers at the GESIS Data Archive for the Social Sciences Workshop “Persistent Identifiers for the Social Sciences” Bonn,
DDI Profiles to Support Software Development as well as Data Exchange and Analysis NADDI , Vancouver (Canada) David Schiller, IAB Ingo Barkow,
METADATA DRIVEN SURVEY RESEARCH Alerk Amin, CentERdata Jeremy Iverson, Colectica.
SDMX and DDI Working Together Technical Workshop 5-7 June 2013
DDI: Capturing metadata throughout the research process for preservation and discovery Wendy Thomas NADDI 2012 University of Kansas.
DDI 3.0 Overview Sanda Ionescu, ICPSR. DDI Background Development History 1995 – A grant-funded project initiated and organized by ICPSR proposes to create.
9/14/2012ISC329 Isabelle Bichindaritz1 Database System Life Cycle.
4 April 2007METIS Work Session1 Metadata Standards and Their Support of Data Management Needs Daniel W. Gillman Bureau of Labor Statistics Paul Johanis.
1 Chapter 15 Methodology Conceptual Databases Design Transparencies Last Updated: April 2011 By M. Arief
Development of metadata in the National Statistical Institute of Spain Work Session on Statistical Metadata Genève, 6-8 May-2013 Ana Isabel Sánchez-Luengo.
The activities of CESSDA Data Archives in Europe Roxane Silberman DwP Principal Investigator CNRS/Réseau Quetelet 1st DwB Regional Workshop, Ljubljana,
Emerging methodologies for the census in the UNECE region Paolo Valente United Nations Economic Commission for Europe Statistical Division International.
C ross-European data sharing made easy EDAF Luxembourg.
« 8-11 July 2008 « Metadata Life Cycle « STATISTICS PORTUGAL.
1/26/2004TCSS545A Isabelle Bichindaritz1 Database Management Systems Design Methodology.
Methodology - Conceptual Database Design
Conference on Data Quality for International Organisations, Newport, April Assessment of statistical data quality: The example of the Occupational.
DDI and the Lifecycle of Longitudinal Surveys Larry Hoyle, IPSR, Univ. of Kansas Joachim Wackerow, GESIS - Leibniz Institute for the Social Sciences.
THE LFS REVIEW in the context of Eurostat programme for modernising social micro-data collections Anne CLEMENCEAU - Eurostat 9th Workshop on Labour Force.
Eurostat SDMX and Global Standardisation Marco Pellegrino Eurostat, Statistical Office of the European Union Bangkok,
The Question Bank Graham Hughes & Julie Gibbs Department of Sociology University of Surrey Research Methods Festival, July 2008
MetaPlus Klas Blomqvist Statistics Sweden Research and Development – Central Methods
CIMES, a tool for describing European Official Statistics Microdata P resented by Raphaëlle Fleureux, Cyril Jayet/ CNRS-RQ DwB 1st Regional Workshop, Ljubljana,
General concepts: DDI Irena Vipavc Brvar, ADP SEEDS Kick-off meeting, Lausanne, May 2015.
Building Capacities for Establishment of Social Science Digital Data Archives Aleksandra Bradić-Martinović, Institute of Economic Sciences, Belgrade Achievements.
TIC Updates EDDI 2010 Wendy Thomas – 6 Dec Schedule and Process Changes Production schedule is moving to: – Summer / Winter release schedule January.
SDMX Basics course, March 2016 Eurostat SDMX Basics course, March Introducing the Roadmap Marco Pellegrino Eurostat Unit B5: “Data and.
Active Data Management Planning and its exchange with DDI Uwe Jensen & Sebastian Netscher GESIS - Leibniz Institute for the Social Sciences IASSIST 2016.
Metadata standards Using DDI to Inform, Organize, and Drive Survey Data Production.
Publishing DDI-Related Topics Advantages and Challenges of Creating Publications Joachim Wackerow EDDI16 - 8th Annual European DDI User Conference Cologne,
   Tom W. Smith NORC at the University of Chicago
Topic 2 (ii) Metadata concepts, standards, models and registries
Streamlining the Statistical Production in TurkStat Metadata Studies in TURKSTAT High Level Seminar for Eastern Europe, Caucasus and Central Asia Countries.
2. An overview of SDMX (What is SDMX? Part I)
Big Data ESSNet WP 1: Web scraping / Job Vacancies Pilot
in the data production process
The Next Generation of the Microdata Information System MISSY: An Integrated Solution for the Documentation of European Microdata European DDI User Conference,
Questasy: Documenting and Disseminating Longitudinal Data Online with DDI 3 Edwin de Vet 5/21/2019.
The role of metadata in census data dissemination
GSBPM AND ISO AS QUALITY MANAGEMENT SYSTEM TOOLS: AZERBAIJAN EXPERIENCE Yusif Yusifov, Deputy Chairman of the State Statistical Committee of the Republic.
Presentation transcript:

Group & Resource Package - Potentials to re-use metadata with DDI 3 - Uwe Jensen, GESIS – cessda Expert Seminar Nov Ljubljana, Slovenia Group & Resource Package (+ Comparison) Potentials to re-use metadata with DDI 3 for cross section to complex data Question & considerations from CESSDA PPP WP8 Data and Metadata infrastructures Uwe Jensen, GESIS Data Archive

Group & Resource Package - Potentials to re-use metadata with DDI 3 - Uwe Jensen, GESIS – cessda Expert Seminar Nov Ljubljana, Slovenia Basic options to re-use of metadata in DDI 3 Group > inheritance mechanism  Structure two or more studies > series (by design) or “ad-hoc” …. –Commonalities > upper level (Group > Subgr. > Study Unit) inherited down the tree as long as … –Differences > ADD or DELETE > lower level Resource Package > reference mechanism  schemes that may be used outside of a Group structure by single Studies or grouped studies -Rational: they are independent of a study (or related groups)

Group & Resource Package - Potentials to re-use metadata with DDI 3 - Uwe Jensen, GESIS – cessda Expert Seminar Nov Ljubljana, Slovenia “Which modules to use for what purpose or situation” Re-use of metadata requires overview & decisions as several approaches are possible to structure metadata What life-cycle event and or process: exchange … - document by …; - publish & present by year, topic, languages, country; … - preservation … - tools design … What is common? What different? Study, Questions, Variables, ….. –Sit. 0: Study (cross- section) –Sit. 1: Group (+ comparison) –Sit. 2: Resource Package (+ comparison) –Sit. 3: Group & RP (+ comparison) –Sit. 4: Standalone: Group or RP

Group & Resource Package - Potentials to re-use metadata with DDI 3 - Uwe Jensen, GESIS – cessda Expert Seminar Nov Ljubljana, Slovenia Situation 1: Use of Group (& Comparison) Documentation of comparative studies when the basic standard is defined (captured, translated) Considered for: –ex-ante (comparative by-design) for basic modular questions in relation to the fieldwork –for transfer in the lifecycle like when the documentation is finished at that place / at that time (> from data producer to data provider) –publication & presentation of a completed documentation –Publish at a public portal > for Browsing in grouped structure –Search for comparable items based on metadata from CM module Example: ISSP module questions, but … To discuss Advantage / Disadvantage not to use RP (with comparison; in addition) > estimate rate of expected / unexpected change

Group & Resource Package - Potentials to re-use metadata with DDI 3 - Uwe Jensen, GESIS – cessda Expert Seminar Nov Ljubljana, Slovenia Situation 2: Use of Resource Package (& Comparison) Documentation of comparative or comparable studies, when the standard is defined or to be adjusted / changed Considered for: –ex-post comparison of standardized / harmonised variables to create new harmonised variables –ex-post (comparative after-the-fact) in relation to the fieldwork –at an harmonisation project –Published metadata repositories like question Example: like EB trend variables, but … Question: Advantage / Disadvantage not to use Group (+ Compar.)

Group & Resource Package - Potentials to re-use metadata with DDI 3 - Uwe Jensen, GESIS – cessda Expert Seminar Nov Ljubljana, Slovenia Situation 3: Combined use of Group & RP (& CM) Considered for: –Reuse of different schemes like for Questions, Variables, Codes etc. for comparative by design and adjustments after the fact (of the fieldwork) –Comparison for ex-post harmonisation; –Standardisation & documentation of changes over time … Basic example for exploration is the EB trend case as presented at IASSIST 2009 Question: Advantage / Disadvantage of this combined approach

Group & Resource Package - Potentials to re-use metadata with DDI 3 - Uwe Jensen, GESIS – cessda Expert Seminar Nov Ljubljana, Slovenia Situation 4: Use of Resource Package (or Group) Considered for: –Controlled Vocabs for inclusion in several documentation objects –Substantial standards on several documentation objects for inclusion by reference (ISCO, ISO) –Standard Demography

Group & Resource Package - Potentials to re-use metadata with DDI 3 - Uwe Jensen, GESIS – cessda Expert Seminar Nov Ljubljana, Slovenia General (intermediate) conclusions Single Study (+ comparison) Use RP for metadata independent from the study Group (+ comparison) Use group > subgroup > study unit to organise dependent studies according to the study scope (comparative by design; ad-hoc by topics) Analyse commonalities > place on top / middle level (consider rel. studies) Analyse differences & deviation > Add or overwrite on lower levels Resource Package (+ comparison) for survey independent information (internal) or for to provide public access (e.g. Occupation; Countries; Demography) Group & RP (+ comparison) Combine approaches to document & manage complex metadata

Group & Resource Package - Potentials to re-use metadata with DDI 3 - Uwe Jensen, GESIS – cessda Expert Seminar Nov Ljubljana, Slovenia Example: Subgroup 1 Citizenship Study Unit Contry 1 Group ISSP survey series with 10 Modules - Conceptual Component -- Data Collection - - Logical Product - - Archive Subgroup 2 – Environment Conceptual Component ….. Data Collection … Logical Product … Sg 3 … Sg 4 … Sg 5 … Sg 6 … Sg 7 … Sg 8 … Sg 10 … Sg 9 … Subgroup Year 1993 Subgroup Year 2000 Study Unit Contry 1 Subgroup Year Subgroup Year Subgroup Year Subgroup Year Subgroup Year Subgroup Year Subgroup Year Subgroup Year Subgroup Year Subgroup Year Subgroup Year Subgroup Year Subgroup Year Subgroup Year Subgroup Year Subgroup Year Subgroup Year Subgroup Year Subgroup Year Subgroup Year Subgroup Year Sg 9 … Subgroup Year Subgroup Year Data Collection Logical Product Study Unit Country n Study Unit Contry n Data Collection Logical Product

Group & Resource Package - Potentials to re-use metadata with DDI 3 - Uwe Jensen, GESIS – cessda Expert Seminar Nov Ljubljana, Slovenia Subgroup Module 2 (Replication) RoG I > II > III >IV > Cumulation Conceptual Component …  concept scheme Data Collection  Methodology  Question Logical Product  Variables Schemes  Code Schemes Group ISSP survey series - Conceptual Component - Data Collection - Logical Product RoG II – 1990 – 10 Coutr. Subgroup RoG I – Countries  StudyUnit Coutry1 o Add, delete specifics  StudyUnit Coutry2 o …. RoG III – 1996 – 27 C RoG IV – 2006 – 35 C Build Integration RoG I-IV from Group / subgroup & Comparison & RP Series specific Resource package(s) for (basic) Ex-Ante Standard on  Universe > scheme  Concept > schemes  Questions > schemes  Variables > schemes Archive Resource Package (s) for Substantial Standards:  Countries (ISO)  Regions (Nuts...)  Employment (ISCO...)  Standard Demography  … Series specific Resource package(s) for standard from Ex-Post harmonisation?  Religion, parties, …  Constructed Variables > schemes Re-use from Resource Package Inclusion by reference Initial Schema - combined use of Group Resource Package - Comparison (not yet considered) One Subgroup for one Topical Module 1 to 10