Codebook Centric to Life-Cycle Centric In the beginning….

Slides:



Advertisements
Similar presentations
Workshop on Metadata Standards and Best Practices November th, 2007 Session 4 The Data Documentation Initiative Technical Overview Pascal Heus Open.
Advertisements

DLI Training Nesstar Workshop
Foundational Objects. Areas of coverage Technical objects Foundational objects Lessons learned from review of Use Case content Simple Study Simple Questionnaire.
Metadata at ICPSR Sanda Ionescu, ICPSR.
Making the Case for Metadata at SRS-NSF National Science Foundation Division of Science Resources Statistics Jeri Mulrow, Geetha Srinivasarao, and John.
Metadata to Support the Survey Life Cycle Alice Born, Statistics Canada Joint UNECE/Eurostat/OECD Work Session on Statistical Metadata (METIS) Geneva,
Educational Research: Competencies for Analysis and Application, 9 th edition. Gay, Mills, & Airasian © 2009 Pearson Education, Inc. All rights reserved.
Wendy Thomas Minnesota Population Center NADDI 2014.
Describing Aggregate Data: The Enigma Variations Presented at IASSIST/IFDO 2001 Wendy L.Thomas 18. May 2001.
Organizing Groups Why, When and How to do it. Brief history of the need for groups In the old days of MARC records you could either be a machine readable.
Arja Kuula: The DDI and Qualitative data IASSIST2001 Amsterdam, May 2001 Finnish Social Science Data Archive.
The Variable Explosion Or how the DDI variable spread out to inhabit multiple modules in DDI 3.0.
TC3 Meeting in Montreal (Montreal/Secretariat)6 page 1 of 10 Structure and purpose of IEC ISO - IEC Specifications for Document Management.
Copyright © 2008 Pearson Education, Inc. Publishing as Pearson Addison-Wesley Fluency with Information Technology Third Edition by Lawrence Snyder Chapter.
Reusable!? Or why DDI 3.0 contains a recycling bin.
DDI 3.0 Conceptual Model Chris Nelson. Why Have a Model Non syntactic representation of the business domain Useful for identifying common constructs –Identification,
IASSIST Conference 2006 – Ann Arbor, May Metadata as report and support A case for distinguishing expected from fielded metadata Reto Hadorn S I.
Präsentationstitel IAB-ITM Find the right tags in DDI IASSIST 2009, 27th-30th Mai 2009 IAB-ITM Finding the Right Tags in DDI 3.0: A Beginner's Experience.
Putting DDI 3.0 to Work for You!
Documentation Tools in the Survey Lifecycle. Outline What is NSFG Webdoc? Instrument documentation != Survey documentation Data Cleaning/Processing in.
FGDC, Meet the DDI Adding Geospatial Metadata to a Numeric Data Catalog Julie Linden Yale University.
 Name and organization  Have you worked with DDI before? (2 or 3)  If not, are you familiar with XML?  What kind of CAI systems do you use?  Goals.
STATISTICS CANADA SURVEY LIFECYCLE WOLFVILLE, APRIL 2008 SURVEY LIFECYCLE Michel B. Séguin Atlantic DLI Training.
Modernizing the Data Documentation Initiative (DDI-4) Dan Gillman, Bureau of Labor Statistics Arofan Gregory, Open Data Foundation WICS, 5-7 May 2015.
ISO/TC211 Geographic Information/Geomatics Implementing ISO Metadata David Danko Work Item 15—Project Leader
Environment Change Information Request Change Definition has subtype of Business Case based upon ConceptPopulation Gives context for Statistical Program.
IPUMS to IHSN: Leveraging structured metadata for discovering multi-national census and survey data Wendy L. Thomas 4 th Conference of the European Survey.
Data Documentation Initiative (DDI): Goals and Benefits Mary Vardigan Director, DDI Alliance.
World Bank: Microdata Library Development Data Group.
ESCWA SDMX Workshop Session: Role in the Statistical Lifecycle and Relationship with DDI (Data Documentation Initiative)
WP.5 - DDI-SDMX Integration
Research data workflow Practice in Slovenian Social Science Data Archives SERSCIDA WP4 – WORKSHOP Ljubljana September 2013.
WP.5 - DDI-SDMX Integration E.S.S. cross-cutting project on Information Models and Standards Marco Pellegrino, Denis Grofils Eurostat METIS Work Session6-8.
NSI 1 Collect Process AnalyseDisseminate Survey A Survey B Historically statistical organisations have produced specialised business processes and IT.
Case Studies: Statistics Canada (WP 11) Alice Born Statistics UNECE Workshop on Statistical Metadata.
Survey Data Management and Combined use of DDI and SDMX DDI and SDMX use case Labor Force Statistics.
Just Enough DDI 3 for the “DDI: Managing Metadata for Longitudinal Data — Best Practices”
DDI: Capturing metadata throughout the research process for preservation and discovery Wendy Thomas NADDI 2012 University of Kansas.
3 rd Annual European DDI Users Group Meeting, 5-6 December 2011 The Ongoing Work for a Technical Vocabulary of DDI and SDMX Terms Marco Pellegrino Eurostat.
IMS Proof of Concept for Data Capture using Metadata Bryan Fitzpatrick Rapanea Consulting Limited June 2014.
Introduction to DDI 3.0 Sanda Ionescu ICPSR CESSDA Expert Seminar, September 2007.
4 April 2007METIS Work Session1 Metadata Standards and Their Support of Data Management Needs Daniel W. Gillman Bureau of Labor Statistics Paul Johanis.
Technical Overview of SDMX and DDI : Describing Microdata Arofan Gregory Metadata Technology.
DDI-RDF Leveraging the DDI Model for the Linked Data Web.
Metadata Models in Survey Computing Some Results of MetaNet – WG 2 METIS 2004, Geneva W. Grossmann University of Vienna.
February 17, 1999Open Forum on Metadata Registries 1 Census Corporate Statistical Metadata Registry By Martin V. Appel Daniel W. Gillman Samuel N. Highsmith,
Introduction to Metadata, the DDI and the Metadata Editor Presentation to the SERPent project team by Margaret Ward 3 March 2010.
United Nations Regional Seminar on Census Data Archiving for Africa, Addis Ababa, Ethiopia, September, 2011 Documentation and Cataloguing in Data.
Environment Change Information Request Change Definition has subtype of Business Case based upon ConceptPopulation Gives context for Statistical Program.
Evolution of Data Documentation Providing Social Science Data Services Jim Jacobs, 2008.
DDI and the Lifecycle of Longitudinal Surveys Larry Hoyle, IPSR, Univ. of Kansas Joachim Wackerow, GESIS - Leibniz Institute for the Social Sciences.
National Boot camp Vancouver Heather Dryburgh and Michel B. Séguin May 31 st, 2011 Survey Life cycle.
ISO 191** Overview A “Family” of Standards. Resources ISO Standards Web Page – Technical.
Stretching Your Data Management Skills Chuck Humphrey University of Alberta Atlantic DLI Workshop 2003.
HETUS Pilot Group 8 Privacy procedures and ethical issues Kimberly Fisher, Centre for Time Use Research – co-ordinator External consultant Kai Ludwigs.
Metadata requirements for archiving structured data Alice Born Statistics Canada Joint UNECE/Eurostat/OECD Work Session on Statistical Metadata (9-11 April.
Metadata models to support the statistical cycle: IMDB
Publishing DDI-Related Topics Advantages and Challenges of Creating Publications Joachim Wackerow EDDI16 - 8th Annual European DDI User Conference Cologne,
DDI and GSIM – Impacts, Context, and Future Possibilities
Improving data services by creating a question database
CFI John R Evans Leaders Fund Digital Data Management
What’s New in Colectica 5.3 Part 1
Data Management: Documentation & Metadata

Wendy Thomas NADDI 2012 University of Kansas
Enhancing ICPSR metadata with DDI-Lifecycle
Updates on the XSLT stylesheets for DDI
Managing Private and Public Views of DDI Metadata Repositories
The role of metadata in census data dissemination
DDI and GSIM – Impacts, Context, and Future Possibilities
Presentation transcript:

Codebook Centric to Life-Cycle Centric In the beginning….

We described the life cycle  But how were we going to relate this iterative life cycle in XML?  So we went back to…… In the beginning….

Was the IDEA!

 Described in the study unit Who is proposing the study Research question or purpose of the study Research population Background research Formal study proposal Funding sources Proposal Revisions Concepts and definitions

 Proposal becomes reality…Data Collection Questionnaire development Instrumentation Who collects the data How the data is collected Data cleaning Data processing  Recoding and weighting  Imputation  Suppression or allocation

 Publishing the Data: The logical product content Categories Variables nCube Including links to previously defined  Concepts  Questions  Processing activities

 Describing the Physical Data Product Link to a logical product description Multiple structures to describe different storage structures Information on relational links between record types stored in one or many data files Links to variables and NCube cells

 Record of a Physical Instance Link to a physical storage structure Specifics of the range of records in the file  Record type selection  Geographic selection  Topical selection Summary statistics Identification and location of the actual data file

 Making it visible to the outside world Publishing in-house Depositing with a distributor  Creating “archive” information  Packaging and publishing as a DDI Instance The DDI Instance now has identity as an object This means that your metadata can be “discovered”

Study Unit Data Collection Logical Product Physical Structure 1 Physical Instance (full file) Physical Instance (subset of records) Physical Structure 2 Physical Instance (full file) Archive Information INSTANCE

 Archive received instance and data Add local identification  Archive name and contact  Use restrictions or access process Record processing information  Cleaning metadata  Creating new formats / record subsets  Creating an internal physical instance (file rename for example)

 Groups Adding to an existing series Creating a new series  Time series  Topical Series  Management / Use series

 Management over time Materials added over time  Adding local concept scheme  Adding citations to publications based on data  Recording value added information discovered during use and analysis  Information change Local contact information Location information changes