MISSY 2 [Microdata Information System – part 2]

Slides:

Advertisements

Similar presentations

FDZ-RV Research Data Centre of the German Pension Insurance Integration of Metadata in FDZ-RV 1 Integration of Metadata in FDZ-RV (Research Data Centre.

Advertisements

MICS4 Survey Design Workshop Multiple Indicator Cluster Surveys Survey Design Workshop Data Archiving.

DDI for the Uninitiated ACCOLEDS /DLI Training: December 2003 Ernie Boyko Statistics Canada Chuck Humphrey University of Alberta.

DLI Training Nesstar Workshop

Data Documentation Initiative (DDI) Workshop Carol Perry Ernie Boyko April 2005 Kingston Ontario.

Metadata Management at GESIS-ZA Reiner Mauer GESIS – Data Archive and Data Analysis CESSDA-Expert Seminar Odense, September 11th 2008.

Documentation and Additional Resources Alexander Mack.

Metadata at ICPSR Sanda Ionescu, ICPSR.

Making the Case for Metadata at SRS-NSF National Science Foundation Division of Science Resources Statistics Jeri Mulrow, Geetha Srinivasarao, and John.

Access to and specifics of detailed national LFS data – the case of Slovenia Sebastian Kočar Social Science Data Archives University of Ljubljana 4th DwB.

Plannes security for items, variables and applications NEPS User Rights Management.

Implementation of the DDI at the Roper Center A Pilot Project on Resource Integration Marc Maynard and Hui Wang The Roper Center.

Fitting a survey life cycle in the DDI Irene Wong Chuck Humphrey IASSIST Edinburgh May 2005.

German Microdata Lab MISSY Microdata Information System IASSIST 2006, Ann Arbor May 24, 2006 Andrea Janßen, Jeanette Bohr, Joachim Wackerow (German Microdata.

A database-driven tool to create items, variables and questionnaires NEPS Metadata Editor.

QDDS [ Questionnaire Developmen Documentation System ] State and strategy for DDI 3 1.

IASSIST Conference 2006 – Ann Arbor, May Metadata as report and support A case for distinguishing expected from fielded metadata Reto Hadorn S I.

CONTENT: A model for collaborative database building Trevor Bond Alan Cornish Washington State University Libraries.

Documentation Tools in the Survey Lifecycle. Outline What is NSFG Webdoc? Instrument documentation != Survey documentation Data Cleaning/Processing in.

 Name and organization  Have you worked with DDI before? (2 or 3)  If not, are you familiar with XML?  What kind of CAI systems do you use?  Goals.

Data Management: Documentation & Metadata Types of Documentation.

© 2014 by the Regents of the University of Michigan Metadata from Blaise and DDI 3.0/3.2 Gina Cheung Beth-Ellen Pennell North American DDI Conference April.

IPUMS to IHSN: Leveraging structured metadata for discovering multi-national census and survey data Wendy L. Thomas 4 th Conference of the European Survey.

Model-View-Controller Architecture in a Systems Analysis and Design Course Dr. Robert F. Zant Illinois State University.

1 The planned use of DDI 3.0 within a German Research Data Center IASSIST, Session “Tools and Implementations of DDI 3.0”, May 27, 2009 Dana Müller.

WP.5 - DDI-SDMX Integration

WP.5 - DDI-SDMX Integration E.S.S. cross-cutting project on Information Models and Standards Marco Pellegrino, Denis Grofils Eurostat METIS Work Session6-8.

CIMES, a tool for describing European Official Statistics Microdata P resented by Arnaud Szulek CASD/GENES Luxembourg, European Data Access Forum, March.

Case Studies: Statistics Canada (WP 11) Alice Born Statistics UNECE Workshop on Statistical Metadata.

Distributed Access to Data Resources: Metadata Experiences from the NESSTAR Project Simon Musgrave Data Archive, University of Essex.

4 April 2007METIS Work Session1 Metadata Standards and Their Support of Data Management Needs Daniel W. Gillman Bureau of Labor Statistics Paul Johanis.

DINI „Electronic Publishing Group“ DINI – Certificate Document and Publication Repositories “Electronic Publishing Group“

DLI Training April 2004 Kingston Ontario. DDI What, Why, How?

Ihr Logo Chapter 7 Web Content Mining DSCI 4520/5240 Dr. Nick Evangelopoulos Xxxxxxxx.

CASE STUDY: STATISTICS NORWAY (SSB) Jenny Linnerud and Anne Gro Hustoft Joint UNECE/Eurostat/OECD work session on statistical metadata (METIS) Luxembourg.

Leveraging the DDI Model for Linked Statistical Data in the Social, Behavioural, and Economic Sciences DC Thomas Bosch GESIS – Leibniz.

Data documentation and metadata for data archiving and sharing Managing research data well workshop London, 30 June 2009 Manchester, 1 July 2009.

DDI-RDF Leveraging the DDI Model for the Linked Data Web.

BLAISE to DDI Vipavc Irena, ADP, Slovenia CESSDA - Seminar, September, 2004.

Ontologies and Lexical Semantic Networks, Their Editing and Browsing Pavel Smrž and Martin Povolný Faculty of Informatics,

P. Schirmbacher Humboldt-Universität zu Berlin The Changing Process of Scholarly Publishing or the Necessity of a New Culture of Electronic.

United Nations Regional Seminar on Census Data Archiving for Africa, Addis Ababa, Ethiopia, September, 2011 Documentation and Cataloguing in Data.

Metadata management: DDI and Nesstar at the Czech Social Science Data Archive Jindrich Krejci & Yana Leontiyeva Data without Boundaries, Ljubljana 24 &

MISSY - Metadata for Official Statistics - a new service for EU microdata - European Data Access Forum Luxembourg, March 2015 Jeanette Bohr GESIS – Leibniz.

PatentScope - Electronic Publication World Intellectual Property Organization.

Colectica: A Platform for DDI 3 based Metadata Management Design. Collect. Share.

Using XML to store Descriptive Metadata Richard Murphy Rosarie O’Riordan Central Statistics Office Ireland.

A radiologist analyzes an X-ray image, and writes his observations on papers  Image Tagging improves the quality, consistency.  Usefulness of the data.

Mercury – A Service Oriented Web-based system for finding and retrieving Biogeochemical, Ecological and other land- based data National Aeronautics and.

OVERVIEW OF ARCHIVING OF MICRODATA SILAS M. MULWA Kenya National Bureau of Statistics United Nations Regional Seminar on Census Data Archiving for Africa.

Eurostat SDMX and Global Standardisation Marco Pellegrino Eurostat, Statistical Office of the European Union Bangkok,

H. Widmann (M&D) Data Discovery and Processing within C3Grid GO-ESSP/LLNL / June, 19 th 2006 / 1 Data Discovery and Basic Processing within the German.

The Data Documentation Initiative (DDI) Fostering Community Engagement and Adoption Breakout 9 RDA Sixth Plenary, Paris Mary Vardigan, ICPSR, University.

7. Data Import Export Lingma Acheson Department of Computer and Information Science IUPUI CSCI N207 Data Analysis Using Spreadsheets 1.

Invitation to Computer Science 6 th Edition Chapter 10 The Tower of Babel.

Simulation Production System Science Advisory Committee Meeting UW-Madison March 1 st -2 nd 2007 Juan Carlos Díaz Vélez.

Basic Web Page Design. Text book: HTML, XHTML, and CSS: Visual QuickStart Guide, Sixth Edition written by Elizabeth Castro. Software: Adobe® Dreamweaver®

Publishing DDI-Related Topics Advantages and Challenges of Creating Publications Joachim Wackerow EDDI16 - 8th Annual European DDI User Conference Cologne,

Rich metadata from the start

The Re3gistry software and the INSPIRE Registry

Building an Integrable XBRL Portal Daniel Hamm German Central Bank

الجهاز المركزي للإحصاء الفلسطيني

DDI-RDF Discovery Vocabulary _ Use Cases and Vocabularies

A Question Database for the German Longitudinal Election Study

Information and software architecture for statistical dissemination

Prepared by Peter Boško, Luxembourg June 2012

The Next Generation of the Microdata Information System MISSY: An Integrated Solution for the Documentation of European Microdata European DDI User Conference,

EDDI Copenhagen (Denmark)

CAse STudy – Update 2010 Metadata Management in Official Statistics in Germany METIS, Geneva, March 10-12, 2010.

Presentation transcript:

MISSY 2 [Microdata Information System – part 2] Implementing DDI 3: The German Microcensus Case Study andias.wira-alam@gesis.org oliver.hopt@gesis.org

Information Processes in the Social Sciences Frank Sawitzki Prof. Dr. York Sure Sure Andias Wira Alam Benjamin Zapilko Daniel Hienert Engin Sagbas Oliver Hopt Peggy Fischer Peter Mutschke Dr. Philipp Mayr Philipp Schaer Wei Shen Siegfried Schomisch Ute Koch Timo Wandhöfer Simon Bachenberg

Issues: Documenting the Metadata at Variable Level. DDI 3 Editor? Metadata Presentation?

(Scientific Community) General Work Flow A B Public (Scientific Community) Federal Statistical Office A B The Federal Statistical Office (Destatis)… provides access to microdata for scientific purposes (scienitifc use files). provides survey documents for MISSY. in collaboration with, produces scientific use files of the Microcensus (e.g. anonymisation, construction of variable labels). GESIS provides… provides metadata for the Microcensus scientific use files on the Web (MISSY): codebook and detailled variable information in DDI 3 format. study description and study related material (e.g. questionnaires, definitions, interviewer guides). examples and recommendations on analysing the metadata. 4 4

(Example: Code Book and Questionnaire) Available Materials (Example: Code Book and Questionnaire) Code Book

(Example: Code Book and Questionnaire) Available Materials (Example: Code Book and Questionnaire) Questionnaire

Code Book & Questionnaire What goes to where? (DDI 3 structure) Questionnaire Code Book & Questionnaire Code Book Variable Name (EF Number) Variable Label Question Number (no text and other details) Frequencies Question Number Question Text

<DataCollection> <QuestionScheme> <QuestionItem> What goes to where? (DDI 3 structure) DDI 3 Code Book & Questionnaire Code Book Variable Name (EF Number) Variable Label Question Number Question Text Frequencies <DataCollection> <LogicalProduct> <PhysicalInstance> <QuestionScheme> <CategoryScheme> <Statistics> <VariableScheme> <VariableStatistics> <QuestionItem> <Variable> reference reference

Subjects (Categorization) Comparable Variables (DDI 3 structure ++) Subjects (Categorization) Subject 1 Subject 1.1 Subject 1.2 Subject 2 Subject 2.1 Subject 2.1.1 Subject 2.1.1.1 Subject 2.1.1.2 EF xy (1995) belongs to comparable comparable belongs to EF yz (1996) comparable presentation EF xy (1995) EF yz (1996) Subject 1.2 Subject 1.1

DDI 3 Editor 1973.ddi 1978.ddi 2004.ddi 2007.ddi Support Multi User

Software Architecture DDI 3 EDITOR WebDAV Server store DBClear Data Service Transforming DDI 3 into DBClear format WebServer (Typo3) XML + XSLT + Groovy USERS HTML View edit DDI 3.0 Editor DDI Service Web Information System request Software Architecture Views c a b Model

DDI to Metadatabase Lucene Index Database Indexing

Web Information System in MISSY: (3 detail views of the metadata - dynamic pages) List of Variables (Variablenliste). Subject Outline (Thematische Gliederung). Timeline Matrix of Variables (Variablen-Zeitpunkte-Matrix).

Acknowledgement Future Work This project is funded by the BMBF Germany (01UW0707 - "Servicezentrum für Mikrodaten der GESIS / MISSY II"). Future Work Integrating with regional microcensus. Improving our application (e.g. performance, search capabilities, object oriented database, etc) so it can be used also by other studies. Open Research Data.