PHDD – An RDF Vocabulary for the Physical Data Description Work in Progress Joachim Wackerow and Thomas Bosch (both GESIS – Leibniz Institute for the Social.

Slides:



Advertisements
Similar presentations
Digital Repositories – Linked Open Data – the possible Role of D4Science Workshop, December 2010, FAO use cases A tool to create Linked Data providers.
Advertisements

The Institute for Learning and Research Technology is a national centre of excellence in the development and use of technology-based methods in teaching,
DDI3 Uniform Resource Names: Locating and Providing the Related DDI3 Objects Part of Session: DDI 3 Tools: Possibilities for Implementers IASSIST Conference,
RDF and RDB 1 Some slides adapted from a presentation by Ivan Herman at the Semantic Technology & Business Conference, 2012.
™ Suggestions for Semantic Web Interfaces to Relational Databases Mike Dean W3C Workshop on RDF Access to Relational Databases Cambridge,
Exanda A Flexible On-Line Tabulation System Using DDI 3 Part of Session: DDI 3 Tools: Possibilities for Implementers IASSIST Conference, Cornell University,
ReQuest (Validating Semantic Searches) Norman Piedade de Noronha 16 th July, 2004.
Reducing Metadata Objects Dan Gillman November 14, 2014.
Web Service Architecture Part I- Overview and Models (based on W3C Working Group Note Frank.
The Data Cube Vocabulary: Statistics in the Web of Linked Data Arofan Gregory Open Data Foundation WICS, Geneva, 5-7 May 2015.
Ontology Semantic Mediation in the Big Picture MMI Workshop - August 2005.
Metadata: Its Functions in Knowledge Representation for Digital Collections 1 Summary.
Modernizing the Data Documentation Initiative (DDI-4) Dan Gillman, Bureau of Labor Statistics Arofan Gregory, Open Data Foundation WICS, 5-7 May 2015.
Metadata Standards and Applications 4. Metadata Syntaxes and Containers.
Locating objects identified by DDI3 Uniform Resource Names Part of Session: Concurrent B2: Reports and Updates on DDI activities 2nd Annual European DDI.
RDF: Concepts and Abstract Syntax W3C Recommendation 10 February Michael Felderer Digital Enterprise.
Managing & Integrating Enterprise Data with Semantic Technologies Susie Stephens Principal Product Manager, Oracle
DOI Registration for Social and Economic Data da|ra Brigitte Hausstein GESIS Leibniz-Institute for the Social Sciences, Berlin.
Survey Data Management and Combined use of DDI and SDMX DDI and SDMX use case Labor Force Statistics.
 Copyright 2005 Digital Enterprise Research Institute. All rights reserved. Towards Translating between XML and WSML based on mappings between.
Controlled Vocabularies for DDI 4 How to represent CVs?
DDI Lifecycle: Moving Forward Outcome of the Recent Workshop in Dagstuhl Joachim Wackerow.
Experiences with the Design and Development Process of DDI Requirements for Future Work Ideas for Improvement Joachim Wackerow.
Metadata: An Overview Katie Dunn Technology & Metadata Librarian
DDI: Capturing metadata throughout the research process for preservation and discovery Wendy Thomas NADDI 2012 University of Kansas.
DDI-RDF Discovery Vocabulary A Metadata Vocabulary for Documenting Research and Survey Data Linked Data on the Web (LDOW 2013) Thomas Bosch.
The MMI Tools Carlos Rueda Monterey Bay Aquarium Research Institute OOS Semantic Interoperability Workshop Marine Metadata Interoperability Project Boulder,
Object Description by Data Records DDI Moving Forward - IASSIST Sprint, May 2014 Joachim Wackerow Larry Hoyle.
Technical Overview of SDMX and DDI : Describing Microdata Arofan Gregory Metadata Technology.
Leveraging the DDI Model for Linked Statistical Data in the Social, Behavioural, and Economic Sciences DC Thomas Bosch GESIS – Leibniz.
Master Informatique 1 Semantic Technologies Part 11Direct Mapping Werner Nutt.
1 Ontology-based Semantic Annotatoin of Process Template for Reuse Yun Lin, Darijus Strasunskas Depart. Of Computer and Information Science Norwegian Univ.
DDI-RDF Leveraging the DDI Model for the Linked Data Web.
DDI & Model-View-Controller: An Architectural Perspective Dennis Wegener, Matthäus Zloch, Thomas Bosch (GESIS) Dagstuhl,
OGC ® ® Hydrologic Features SWG Irina Dornblut, GRDC 17 September 2015 Nottingham OGC TC meeting 1.
DDI and the Lifecycle of Longitudinal Surveys Larry Hoyle, IPSR, Univ. of Kansas Joachim Wackerow, GESIS - Leibniz Institute for the Social Sciences.
The future of the Web: Semantic Web 9/30/2004 Xiangming Mu.
DDI Discovery: An Overview of Current RDF Vocabularies Arofan Gregory Metadata Technologies NA Joachim Wackerow GESIS.
Strategies for subject navigation of linked Web sites using RDF topic maps Carol Jean Godby Devon Smith OCLC Online Computer Library Center Knowledge Technologies.
Metadata, Resources, and the RDF 김민수 Chapter 1. Creating the Sementic Web with RDF2 Overview Knowledge Representation Library Metadata RDFRDF.
Eurostat SDMX and Global Standardisation Marco Pellegrino Eurostat, Statistical Office of the European Union Bangkok,
DDI Background Wendy Thomas DDI Sprint Dagstuhl W. Thomas Copyright © DDI 2015 Published under Creative Commons Attribute-ShareAlike 3.0.
A Generic Multilevel Approach for Designing Domain Ontologies Based on XML Schemas 3rd Annual European DDI Users Group Meeting (EDDI 2011) Thomas.
The Data Documentation Initiative (DDI) Fostering Community Engagement and Adoption Breakout 9 RDA Sixth Plenary, Paris Mary Vardigan, ICPSR, University.
DDI Specifications Recent Developments Wendy Thomas Joachim Wackerow Technical Committee EDDI Copenhagen.
Application Report: An extensible policy editing API for privacy and identity management policies Giles Hogben jrc. It European Commission.
Semantic Web COMS 6135 Class Presentation Jian Pan Department of Computer Science Columbia University Web Enhanced Information Management.
Improving User Access to Metadata for Public and Restricted Use US Federal Statistical Files William C. Block Jeremy Williams Lars Vilhuber Carl Lagoze.
Prizms for Data Publication and Management May 9, 2014 Katie Chastain.
Working Group 4 Data and metadata lifecycle management  1. Policies and infrastructure for data and metadata changes  2. Supporting file and data formats.
Prizms for Data Publication and Management Katie Chastain May 9, 2014.
Renovation of Eurostat dissemination chain
Metadata Driven Aspect Specification Ricardo Ferreira, Ricardo Raminhos Uninova, Portugal Ana Moreira Universidade Nova de Lisboa, Portugal 7th International.
The Registration Agency, DDI and Linked Open Data
Publishing DDI-Related Topics Advantages and Challenges of Creating Publications Joachim Wackerow EDDI16 - 8th Annual European DDI User Conference Cologne,
RDFa How and Why Ralph R. Swick World Wide Web Consortium
Wheat Data Interoperability Esther DZALE YEUMO KABORE Richard FULSS
DDI - A Metadata Standard for the Community
Czech Statistical Office
Applications of IFLA Namespaces
A DDI3.2 Style for Data and Metadata Extracted from SAS
Alternatives for Representing Coding of Qualitative Data in DDI
Enabling direct data access to social science research data
A Web service for transforming metadata schemas
DDI-RDF Discovery Vocabulary _ Use Cases and Vocabularies
Updates on the XSLT stylesheets for DDI
LOD reference architecture
Disseminating Service Registry Records
The Next Generation of the Microdata Information System MISSY: An Integrated Solution for the Documentation of European Microdata European DDI User Conference,
Sample Use Cases for the DataDictionary View in DDI Views (DDI4)
Presentation transcript:

PHDD – An RDF Vocabulary for the Physical Data Description Work in Progress Joachim Wackerow and Thomas Bosch (both GESIS – Leibniz Institute for the Social Sciences)

What is it? Description of the physical properties of a data file. Focus on most common format types – Rectangular format – Character-separated values (CSV) or fixed-record length

Character-separated Values Header row

Fixed Record-length Format

Motivation Data.gov and similar initiatives provide data in CSV format or similar W3C Government Linked Data Working Group Charter – “The mission … is to provide standards and other information which help governments around the world publish their data as effective and usable Linked Data using Semantic Web technologies.” Machine-actionability - intended for program use

Example at data.gov

Existing Approaches CSV on the Web Working Group Charter (W3C) CSV on the Web Working Group Charter Linkage – Linked CSV (Jeni Tennison) Linked CSV – CSV linked data (Quoderat) CSV linked data Description – Common Format and MIME Type for Comma-Separated Values (CSV) Files, RFC 4180RFC 4180 – csv: a vocabulary for describing CSV files (Rurik Thomas Greenall, Norwegian University at Trondheim) csv Representations – URI design for RDF conversion of CSV-based data (Tim Lebo, Gregory Todd Williams) URI design for RDF conversion of CSV-based data – CSV2RDF Application (Ivan Ermilov, Sören Auer, Claus Stadler) CSV2RDF Application Research results: – Intended for different purposes – Description approaches not sufficient

PHDD – First Ideas

PHDD – UML Model

PHDD - Overview General approach is not really new, just a complete set of properties for the most common cases. Structure Table – the rectangular data file [disco::DataFile, dcat::Distribution] – TableStructure - common properties plus specific ones for delimited and fixed columns Column - common properties plus specific ones for delimited and fixed columns [disco::Variable]

Table Structure

Column Description

Relationship to other RDF Vocabularies

Usage Scenarios Data PHDDDiscoveryDCAT Program Description Transformation Analysis Data User Provider Search DDI XML

Relationship to DDI XML Mapping to DDI XML Specifications – DDI Codebook 2.* approx. half of the properties of PHDD – DDI Lifecycle 3.* almost all properties of PHDD

Relationship of DDI Specifications DDI Codebook 2.* DDI Lifecycle 3.* DDI 4 Model OWL/RDF RepresentationXML Schema Representation PHDD Discovery XKOS XML SchemaOWL/RDF Future

Acknowledgements Contributions by – Larry Hoyle (Institute for Policy & Social Research, University of Kansas) – Richard Cyganiak (DERI - Digital Enterprise Research Institute )

Further Information Development repository of PHDD – description description DDI Alliance RDF Vocabularies –