Topic 2 (ii) Metadata concepts, standards, models and registries

Slides:



Advertisements
Similar presentations
United Nations Statistics Division Principles and concepts of classifications.
Advertisements

Breakout Session 5: Collaboration Between DPs and SPs Protocol simple, providing a service more difficult… …because of lack of networking among DPs and.
The MetaDater Model and the formation of a GRID for the support of social research John Kallas Greek Social Data Bank National Center for Social Research.
ESCWA SDMX Workshop Session: Role in the Statistical Lifecycle and Relationship with DDI (Data Documentation Initiative)
WP.5 - DDI-SDMX Integration E.S.S. cross-cutting project on Information Models and Standards Marco Pellegrino, Denis Grofils Eurostat METIS Work Session6-8.
Case Studies: Statistics Canada (WP 11) Alice Born Statistics UNECE Workshop on Statistical Metadata.
Metadata management and statistical business process at Statistics Estonia Work Session on Statistical Metadata (Geneva, Switzerland 8-10 May 2013) Kaja.
3 rd Annual European DDI Users Group Meeting, 5-6 December 2011 The Ongoing Work for a Technical Vocabulary of DDI and SDMX Terms Marco Pellegrino Eurostat.
Metadata for a Statistical Data Warehouse Lars-Göran Lundell Statistics Sweden Luxembourg 22 September 2011.
4 April 2007METIS Work Session1 Metadata Standards and Their Support of Data Management Needs Daniel W. Gillman Bureau of Labor Statistics Paul Johanis.
CountryData Technologies for Data Exchange SDMX Information Model: An Introduction.
GSIM implementation in the Istat Metadata System: focus on structural metadata and on the joint use of GSIM and SDMX Mauro Scanu
United Nations Economic Commission for Europe Statistical Division Part B of CMF: Metadata, Standards Concepts and Models Jana Meliskova UNECE Work Session.
Metadata Models in Survey Computing Some Results of MetaNet – WG 2 METIS 2004, Geneva W. Grossmann University of Vienna.
« 8-11 July 2008 « Metadata Life Cycle « STATISTICS PORTUGAL.
ESS-net DWH ESSnet DWH - Metadata in the S-DWH Harry Goossens – Statistics Netherlands Head Data Service Centre / ESSnet Coordinator
First Principles for Data Semantics Standards Frank Farance Dan Gillman US Experts WG2 N
ESSnet on microdata linking and data warehousing in statistical production: Metadata Quality in the Statistical Data Warehouse.
The data standards soup … Is the most exciting topic you can dream of.
Metadata Common Vocabulary a journey from a glossary to an ontology of statistical metadata, and back Sérgio Bacelar
2.An overview of SDMX (What is SDMX? Part I) 1 Edward Cook Eurostat Unit B5: “Central data and metadata services” SDMX Basics course, October 2015.
Metadata Framework for a Statistical Data Warehouse
Joint UNECE/Eurostat/OECD work session on statistical metadata (METIS) APRIL 2006Mar Blanco Frías STATISTICAL METADATA MODEL DEVELOPED IN SPAIN:CURRENT.
OECD Expert Group on Statistical Data and Metadata Exchange (Geneva, May 2007) Update on technical standards, guidelines and tools Metadata Common.
Further Developments in the Terminological Theory of Data Frank Farance Farance Inc Daniel Gillman US Bureau of Labor Statistics.
METIS - UNECE Statistical Division Slide 14-6 July 2007 Part C of the Common Metadata Framework (CMF) Metadata and the Statistical Cycle.
Role of the IMDB in the CBA and IM Strategy Presented to Information Management Committee Standards Division June
Statistical Data and Metadata Exchange SDMX Metadata Common Vocabulary Status of project and issues ( ) Marco Pellegrino Eurostat
UNECE METIS 2008 Pre-work session survey of participants.
METADATA MANAGEMENT AT ISTAT: CONCEPTUAL FOUNDATIONS AND TOOLS Istituto Nazionale di Statistica ITALY.
Metadata requirements for archiving structured data Alice Born Statistics Canada Joint UNECE/Eurostat/OECD Work Session on Statistical Metadata (9-11 April.
Reading literacy. Definition of reading literacy: “Reading literacy is understanding, using and reflecting on written texts, in order to achieve one’s.
Metadata models to support the statistical cycle: IMDB
Prepared by: Galya STATEVA, Chief expert
5b. SDMX and reference metadata: guideline examples
Structural and reference metadata in the European Statistical System
Contents Introducing the GSBPM Links to other standards
THE BNSI EXPERIENCE IN METADATA COLLECTION AND ORGANIZATION
Wheat Data Interoperability Esther DZALE YEUMO KABORE Richard FULSS
The Generic Statistical Information Model (GSIM) and the Sistema Unitario dei Metadati (SUM): state of application of the standard Cecilia Casagrande –
Interoperable data formats: SDMX
Concept of a document Lesson 3.
SDMX Information Model
Vocabularies and Semantics
Documentation of statistics
Validation Break-out sessions
Cross-domain concepts
Metadata in the modernization of statistical production at Statistics Canada Carmen Greenough June 2, 2014.
2. An overview of SDMX (What is SDMX? Part I)
Towards common metadata using GSIM and DDI 3
2. An overview of SDMX (What is SDMX? Part I)
Max Booleman Statistics Netherlands
SDMX Information Model: An Introduction
Social Research Methodology and Supplementary Documentation John Kallas University of the Aegean, Department of Sociology.
LOD reference architecture
Manager’s Overview DoDAF 2.0 Meta Model (DM2) TBS dd mon 2009
August Götzfried Eurostat unit B 4
SDMX Software Libraries Eurostat, Unit B5
Statistical Information Framework at CSO - A Beginning
Presentation to SISAI Luxembourg, 12 June 2012
Semantic Statistics DDI Lifecycle: Moving Forward Outcome of the Recent Workshops in Dagstuhl Joachim Wackerow.
Part B of CMF: Metadata, Standards Concepts and Models Jana Meliskova
The role of metadata in census data dissemination
The Role of Metadata in Census Data Dissemination
Annegrete Wulff Statistics Denmark
Generic Statistical Information Model (GSIM)
Work Session on Statistical Metadata (Geneva, Switzerland May 2013)
Classifications and Linked Open Data Formalizing the structure and content of statistical classifications Item 9.1 Standards Working Group Luxembourg,
GSIM overview Mauro Scanu ISTAT
Statistical databases in theory and practice Part IV: Modelling the contents and structure of official statistics Bo Sundgren 2010.
Presentation transcript:

Topic 2 (ii) Metadata concepts, standards, models and registries Questions from opening session Common terminology – SDMX’s MCV, definitions for terms such as survey Classification / typology of statistical metadata

Topic 2 (ii) Metadata concepts, standards, models and registries Metadata classifications Multidimensional classification for statistical metadata – by purpose (who, why), by content (what), by source and by form (how) Metadata by usage or purpose All processes produce metadata metadata X each process – paradata (peridata) Metadata by content – object attachment Corporate metadata repository Process, data, conceptual object, collection source Finally combines –source X use

Metadata classifications (2) Do we need a metadata classification by form – coded, structured, organization ? SDMX requirements Structural metadata – descriptors of the data (Bo’s Table 2c) Reference metadata – contents and quality of data (Bo’s tables 2a, 2b and 2d) Archive metadata Administrative – Bo’s table 2b Structure – Bo’s table 2c Survey and definitional – Bo’s tables 2a, 2b, 2d

Metadata registries and harmonized content Metadata classifications and standards – How do we move to more harmonization of metadata standards and classifications? ESS – metadata are documented according to a standard metadata SDMX metadata standards – good start – should definitions be adopted as part of METIS CMF? Role of interoperability – should they be part of the CMF? PC AXIS – SDMX SDMX – 11179 other mappings / crosswalks

Data semantics and interoperability (data and semantics) Two papers – US paper on data and datatypes; Statistics Netherlands on metadata models (classifications and datasets) Data semantics – better understanding of the meaning of data (paragraph 2 US and paragraph 9 NLD) Synonymous information and equality Mechanisms needed to identify metadata items that are the same – synonyms For categorical data – equality is defined the same way as for numbers - semantics of values must be the same to allow for comparisons Are these ideas similar?

Statistical classifications Logic of classification systems is essentially Boolean algebra – new view of classifications Related view ontological systems Figures 5 and 6 – Is the rule the classes must be mutual exclusive not respected? Conclusion: formal semantics can play a constructive role in the development of models for statistical metadata How does this view relate to Dan’s – ontology is formal means for organizing data and data descriptions