4 April 2007METIS Work Session1 Metadata Standards and Their Support of Data Management Needs Daniel W. Gillman Bureau of Labor Statistics Paul Johanis.

Slides:



Advertisements
Similar presentations
1 Statistics Norway Information Architecture – some challenges ODaF meeting, Colchester April 2008 Rune Gløersen Director Department for IT and.
Advertisements

Status on the Mapping of Metadata Standards
April, 2004 Lars Thygesen International Trade Expert meeting Whats going on at OECD: statistical information management.
Metadata to Support the Survey Life Cycle Alice Born, Statistics Canada Joint UNECE/Eurostat/OECD Work Session on Statistical Metadata (METIS) Geneva,
1 Work session convened by the Friends of the Chair Group on Integrated Economic Statistics Bern, 6-8 June 2007 Session 3(c) DISSEMINATION STANDARDS (DATA.
Is Your Data Facility ISO Compliant? Progress Towards Harmonizing the DDI and ISO/IEC Dan Gillman Information Scientist US Bureau of Labor Statistics.
U. S. Bureau of Labor Statistics The Nature of Data Frank Farance Farance, Inc Daniel W. Gillman US Bureau of Labor Statistics.
Reducing Metadata Objects Dan Gillman November 14, 2014.
DDI Does it have a life beyond IASSIST? IASSIST/IFDO 2005 Edinburgh Edinburgh February 11, 2004 Ernie Boyko NESSTAR Americas Ottawa May, 2005.
Modernizing the Data Documentation Initiative (DDI-4) Dan Gillman, Bureau of Labor Statistics Arofan Gregory, Open Data Foundation WICS, 5-7 May 2015.
Producing and managing metadata Workshop on Writing Metadata for Development Indicators Lusaka, Zambia 30 July – 1 August 2012 Writing Metadata for Development.
Future of MDR - ISO/IEC Metadata Registries (MDR) Larry Fitzwater, SC 32 WG 2 Convener Computer Scientist U.S. Environmental Protection Agency May.
ESCWA SDMX Workshop Session: Role in the Statistical Lifecycle and Relationship with DDI (Data Documentation Initiative)
Background Defining and mapping business processes in statistical organisations started at least 10 years ago –“Statistical value chain” –“Survey life-cycle”
WP.5 - DDI-SDMX Integration
WP.5 - DDI-SDMX Integration E.S.S. cross-cutting project on Information Models and Standards Marco Pellegrino, Denis Grofils Eurostat METIS Work Session6-8.
NSI 1 Collect Process AnalyseDisseminate Survey A Survey B Historically statistical organisations have produced specialised business processes and IT.
Case Studies: Statistics Canada (WP 11) Alice Born Statistics UNECE Workshop on Statistical Metadata.
Survey Data Management and Combined use of DDI and SDMX DDI and SDMX use case Labor Force Statistics.
Statistics New Zealand Classification Management System Andrew Hancock Statistics New Zealand Prepared for 2013 Meeting of the UN Expert Group on International.
Metadata management and statistical business process at Statistics Estonia Work Session on Statistical Metadata (Geneva, Switzerland 8-10 May 2013) Kaja.
Using ISO/IEC to Help with Metadata Management Problems Graeme Oakley Australian Bureau of Statistics.
DDI-RDF Discovery Vocabulary A Metadata Vocabulary for Documenting Research and Survey Data Linked Data on the Web (LDOW 2013) Thomas Bosch.
Vincenzo Del Vecchio Banca d’Italia Statistics Collection and Processing Department 2012 ESSnet Workshop – 4 December.
Is Your Data Facility ISO Compliant? Progress Towards Harmonizing the DDI and ISO/IEC Dan Gillman Information Scientist US Bureau of Labor Statistics.
Development of metadata in the National Statistical Institute of Spain Work Session on Statistical Metadata Genève, 6-8 May-2013 Ana Isabel Sánchez-Luengo.
Met a-data Resources in Europe: within NSIs and from Dosis Projects Wilfried Grossmann Department of Statistics and Decision Support Systems University.
SDMX Standards Relationships to ISO/IEC 11179/CMR Arofan Gregory Chris Nelson Joint UNECE/Eurostat/OECD workshop on statistical metadata (METIS): Geneva.
CASE STUDY: STATISTICS NORWAY (SSB) Jenny Linnerud and Anne Gro Hustoft Joint UNECE/Eurostat/OECD work session on statistical metadata (METIS) Luxembourg.
Leveraging the DDI Model for Linked Statistical Data in the Social, Behavioural, and Economic Sciences DC Thomas Bosch GESIS – Leibniz.
Metadata Models in Survey Computing Some Results of MetaNet – WG 2 METIS 2004, Geneva W. Grossmann University of Vienna.
Statistics Portugal/ Metadata Unit Monica Isfan « Joint UNECE/ EUROSTAT/ OECD Work Session on Statistical Metadata.
February 17, 1999Open Forum on Metadata Registries 1 Census Corporate Statistical Metadata Registry By Martin V. Appel Daniel W. Gillman Samuel N. Highsmith,
Metadata Architecture at StatCan MSIS 2008 Luxembourg, April 7-9, 2008 Karen Doherty Director General Informatics Branch Statistics Canada.
United Nations Regional Seminar on Census Data Archiving for Africa, Addis Ababa, Ethiopia, September, 2011 Documentation and Cataloguing in Data.
Statistical Metadata System in the State Statistical Committee Baku, Azerbaijan, 2013 State Statistical Committee of the Republic of Azerbaijan 1.
9 th Open Forum on Metadata Registries Harmonization of Terminology, Ontology and Metadata 20th – 22nd March, 2006, Kobe Japan. Presentation Title: Day:
ISO/IEC : Framework for a Metadata Registry By Daniel W. Gillman Bureau of Labor Statistics USA.
Data and Metadata Session 5 Mark Viney Australian Bureau of Statistics 6 June 2007.
METIS: 20 Years of Progress Daniel W. Gillman US Bureau of Labor Statistics.
Overview of SC 32/WG 2 Standards Projects Supporting Semantics Management Open Forum 2005 on Metadata Registries 14:45 to 15:30 13 April 2005 Larry Fitzwater.
Eurostat SDMX and Global Standardisation Marco Pellegrino Eurostat, Statistical Office of the European Union Bangkok,
Tutorial on XML Tag and Schema Registration in an ISO/IEC Metadata Registry Open Forum 2003 on Metadata Registries Tuesday, January 21, 2003; 4:45-5:30.
SDMX IT Tools Introduction
Metadata Working Group Jean HELLER EUROSTAT Directorate A: Statistical Information System Unit A-3: Reference data bases.
2.An overview of SDMX (What is SDMX? Part I) 1 Edward Cook Eurostat Unit B5: “Central data and metadata services” SDMX Basics course, October 2015.
4 April 2006METIS Work Session1 The Nature of Data Frank Farance Farance, Inc Daniel W. Gillman US Bureau of Labor Statistics.
Statistical Metadata Extensions to the X3.285 Metamodel By Daniel W. Gillman Chairman, NCITS/L8 U.S. Bureau of the Census.
Role of the IMDB in the CBA and IM Strategy Presented to Information Management Committee Standards Division June
Statistical Data and Metadata Exchange SDMX Metadata Common Vocabulary Status of project and issues ( ) Marco Pellegrino Eurostat
UNECE METIS 2008 Pre-work session survey of participants.
United Nations Economic Commission for Europe Statistical Division GSBPM and Other Standards Steven Vale UNECE
Relationship between Short-term Economic Statistics Expert Group Meeting on Short-Term Statistics February 2016 Amman, Jordan.
METADATA MANAGEMENT AT ISTAT: CONCEPTUAL FOUNDATIONS AND TOOLS Istituto Nazionale di Statistica ITALY.
Metadata requirements for archiving structured data Alice Born Statistics Canada Joint UNECE/Eurostat/OECD Work Session on Statistical Metadata (9-11 April.
Metadata models to support the statistical cycle: IMDB
Topic 2 (ii) Metadata concepts, standards, models and registries
End-to-End Management of the Statistical Process An Initiative by ABS
Metadata Standards for Statistical Classifications
Generic Statistical Business Process Model (GSBPM)
Metadata in the modernization of statistical production at Statistics Canada Carmen Greenough June 2, 2014.
2. An overview of SDMX (What is SDMX? Part I)
2. An overview of SDMX (What is SDMX? Part I)
Metadata use in the Statistical Value Chain
Semantic Statistics DDI Lifecycle: Moving Forward Outcome of the Recent Workshops in Dagstuhl Joachim Wackerow.
Part B of CMF: Metadata, Standards Concepts and Models Jana Meliskova
The role of metadata in census data dissemination
Work Session on Statistical Metadata (Geneva, Switzerland May 2013)
Petr Elias Czech Statistical Office
Presentation transcript:

4 April 2007METIS Work Session1 Metadata Standards and Their Support of Data Management Needs Daniel W. Gillman Bureau of Labor Statistics Paul Johanis Statistics Canada

4 April 2007METIS Work Session2 Overview Terminology Theory ISO/IEC Statistical Data Corporate Metadata Repository Model Metadata Schemes –XBRL; Neuchâtel; DDI; SDMX; CWM Integration Conclusion

4 April 2007METIS Work Session3 Terminology Theory Property = something observed Object = perceivable or conceivable Characteristic = abstraction of properties of objects Concept = unique combination of characteristics Designation = association of sign with concept

4 April 2007METIS Work Session4 Terminology Theory Concepts –Intension = sum of characteristic –Extension = set of corresponding objects –General = 2 or more objects in extension Designation = term (Example: man) –Individual = 1 object in extension Designation = appelation (Example: Dan)

4 April 2007METIS Work Session5 ISO/IEC nd Edition Published (in 2005); 3 rd Edition underway Freely available on web – me/PubliclyAvailableStandards.htmhttp://isotc.iso.org/livelink/livelink/fetch/2000/2489/Ittf_Ho me/PubliclyAvailableStandards.htm See also –ISO/IEC TR (Achieving Content Consistency) –ISO/IEC (Language Independent Datatypes) Future – ISO/IEC –Interoperability and Bindings

4 April 2007METIS Work Session6 ISO/IEC Object Class –“What is being counted here?” –Example – METIS 2006 attendees Property –Characteristic of the object class –Example – country of birth Data Element Concept := OC + P

4 April 2007METIS Work Session7 ISO/IEC Value Domain –What are the allowed values? –Example – ISO Country codes (2-alpha) Data Element := DEC + VD

4 April 2007METIS Work Session8 Statistical Data Data –Population (concept)= Object Class –Characteristic (concept)= Property –Values (designation)= Value Domain Micro-data –General concept Macro-data –Individual concept

4 April 2007METIS Work Session9 CMR CMR – Corporate Metadata Repository Model Extension of ISO/IEC –For statistical surveys –Sample –Questionnaire –Data sets –Products –Systems

4 April 2007METIS Work Session10 Metadata Schemes XBRL (extensible business reporting language) DDI (data documentation initiative) SDMX (statistical data and metadata exchange) Neuchâtel Group (classification + variable models) CWM (common warehouse metamodel)

4 April 2007METIS Work Session11 Metadata Schemes XBRL – XML for Financial Data and Metadata –Recording + Transferring –Instance documents based on “taxonomies” Schema – element structure Labels – reuse across languages and purposes References – to legal or accounting standards Presentation – rules for specifying hierarchy of elements Calculations – rules for calculations between elements Definitions – rules for other relationships between elements

4 April 2007METIS Work Session12 Metadata Schemes DDI (data documentation initiative) –Data archives, for codebooks –5 chapters –Document; Study; File; Data; Other –Main concept – data set –Describes Microdata Tables

4 April 2007METIS Work Session13 Metadata Schemes SDMX (statistical data and metadata exchange) –BIS, ECB, IMF, World Bank, UN, Eurostat, OECD –Main concept – data or metadata structure definition –Scheme for defining data and metadata transfer structures –Describes Macrodata Time series

4 April 2007METIS Work Session14 Metadata Schemes Neuchâtel Group (classification + variable models) Sweden, Norway, Netherlands, Switzerland, US German IT company Did include Denmark, Finland –Main concepts – classification, variable –Describes Classifications, microdata

4 April 2007METIS Work Session15 Metadata Schemes CWM – Common Warehouse Metamodel –OMG – Object Management Group –Information supply chain = Survey life-cycle –Tool integration –Common metadata model framework Map between tools Share metadata Common view of metadata

4 April 2007METIS Work Session16 Integration XBRL ISO11179/ CMR DDI SDMX CWM Thesauri/search resources Data Collection Data Dissemination Data Transfer between Organizations and Organizational Units Database Interoperability Data Collection Data Dissemination

4 April 2007METIS Work Session17 Integration

4 April 2007METIS Work Session18 Conclusion Metadata Constructs –Throughout survey life-cycle –Many linkages Questions