1 Integration of the Eurostat and ESS Metadata Systems A. Götzfried Head of Unit B6 Eurostat.

Slides:



Advertisements
Similar presentations
1 Meeting of the OECD Short-term Economic Statistics Expert Group June 2002 FUTURE OF SHORT-TERM ECONOMIC STATISTICS DISSEMINATED BY THE OECD.
Advertisements

SDMX training session on basic principles, data structure definitions and data file implementation 29 November
The quality framework of European statistics by the ESCB Quality Conference Vienna, 3 June 2014 Aurel Schubert 1) European Central Bank 1) This presentation.
ESS reference metadata implementation of standards and interoperability of National/European metadata systems Bogdan Sorin ZDRENTU, Eurostat (B5) Mogens.
SDMX – AN OECD PERSPECTIVE Paul Schreyer OECD CCSA Special Session, September 2014 Rome.
The use and convergence of quality assurance frameworks for international and supranational organisations compiling statistics The European Conference.
Implementing ESS standards for reference metadata and quality reporting at Istat Work Session on Statistical Metadata Topic (i): Metadata standards and.
Quality assurance activities at EUROSTAT CCSA Conference Helsinki, 6-7 May 2010 Martina Hahn, Eurostat.
REFERENCE METADATA FOR DATA TEMPLATE Ales Capek EUROSTAT.
SDMX Implementation in the European Statistical System P. Everaers, A. Götzfried Eurostat.
Eurostat achievements and challenges Emanuele Baldacci, Director European Commission - Eurostat Director Methodology; Corporate statistical.
Eurostat SDMX and Global Standardisation Marco Pellegrino Eurostat, Statistical Office of the European Union Bangkok,
SDMX and Metadata SDMX Basics Course 12 April 2013 Daniel Suranyi Eurostat B5 Management of statistical data and metadata.
1 5a. SDMX and reference metadata exchanges Bogdan ZDRENTU Eurostat Unit B5: “Central data and metadata services” SDMX Basics course, October 2015.
Work Session on Statistical Metadata 2013 Session III: Metadata in the Statistical Business Process Better documenting statistical business processes:
1 Enhancing data quality by using harmonised structural metadata within the European Statistical System A. Götzfried Head of Unit B6 Eurostat.
1 Quality reporting within the Eurostat and the ESS metadata systems August Götzfried and Håkan Linden Eurostat Unit B6: Reference databases and metadata.
Reference metadata: a step towards greater accessibility and clarity of statistical data European conference on quality in official statistics 2-5 June.
13 November, 2014 Seminar on Quality Reports QUALITY REPORTS EXPERIENCE OF STATISTICS LITHUANIA Nadiežda Alejeva Head, Price Statistics.
Quality Reports Ukraine November Regulation 223/2009 on European Statistics European Statistics shall be produced  on the basis of uniform standards.
United Nations Economic Commission for Europe Statistical Division GSBPM in Documentation, Metadata and Quality Management Steven Vale UNECE
1 Recent developments in quality related matters in the ESS High level seminar for Eastern Europe, Caucasus and Central Asia countries Claudia Junker,
Eurostat Quality reporting on energy statistics Framework and experience at EU level United Nations Oslo Group on Energy Statistics Aguascalientes (Mexico),
Quality declarations Study visit from Ukraine 19. March 2015
The Eurostat Metadata Handler Götzfried Eurostat (Head of Unit B6)
The ESS vision, ESSnets and SDMX
5b. SDMX and reference metadata: guideline examples
Structural and reference metadata in the European Statistical System
Item 6 - Introduction to ESS Metadata Handler
The CVD Metadata Handler
Usage of National Reference Metadata Editor (NRME)
The new metadata structure & Country Specific Notes
Statistics Denmark’s presentation of metadata
2. An overview of SDMX (What is SDMX? Part I)
ESS technical standards and tools for quality reporting
Draft EP/Council Regulation for processes, standards and
5. Detail: Main SDMX objects for. metadata exchange. (What is SDMX
Implementation of SDMX in the ESS
Quality assessment ESTP Training Course “Quality Management and survey Quality Measurement” Rome, 24 – 27 September 2013 Giorgia Simeoni Researcher Unit.
What is next? H. Linden Eurostat, Unit B5
Statistical Information Technology
August Götzfried Eurostat unit B 4
The ESS reference metadata standards
National reference metadata and the National Reference Metadata Editor
Draft EP/Council Regulation on processes, standards and metadata for the exchange and dissemination of European statistics A. Götzfried Head of.
August Götzfried Eurostat unit B 4
SDMX : General introduction H. Linden, Eurostat, Unit B5
A review of the 2011 census round in the EU, including the successful implementation of a detailed European legal base First meeting of the Technical Coordination.
Item of the Agenda Towards an integrated Eurostat metadata handler – Eurostat SDMX Registry services for Member States Francesco Rizzo Unit B3 13.
Working Group "Agriculture and Environment – Pesticides Statistics" September Quality reports B. Zdrentu V. Delhaxhe-Wolmering Eurostat.
SDMX Progress and implementation A. Götzfried, Unit B6
Quality Reporting in CBS
Legislative strategy for cross-cutting ESS legislation
Education and Training Statistics Working Group, May 2011
Item 7.11 SDMX Progress report
Standards and guidelines for reference metadata
Quality reporting in the ESS - State of play and next steps
SDMX Implementation The National Accounts use case
Metadata on quality of statistical information
Prodcom Working Group Item Quality reporting and indicators
M. Henrard, B5 N. Buysse and H. Linden, B6 Eurostat
Annegrete Wulff Statistics Denmark
ESTP course on Statistical Metadata – Introductory course –
European Statistical System Metadata Handler ESS MH (Super) Providers
ESS technical standards and tools for quality reporting
IA on quality reporting
7. Introduction to the main SDMX objects for metadata exchange
ESS conceptual standards for quality reporting
Presentation transcript:

1 Integration of the Eurostat and ESS Metadata Systems A. Götzfried Head of Unit B6 Eurostat

2 2 Outline The Eurostat Metadata-Handler and two of its main components The Eurostat Metadata-Handler and two of its main components  Euro SDMX Registry  National Reference Metadata Editor (National RME) The standard structures for metadata reporting The standard structures for metadata reporting  Euro SDMX Metadata Structure (ESMS)  ESS Standard for Quality Reports structure (ESQRS) The Generic Statistical Business Process Model (GSBPM) The Generic Statistical Business Process Model (GSBPM) Impacts on the s tatistical business processes Impacts on the s tatistical business processes

3 3 The Eurostat Metadata-Handler is the backbone of a metadata-driven harmonised statistical business process at Eurostat and in the European Statistical System; provides one central interface for accessing different types of metadata by Eurostat staff or by ESS members; provides services to other IT applications within the ESS; is the primary source for different types of harmonised metadata to be used within Eurostat and the ESS.

4 4 The Eurostat Metadata-Handler and its main components National Metadata Editor National Metadata Editor EMIS RAMON CODED EurostatMetadataHandler Common user interface Euro SDMX Registry

5 The Euro SDMX Registry as part of the Eurostat-MH The Euro SDMX Registry currently contains : the Eurostat and ECB Data Structure Definitions in use for GESMES- based data transmission; the code lists currently used in the different GESMES-based Data Structure Definitions; the list of data and metadata flows (from countries to Eurostat); the list of statistical concepts used in the abovementioned data structure definitions; some additional information such as provision agreements, etc. The Euro SDMX Registry will contain in the future: the agreed SDMX data and metadata structure definitions used in different statistical domains for data and metadata exchange; the harmonized code lists used in SDMX data structure definitions; national data structure definitions and code lists used in the ESS countries (if uploaded by countries).

6 The use of the Euro SDMX Registry for National Statistical Authorities The National Statistical Authorities will have access to the Euro SDMX Registry : for storing the data and metadata structure definitions they are using at national level; for storing the code lists they are using at national level; for retrieving the SDMX data and metadata structure definitions used within the ESS or beyond; for retrieving the harmonised structural metadata (code lists) used within the ESS or beyond; for retrieving information related to data and metadata flows and other standards (the concepts used, the provision agreements, etc… )

7 The National Reference Metadata Editor : is the component dealing with national reference metadata; will accommodate the current ESS standards for reference metadata such as the ESMS or the upcoming ESQRS; is addressed to the national producers of reference metadata, who will be able to compile their domain-specific metadata on- line and transmit them to Eurostat; is the IT tool stimulating the harmonization of reference metadata within the ESS; will be made available to the ESS later in The National Reference Metadata Editor as part of the Eurostat-MH

8 Business process related to a national reference metadata file

9 9 The standard structures for Metadata reporting Progress made since 2008 : 2008: introduction of the Euro SDMX Metadata Structure (ESMS) at Eurostat and the ESS for the production and dissemination of reference metadata (Commission Recommendation 498/2009) 01/2009: release of the new version of the ESS quality reporting documents: ESS Standard for Quality Reports (ESQR) ESS Handbook for Quality Reports (EHQR)  Detailed requirements following the European Statistics Code of Practice  ESS Quality and Performance Indicators (QPI’s) defined 03/09: EP/Council Regulation 223/2009  Article 12 defining the quality criteria to be reported

10 The Euro SDMX Metadata Structure (ESMS) The 21 concepts and sub-concepts of the ESMS :

11 The Euro SDMX Metadata Structure (ESMS) The ESMS is more oriented to the USERS of statistics:  helps to understand the statistical data released  does not include too detailed information on data quality  uses 21 SDMX cross domain concepts  now attached at upper level on Eurostat’s website

12 The new ESQRS Based on the ESQR (ESS Standard for Quality Report), a new report structure - the ESS Standard for Quality Reports Structure: ESQRS - was created for harmonising the reporting on statistical data quality within the ESS. The ESQRS is using the main statistical data quality criteria as listed in EP/Council Regulation 223/2009 and as being part of the ESMS and details them further : Relevance Accuracy Timeliness and Punctuality Accessibility and Clarity Comparability Coherence A subset of the Quality Performance Indicators (QPI’s) is covered in the new ESQRS

13 From ESQR to ESQRS

14 ESMS and ESQRS ESQRS is more oriented to the PRODUCERS of statistics  to monitor the quality of the statistics produced in detail  concentrating on the main quality concepts (being also part of the ESS Statistics Regulation No 223/2009) The information in the ESQRS is more detailed than the information on quality criteria in the ESMS but there is consistency and information common to both ESMS and ESQRS  ESQRS goes deeper than ESMS in terms of quality criteria

15 ESMS and ESQRS

16 The Generic Statistical Business Process Model (GSBPM)

17 The GSBPM in Eurostat : the Eurostat CVD

18 Impacts on the statistical business processes The Eurostat Metadata Handler is SDMX compliant and impacts the statistical business process at Eurostat and within the ESS: –The Euro SDMX Registry will make available all SDMX harmonised artefacts (Code lists, DSD’s, MSD’s, etc.) to Eurostat and the ESS –The National RME will offer a way to harmonise the collection, structure, content and format of national reference metadata and national quality reports Development of ESS common building blocks – Eurostat works on a standardised process metadata structure

19 All over Good progress of the Eurostat Metadata Handler since 2008 but work has to be pursued in harmonisation and integration of the statistical business processes Good progress of the Eurostat Metadata Handler since 2008 but work has to be pursued in harmonisation and integration of the statistical business processes Implementation of the ESS metadata standards is essential to: Implementation of the ESS metadata standards is essential to: –enable a more automatic production, exchange and dissemination of metadata –minimise the reporting burden for statistics producers –improve availability and clarity for statistics users –promote for international exchange of information –reduce the costs and burden in Eurostat –reinforce the reporting according to EP/Council Regulation 223/2009 The harmonisation work also considerably contributes to the improvement and integration of the statistical business processes as defined in the Commission Communication 404/2009. The harmonisation work also considerably contributes to the improvement and integration of the statistical business processes as defined in the Commission Communication 404/2009.