Implementing ESS standards for reference metadata and quality reporting at Istat Work Session on Statistical Metadata Topic (i): Metadata standards and.

Slides:



Advertisements
Similar presentations
Case Studies Slovenia Julija Kutin METIS Workshop on the Statistical Business Process and Case.
Advertisements

Mogens Grosen Nielsen Statistics Denmark
Implementation of GSBPM, DDI and SDMX reference metadata at Statistics Denmark UNECE workshop 5-7 May 2015 Mogens Grosen Nielsen
Information System for Quality Documentation A Short Presentation for the ESTP Course “Data Dissemination and Publication of Statistics” by Sonia Vittozzi.
The use and convergence of quality assurance frameworks for international and supranational organisations compiling statistics The European Conference.
The Statistical Metadata System: its role in a statistical organization Jana Meliskova Joint UNECE / Eurostat / OECD Work Session on Statistical Metadata.
Giovanna Brancato, Marina Signore Istat Work Session on Statistical Metadata (METIS) Metadata and Quality Indicators Reuse for Quality reporting Geneva,
Case Studies: Statistics Canada (WP 11) Alice Born Statistics UNECE Workshop on Statistical Metadata.
European Conference on Quality in Official Statistics (Q2010) 4-6 May 2010, Helsinki, Finland Brancato G., Carbini R., Murgia M., Simeoni G. Istat, Italian.
Metadata management and statistical business process at Statistics Estonia Work Session on Statistical Metadata (Geneva, Switzerland 8-10 May 2013) Kaja.
Overview of SDMX: Statistical Data and Metadata eXchange Technical and Content Standards for Statistical Data Ann McPhail, Division Chief Statistics Department,
SDMX and DDI Working Together Technical Workshop 5-7 June 2013
Marina Signore Head of Service “Audit for Quality Istat Assessing Quality through Auditing and Self-Assessment Signore M., Carbini R., D’Orazio M., Brancato.
Development of metadata in the National Statistical Institute of Spain Work Session on Statistical Metadata Genève, 6-8 May-2013 Ana Isabel Sánchez-Luengo.
« 8-11 July 2008 « Metadata Life Cycle « STATISTICS PORTUGAL.
CZECH STATISTICAL OFFICE Na padesátém 81, CZ Praha 10, Czech Republic 1 Subsystem QUALITY in Statistical Information System Czech.
Metadata management in National Statistical Institutes and researcher access: an example Zoltán Vereczkei Hungarian Central Statistical Office Methodology.
1 Integration of the Eurostat and ESS Metadata Systems A. Götzfried Head of Unit B6 Eurostat.
SDMX IT Tools Introduction
SDMX and Metadata SDMX Basics Course 12 April 2013 Daniel Suranyi Eurostat B5 Management of statistical data and metadata.
1 5a. SDMX and reference metadata exchanges Bogdan ZDRENTU Eurostat Unit B5: “Central data and metadata services” SDMX Basics course, October 2015.
Work Session on Statistical Metadata 2013 Session III: Metadata in the Statistical Business Process Better documenting statistical business processes:
MetaPlus Klas Blomqvist Statistics Sweden Research and Development – Central Methods
1 Quality reporting within the Eurostat and the ESS metadata systems August Götzfried and Håkan Linden Eurostat Unit B6: Reference databases and metadata.
The business process models and quality issues at the Hungarian Central Statistical Office (HCSO) Mr. Csaba Ábry, HCSO, Methodological Department Geneva,
Eurostat Sharing data validation services Item 5.1 of the agenda.
From Intrastat to SIMSTAT and ESS.VIP Programme ESTAT Walter Radermacher.
13 November, 2014 Seminar on Quality Reports QUALITY REPORTS EXPERIENCE OF STATISTICS LITHUANIA Nadiežda Alejeva Head, Price Statistics.
SDMX Basics course, March 2016 Eurostat SDMX Basics course, March Introducing the Roadmap Marco Pellegrino Eurostat Unit B5: “Data and.
Quality declarations Study visit from Ukraine 19. March 2015
The Eurostat Metadata Handler Götzfried Eurostat (Head of Unit B6)
Prepared by: Galya STATEVA, Chief expert
The ESS vision, ESSnets and SDMX
Quality assurance in official statistics
The evolution of the SDMX infrastructure and services
Item 6 - Introduction to ESS Metadata Handler
Seminar on ESA 2010 Metadata
The CVD Metadata Handler
Using the Checklist for SDMX Data Providers
Usage of National Reference Metadata Editor (NRME)
11. The future of SDMX Introducing the SDMX Roadmap 2020
The new metadata structure & Country Specific Notes
Time Use Survey data processing and dissemination 17 July 2014
ESS technical standards and tools for quality reporting
Interoperability issues in the implementation of SIMS
Quality assessment ESTP Training Course “Quality Management and survey Quality Measurement” Rome, 24 – 27 September 2013 Giorgia Simeoni Researcher Unit.
What is next? H. Linden Eurostat, Unit B5
ESS VIP ICT Project Task Force Meeting 5-6 March 2013.
National reference metadata and the National Reference Metadata Editor
SDMX : General introduction H. Linden, Eurostat, Unit B5
ESQRS implementation in the in Labour Force Survey
Working Group "Education and Training Statistics" April 2013
ESTP Advanced course on quality reporting
ESS.VIP Validation Item 5.1
SDMX Progress and implementation A. Götzfried, Unit B6
Quality Reporting in CBS
Legislative strategy for cross-cutting ESS legislation
The new quality strategy in the modernised Italian National Statistical Institute Giovanna Brancato Giorgia Simeoni, Antonia Boggia,
Quality reporting in the ESS - State of play and next steps
Metadata on quality of statistical information
M. Henrard, B5 N. Buysse and H. Linden, B6 Eurostat
2.7 Annex 3 – Quality reports
Work Session on Statistical Metadata (Geneva, Switzerland May 2013)
European Statistical System Metadata Handler ESS MH (Super) Providers
Joint UNECE/Eurostat/OECD
ESS technical standards and tools for quality reporting
ESS conceptual standards for quality reporting
Interoperability of metadata systems: Follow-up actions
GSBPM Giorgia Simeoni, Istat,
Presentation transcript:

Implementing ESS standards for reference metadata and quality reporting at Istat Work Session on Statistical Metadata Topic (i): Metadata standards and models Giorgia Simeoni, Istat Unit «Quality, audit and harmonisation» 6 May 2013

Implementing ESS standards for reference metadata and quality reporting at Istat Giorgia Simeoni – Geneva, 6 May 2013 Contents 1.Project background 2.SIDI/SIQual architecture and contents 3.ESS standards for reference metadata and quality reporting 4.Project objectives and outline 5.The quality reports subsystem design 2

Implementing ESS standards for reference metadata and quality reporting at Istat Giorgia Simeoni – Geneva, 6 May 2013 Project background ESS reference metadata and quality reporting conceptual harmonisation: -Euro-SDMX Metadata Structure (ESMS) -ESS Standard for Quality Reports Structure (ESQRS) National implementation in progresssupported by SDMX compliant IT tools (Metadata Handler) SIDI/SIQual - Istat official system for reference metadata and quality indicators documentation – includes a lot of information required from ESMS and ESQRS 3 Project: to enhance SIDI/SIQual in order to produce ESS standard metadata files and quality reports in compliance with SDMX technical standards

Implementing ESS standards for reference metadata and quality reporting at Istat Giorgia Simeoni – Geneva, 6 May 2013 Istat official information system for documenting quality and reference metadata of the statistical production processes SIDI «input» system, SIQual for consultation SIDI first implementation in 2001, later converted in a web- based architecture SIQual first release in 2005, English version released in 2008 SIDI/SIQual is the reference metadata component of the Unified System of Metadata currently under development at Istat SIDI/SIQual 4

Implementing ESS standards for reference metadata and quality reporting at Istat Giorgia Simeoni – Geneva, 6 May 2013 SIDI/SIQual architecture Quality indicators Reference metadata Staff Management ETL Quality indicators Reference metadata SIDI SIQual internet SIQual intranet National Statistical Programme Management metadata DARC (Administrative archive) Dissemination website IT Application Catalogue ARMIDA (Validated microdata) Input GUI Quality reporting Process quality report Product quality report Short method. note 5

Implementing ESS standards for reference metadata and quality reporting at Istat Giorgia Simeoni – Geneva, 6 May 2013 CONCEPTUAL METADATA Themes Units …. SIDI/SIQual contents 6 OPERATIONS Phases Operations Sub-operations GENERALISED SOFTWARE Phases Software QUALITY CONTROL ACTIONS Phase/Non sampling Errors Preventing Monitoring Evaluating IN-DEPTH DOCUMENTATION: Sampling design Index production methodology … STANDARD QUALITY INDICATORS Process oriented Product oriented DOCUMENTS REPOSITORY Regulations, Manuals Questionnaires Documents (field operations, methods, standards, …)

Implementing ESS standards for reference metadata and quality reporting at Istat Giorgia Simeoni – Geneva, 6 May 2013 ESS standards for reference metadata and quality reporting 7 Euro SDMX Metadata Structure ESMS Example

Implementing ESS standards for reference metadata and quality reporting at Istat Giorgia Simeoni – Geneva, 6 May 2013 ESS standards for reference metadata and quality reporting 8 ESS Standard for Quality Reports Structure

Implementing ESS standards for reference metadata and quality reporting at Istat Giorgia Simeoni – Geneva, 6 May 2013 Project: Enhancing SIDI/SIQual in order to be compliant with the ESS conceptual and technical standards for reference metadata files and quality reports. Frameworks: Istat multi-year innovation strategy Stat2015 Eurostat Grant co-funding “Implementing the SDMX Istat strategy” Organisation: Start: second half of December 2012 Duration: for 2 years Main phases: 1.The design phase. Main output expected: the document of requirements for the SIDI/SIQual enhancement (6 months devoted); 2.The software development, including requirement analysis, detailed design, realisation and test (1 year devoted) 3.The implementation process, the first metadata files and quality reports will be produced via the new subsystem 9 Project objectives and outline

Implementing ESS standards for reference metadata and quality reporting at Istat Giorgia Simeoni – Geneva, 6 May 2013 Main advantages: 10 Project objectives and outline Exploit the already available informationReduce reporting burden for survey managersAvoid inconsistencies in metadata and quality reportingImprove the metadata asset Enhance internal system to be compliant to international technical standards Facilitate next re-use Improve internal coordination, harmonisation and centralised monitoring

Implementing ESS standards for reference metadata and quality reporting at Istat Giorgia Simeoni – Geneva, 6 May The design phase: four steps to collect requirements The first step: mapping between ESMS and ESQRS and SIDI/SIQual contents -Based on standard ESS Guidelines -Exercise of compilation from SIDI/SIQual 11 Project objectives and outline Example for ESMS concept «Statistical Unit» ESMSSIDI

Implementing ESS standards for reference metadata and quality reporting at Istat Giorgia Simeoni – Geneva, 6 May The design phase The second step: analysis of NRME functionalities, available Metadata Structure Definitions, already filled in metadata files and quality reports 12 Project objectives and outline Main inputs obtained: -«Input» compliance with SDMX artifacts and concepts is needed -Functionalities to be implemented to support compilation (e.g: copy of a previous edition, re-use of single items, …) -…-…

Implementing ESS standards for reference metadata and quality reporting at Istat Giorgia Simeoni – Geneva, 6 May The design phase The second step: analysis of NRME functionalities, available Metadata Structure Definitions, already filled in metadata files and quality reports 13 Project objectives and outline Difficulties: two levels “Domain” customisation 1.At Metadata Structure Definition level: introduction of Domain specific concepts Example This case can be managed through a more generalised software implementation, that will also facilitate the software reuse and higher its flexibility for changing requirements

Implementing ESS standards for reference metadata and quality reporting at Istat Giorgia Simeoni – Geneva, 6 May The design phase The second step: analysis of NRME functionalities, available Metadata Structure Definitions, already filled in metadata files and quality reports 14 Project objectives and outline Difficulties: two levels “Domain” customisation 2.Within sub-concept level: introduction of different html tables in different domains Example The solution to this issue is still under evaluation, suggestions?

Implementing ESS standards for reference metadata and quality reporting at Istat Giorgia Simeoni – Geneva, 6 May The design phase The third step: involvement of stakeholders At national level Contacts with Eurostat The fourth step: drafting the requirements’ document 15 Project objectives and outline

Implementing ESS standards for reference metadata and quality reporting at Istat Giorgia Simeoni – Geneva, 6 May The software development: Design by Istat IT experts Realisation outsourced 3. The implementation process: Under definition a proposal for the governance to be then approved by the top management The production of metadata files and quality reports with the new subsystem should be centrally supported 16 Project objectives and outline

Implementing ESS standards for reference metadata and quality reporting at Istat Giorgia Simeoni – Geneva, 6 May 2013 Quality reporting subsystem building blocks 17 SIDI Reference Metadata & Quality indicators DB SIDI Metadata & quality indicators GUI Enhancement for ESMS/ESQRS contents not included (1) GUI Enhancement (1) Enhancement to be compliant to SDMX artifacts (3) GUI for metadata files compilation (4) Euro-SDMX registry SDMX Metadata set (5) Eurostat (NRME or EDAMIS) WS (8) SEP ETL Web Browser SIQual (8) GUI template management (7) Pulling out procedures (2) SDMX artifacts import functionalities (6) Quality reports (8)

Implementing ESS standards for reference metadata and quality reporting at Istat Giorgia Simeoni – Geneva, 6 May 2013 Thank you for your attention! Comments and suggestions are welcome 18