1. Implementing ESS standards for reference metadata and quality reporting at Istat Work Session on Statistical Metadata Topic (i): Metadata standards and models Giorgia Simeoni, Istat Unit «Quality, audit and harmonisation» simeoni@istat.it 6 May 2013

2. Implementing ESS standards for reference metadata and quality reporting at Istat Giorgia Simeoni – Geneva, 6 May 2013 Contents 1.Project background 2.SIDI/SIQual architecture and contents 3.ESS standards for reference metadata and quality reporting 4.Project objectives and outline 5.The quality reports subsystem design 2

3. Implementing ESS standards for reference metadata and quality reporting at Istat Giorgia Simeoni – Geneva, 6 May 2013 Project background ESS reference metadata and quality reporting conceptual harmonisation: -Euro-SDMX Metadata Structure (ESMS) -ESS Standard for Quality Reports Structure (ESQRS) National implementation in progresssupported by SDMX compliant IT tools (Metadata Handler) SIDI/SIQual - Istat official system for reference metadata and quality indicators documentation – includes a lot of information required from ESMS and ESQRS 3 Project: to enhance SIDI/SIQual in order to produce ESS standard metadata files and quality reports in compliance with SDMX technical standards

4. Implementing ESS standards for reference metadata and quality reporting at Istat Giorgia Simeoni – Geneva, 6 May 2013 Istat official information system for documenting quality and reference metadata of the statistical production processes SIDI «input» system, SIQual for consultation SIDI first implementation in 2001, later converted in a web- based architecture SIQual first release in 2005, English version released in 2008 SIDI/SIQual is the reference metadata component of the Unified System of Metadata currently under development at Istat SIDI/SIQual 4

5. Implementing ESS standards for reference metadata and quality reporting at Istat Giorgia Simeoni – Geneva, 6 May 2013 SIDI/SIQual architecture Quality indicators Reference metadata Staff Management ETL Quality indicators Reference metadata SIDI SIQual internet SIQual intranet National Statistical Programme Management metadata DARC (Administrative archive) Dissemination website IT Application Catalogue ARMIDA (Validated microdata) Input GUI Quality reporting Process quality report Product quality report Short method. note 5

6. Implementing ESS standards for reference metadata and quality reporting at Istat Giorgia Simeoni – Geneva, 6 May 2013 CONCEPTUAL METADATA Themes Units …. SIDI/SIQual contents 6 OPERATIONS Phases Operations Sub-operations GENERALISED SOFTWARE Phases Software QUALITY CONTROL ACTIONS Phase/Non sampling Errors Preventing Monitoring Evaluating IN-DEPTH DOCUMENTATION: Sampling design Index production methodology … STANDARD QUALITY INDICATORS Process oriented Product oriented DOCUMENTS REPOSITORY Regulations, Manuals Questionnaires Documents (field operations, methods, standards, …)

7. Implementing ESS standards for reference metadata and quality reporting at Istat Giorgia Simeoni – Geneva, 6 May 2013 ESS standards for reference metadata and quality reporting 7 Euro SDMX Metadata Structure ESMS Example

8. Implementing ESS standards for reference metadata and quality reporting at Istat Giorgia Simeoni – Geneva, 6 May 2013 ESS standards for reference metadata and quality reporting 8 ESS Standard for Quality Reports Structure

9. Implementing ESS standards for reference metadata and quality reporting at Istat Giorgia Simeoni – Geneva, 6 May 2013 Project: Enhancing SIDI/SIQual in order to be compliant with the ESS conceptual and technical standards for reference metadata files and quality reports. Frameworks: Istat multi-year innovation strategy Stat2015 Eurostat Grant co-funding “Implementing the SDMX Istat strategy” Organisation: Start: second half of December 2012 Duration: for 2 years Main phases: 1.The design phase. Main output expected: the document of requirements for the SIDI/SIQual enhancement (6 months devoted); 2.The software development, including requirement analysis, detailed design, realisation and test (1 year devoted) 3.The implementation process, the first metadata files and quality reports will be produced via the new subsystem 9 Project objectives and outline

10. Implementing ESS standards for reference metadata and quality reporting at Istat Giorgia Simeoni – Geneva, 6 May 2013 Main advantages: 10 Project objectives and outline Exploit the already available informationReduce reporting burden for survey managersAvoid inconsistencies in metadata and quality reportingImprove the metadata asset Enhance internal system to be compliant to international technical standards Facilitate next re-use Improve internal coordination, harmonisation and centralised monitoring

11. Implementing ESS standards for reference metadata and quality reporting at Istat Giorgia Simeoni – Geneva, 6 May 2013 1.The design phase: four steps to collect requirements The first step: mapping between ESMS and ESQRS and SIDI/SIQual contents -Based on standard ESS Guidelines -Exercise of compilation from SIDI/SIQual 11 Project objectives and outline Example for ESMS concept «Statistical Unit» ESMSSIDI

12. Implementing ESS standards for reference metadata and quality reporting at Istat Giorgia Simeoni – Geneva, 6 May 2013 1.The design phase The second step: analysis of NRME functionalities, available Metadata Structure Definitions, already filled in metadata files and quality reports 12 Project objectives and outline Main inputs obtained: -«Input» compliance with SDMX artifacts and concepts is needed -Functionalities to be implemented to support compilation (e.g: copy of a previous edition, re-use of single items, …) -…-…

13. Implementing ESS standards for reference metadata and quality reporting at Istat Giorgia Simeoni – Geneva, 6 May 2013 1.The design phase The second step: analysis of NRME functionalities, available Metadata Structure Definitions, already filled in metadata files and quality reports 13 Project objectives and outline Difficulties: two levels “Domain” customisation 1.At Metadata Structure Definition level: introduction of Domain specific concepts Example This case can be managed through a more generalised software implementation, that will also facilitate the software reuse and higher its flexibility for changing requirements

14. Implementing ESS standards for reference metadata and quality reporting at Istat Giorgia Simeoni – Geneva, 6 May 2013 1.The design phase The second step: analysis of NRME functionalities, available Metadata Structure Definitions, already filled in metadata files and quality reports 14 Project objectives and outline Difficulties: two levels “Domain” customisation 2.Within sub-concept level: introduction of different html tables in different domains Example The solution to this issue is still under evaluation, suggestions?

15. Implementing ESS standards for reference metadata and quality reporting at Istat Giorgia Simeoni – Geneva, 6 May 2013 1.The design phase The third step: involvement of stakeholders At national level Contacts with Eurostat The fourth step: drafting the requirements’ document 15 Project objectives and outline

16. Implementing ESS standards for reference metadata and quality reporting at Istat Giorgia Simeoni – Geneva, 6 May 2013 2. The software development: Design by Istat IT experts Realisation outsourced 3. The implementation process: Under definition a proposal for the governance to be then approved by the top management The production of metadata files and quality reports with the new subsystem should be centrally supported 16 Project objectives and outline

17. Implementing ESS standards for reference metadata and quality reporting at Istat Giorgia Simeoni – Geneva, 6 May 2013 Quality reporting subsystem building blocks 17 SIDI Reference Metadata & Quality indicators DB SIDI Metadata & quality indicators GUI Enhancement for ESMS/ESQRS contents not included (1) GUI Enhancement (1) Enhancement to be compliant to SDMX artifacts (3) GUI for metadata files compilation (4) Euro-SDMX registry SDMX Metadata set (5) Eurostat (NRME or EDAMIS) WS (8) SEP ETL Web Browser SIQual (8) GUI template management (7) Pulling out procedures (2) SDMX artifacts import functionalities (6) Quality reports (8)

18. Implementing ESS standards for reference metadata and quality reporting at Istat Giorgia Simeoni – Geneva, 6 May 2013 Thank you for your attention! Comments and suggestions are welcome simeoni@istat.it 18