How to implement an SDMX architecture for dissemination and reporting Alessio Cardacino ISTAT alcardac@istat.it SDMX-RI User Group – Luxembourg 24-25 september 2013

The Istat approach on SDMX ESSnets SDMX-RI SDMX Istat Strategy collaborative sharing of knowledge and software beyond the data exchange getting experience from ESS pilot exercises SODI Demography EGR Census Hub SDMX for standardization and industrialization (Stat2015) Istat has been working on SDMX since 2004. At the beginning, in order to get experience, Istat has participated to some pilot projects launched by Eurostat within the European Statistical System: SODI (SDMX Open Data Interchange) – extended the STS database and developed a SDMX web service; Demography Rapid Questionnaire – developed the SDMX Istat Framework as a set of build blocks to be used to disseminate/providing data in SDMX format; EuroGroup Register – developed an extension of the SDMX Istat Framework, that was used by other NSIs during the pilot phase; Census Hub – installed a pilot architecture based on the SDMX-RI. In this context Istat participated from the very first beginning to the design of the SDMX-RI. From 2009 to 2012, Istat has participated to ESSnets on SDMX phase 1 and phase 2, contributing to the development of software and guidelines shared within ESS members. From 2010, with the starting of the multiannual program Stat2015, SDMX has become one of the strategic standards that would have facilitated the harmonization of the content and the industrialization of the process. In this context it has been analyzed the way of moving beyond the simple use of SDMX as a standard for more efficient processes for exchange data among international organizations and their members, and to exploit all its potentialities in handling and disseminating data and metadata.

SDMX-RI Adapting Using Reusing The SDMX-RI in Istat Dissemination: ISTAT’s SEP ------------------- Reporting Census Hub OECD STES ICT VIP ESA2010 (NA) ……. WS Enhancement Tight coupling integration with .STAT SDMX-RI Excel plugin Windows client RSS feeder Structural metadata gui Smartphone and tablets RDF,DSPL adapters When the SDMX-RI has been build up Istat decided to use it in two different way: using it and re-using some part of the modules to implement new software all around the SDMX-RI for internal purposes Reusing

The overall architecture

Financing the implementation: Eurostat – Istat grant Total estimated cost: 464.983,87 € Duration: 24 months (Dec 2012 – Dec 2014) 24 deliverables split among 4 work packages: WP1 – Coordination WP2 – Enhancement of the SDMX-RI, and its integration into the Istat information system WP3 – Enhancement of the Istat Metadata Management System WP4 – Contribution to the development of SDMX standard and implementation of capacity building actions 2 Directorates, 3 Services and 7 Units involved (19 internal people involved for a total of 778 man/days) > 1000 man/days subcontracting

Streamlining the workflow Data Reporting Metadata & mapping repository OECD EUROSTAT DSDs SDMX SEP Mapping Assistant DSW DSDs Data Dissemination I.STAT 6

Structural metadata Web GUI

Excel plug-in

Excel plug-in

Excel plug-in

SDMX Structural Metadata web GUI ver 1.0 State of the art: already available Excel plugin ver 1.0 Windows client ver 1.0 SDMX Structural Metadata web GUI ver 1.0 Software for the tight coupling integration between SDMX-RI (intermediate version) and .Stat: Mapping Assistant ver 3.0.1 Web Service ver 2.4.3 11

RSS feeder (for SDMX-RI and .Stat) ver. 2.0 State of the art: in progress RSS feeder (for SDMX-RI and .Stat) ver. 2.0 Enhanced version of the SDMX-RI web service (based on the intermediate version of the SDMX-RI) Tight coupling integration between SDMX-RI (ultimate version, based on the sdmx Common APIs) and .STAT Excel Plugin ver 2.0 12

Tools for the generation of open data formats as RDF and Google DSPL State of the art: in progress Tools for the generation of open data formats as RDF and Google DSPL App client for tablets and smartphones 13

Thank you for the attention 14