1. SODI Live Demonstration
IT Directors Group
23-24 October 2006
Agenda Item 1.4
SODI Live Demonstration 2

2. Purpose of the SODI demonstration
Demonstration of a real data exchange scenario
Pull transmission method
Recuperate SDMX-ML data from NSI’s environment
Validation (code list and syntax) on data reception
Publication of data
…using widely used standards and related technologies
SDMX version 2.0 standard for query messages & datasets
Web Feeds (ATOM 1.0 and RSS 2.0)
W3C standards (XML Schema, XSLT)
Web Services Interoperability Organization

3. SODI Major Developments
Web Feeds
Practical Guidelines for the Implementation of web feeds formats (ATOM 1.0, RSS 2.0)
SODI processing environment architecture
Business process (BPMN, BPDs), Logical & Deployment view (UML)
Converter module
SODI principal components
NSI Web Service
SDMX Pull Requestor
SDMX Web Service
SDMX Publisher
SDMX pull requestor
Reading periodically the web feeds published by the NSI system
Check the web feed for available data
Check if there is a provisioning agreement for the provided dataflow with the NSI and retrieve it from the SDMX Registry.
Formulate SDMX-ML request (SDMX dataset query) or retrieve it from the location where the feed indicates (URL).
Send the SDMX-ML request to the NSI web service
Receiving the SDMX-ML dataset
Dispatching the SDMX-ML dataset to the SDMX web service
Scenarios implemented in the practical Guidelines:
The feeds presented here, implement two scenarios:
Scenario 1: Data providers publish data on a dissemination data warehouse, and provide a web service capable of getting an SDMX query and responding with an SDMX dataset. When new data is loaded or updated, a notification containing a description of the new or updated data is automatically formulated in terms of statistical concepts using the SDMX query format. Note: We opted to use the SDMX-ML Query format in order to avoid inventing new XML syntax for describing the contents of the data.
Scenario 2: Data providers prepare new available data in the form of SDMX files, which are maintained on a specific URL (such as an http or ftp server). When new data are prepared, a notification containing a description of the new or updated data is automatically formulated. In this case, even though there is no need for an SDMX query, some additional metadata are needed in the notification message, i.e. in the feed, in order for the pull requestor to be able to identify to which dataflow the dataset belongs to, who is the data provider, as well as the which time point or period the data are covering. Thus, we propose to use the SDMX query format to identify this kind of metadata.

4. SODI Live Demonstration Preview
NSI (ISTAT)
WEB FEED
Web feeds
notifications
Pull
requestor
Query Registry
SDMX
Registry WS
ISTAT WS
Provisional
Agreement
SDMX
query
SDMX-ML
Dataset
SDMX-ML
Dataset
SDMX
Web
Service
SDMX
Publisher
Validated SDMX-ML
Dataset
SODI Processing Environment

5. SODI
Live Demonstration