Eurostat Unit B3 – IT and standards for data and metadata exchange

Slides:



Advertisements
Similar presentations
Recent SDMX IT developments at the OECD SDMX Expert Group Meeting September 2012 OECD, Paris By Jens Dossé and Jonathan Challener.
Advertisements

1 SDMX Reference Infrastructure (SDMX-RI) Work in progress, status and plans Bengt-Åke Lindblad, Adam Wroński Eurostat Eurostat Unit B3 – IT and standards.
National Case Study. The first EU Member State, which conducted its population count in 2011 (1-28 February). For the first time - eCensus via Internet.
Sdmx web services Strutural data
SDMX at the IMF Progress Report Expert Group on Statistical Data and Metadata Exchange (SDMX 2007), Geneva, May 8-11, 2007 Patrick Hinderdael, Economic.
Grid Chemistry System Architecture Overview Akylbek Zhumabayev.
Francesco Rizzo (ISTAT - Italy) SDMX ISTAT FRAMEWORK GENEVE May 2007 OECD SDMX Expert Group.
1 MSCS 237 Overview of web technologies (A specific type of distributed systems)
1 Meeting on the Management of Statistical Information Systems (MSIS 2010) SDMX architecture for data sharing and interoperability Francesco Rizzo, ISTAT,
1 Exchange of data between OECD and Statistics Norway Marianne Vik Dysterud, Statistics Norway Meeting of the OECD Expert Group on Statistical.
Eurostat B.4 Enhancements Implemented SDMX RI User Group Luxembourg, September 2013.
Eurostat B.3 Alignment to SDMX 2.1 SDMX RI User Group Luxembourg, September 2013.
Eurostat 6. SDMX: A non-technical overview of the SDMX architecture and IT tools 1 Raynald Palmieri Eurostat Unit B5: “Central data and metadata services”
SDMX IT Tools SDMX Reference Infrastructure
Eurostat SDMX Reference Infrastructure: Tools demonstration November 2015 Eurostat Unit B3 – IT and standards for data and metadata exchange Jean-Francois.
Eurostat November 2015 Eurostat Unit B3 – IT and standards for data and metadata exchange SDMX IT Tools Test Client Jean-Francois LEBLANC Christian SEBASTIAN.
SDMX IT Tools SDMX use in practice in NA
Eurostat November 2015 Eurostat Unit B3 – IT and standards for data and metadata exchange SDMX IT Tools SDMX Converter Jean-Francois LEBLANC Christian.
Copyright 2007, Information Builders. Slide 1 iWay Web Services and WebFOCUS Consumption Michael Florkowski Information Builders.
Eurostat 6. SDMX: A non-technical overview of the SDMX architecture and IT tools 1 Raynald Palmieri Eurostat Unit B5: “Central data and metadata services”
Eurostat Mapping Assistant May 2016 Eurostat, Unit B3 – IT solutions for statistical production Jean-Francois LEBLANC Christian SEBASTIAN 1.
Eurostat May 2016 Eurostat, Unit B3 – IT solutions for statistical production Test Client Jean-Francois LEBLANC Christian SEBASTIAN.
IAEA International Atomic Energy Agency Implementing SDMX for Energy Domain: From Discussion to Actual Implementation and Testing Andrii Gritsevskyi Oslo.
The Holmes Platform and Applications
Java Web Services Orca Knowledge Center – Web Service key concepts.
B.6 Roadmap 2013 – 2014 SDMX RI User Group Luxembourg, September 2013.
Prepared by: Galya STATEVA, Chief expert
Chris Menegay Sr. Consultant TECHSYS Business Solutions
Progress Update MSIS: Bratislava, April 2005
SDMX Reference Infrastructure
ESS VIP ICT Project Mapping Assistant in use (ICT domain)
SDMX Reference Infrastructure
SDMX Reference Infrastructure Development strategy – work in progress
SDMX Converter Raynald PALMIERI June 2015
SDMX Reference Infrastructure Introduction
SISAI STATISTICAL INFORMATION SYSTEMS ARCHITECTURE AND INTEGRATION
Lecture 1: Multi-tier Architecture Overview
Jean-Francois LEBLANC Christian SEBASTIAN
2. An overview of SDMX (What is SDMX? Part I)
ESSnet on SDMX phase II June 7-8, Luxembourg.
SDMX Tools Architecture
SDMX Reference Infrastructure
Statistical Data and Metadata eXchange (SDMX)
SDMX Reference Infrastructure
Workshop on ESA 2010 transmission programme – What and how?
SDMX in the S-DWH Layered Architecture
SDMX Tools Overview and architecture
SDMX IT Tools SDMX Converter
ESS VIP ICT Project Task Force Meeting 5-6 March 2013.
Generate SDMX files.
SDMX IT Tools Data Structure Wizard
SODI Live Demonstration
SDMX IT Tools SDMX use in practice in NA
Eurostat Unit B3 – IT and standards for data and metadata exchange
2nd SISAI meeting Luxembourg, June 2012
Jean-Francois LEBLANC Christian SEBASTIAN
Eurostat Unit B3 – IT and standards for data and metadata exchange
Jean-Francois LEBLANC Christian SEBASTIAN
Eurostat Unit B3 – IT and standards for data and metadata exchange
Eurostat Unit B3 – IT and standards for data and metadata exchange
5. SDMX: General input requirements
Presentation plan Accessing and Retrieving SDMX data
Marco Pellegrino, Bengt-Åke Lindblad
7. Introduction to the main SDMX objects for metadata exchange
Standardizing and industrializing a business process – the dissemination use case Alessio Cardacino - ESTP Course “Information standards.
SDMX IT Tools SDMX Registry
SDMX IT building blocks
A non-statistical data exchange scenario
Jean-Francois LEBLANC Christian SEBASTIAN
Presentation transcript:

Eurostat Unit B3 – IT and standards for data and metadata exchange SDMX for IT Experts NSI Web Service Jorge Nunes Raynald Palmieri 18-20 February 2014 Eurostat Unit B3 – IT and standards for data and metadata exchange

Table of Contents NSI Web Service NSI Web Service overview. The web service provider.

SDMX-RI Components MSDB Store DDB Firewall Firewall Firewall DB Server       DB Server MSDB Store Workstation App Server Mapping Assistant NSI-WS External Client Test Client NSI-Client DB Server DDB Internal Network Secure DMZ DMZ Internet

NSI Web Service Input Output SOAP (SDMX Query): Soap message including the SDMX Query inside. Output SOAP (SDMX-ML Dataset): Soap message including the SDMX-ML Dataset. Input SOAP (SDMX Query): Soap message including the SDMX Query inside. Output SOAP (SDMX-ML Dataset): Soap message including the SDMX-ML Dataset.

SDMX-RI web services overview web service provider query parser data retriever structure retriever data generator Dissemination Database Mapping Store DB 5

Versions of NSI Web Service Java version. Requires JEE servlet container: Tomcat, Weblogic. .NET version Requires Microsoft IIS. In case the developer does not wish to change or even observe the source code of the “Web Service Provider” it can be used as service reference. The "Web Service Provider" could be located anywhere as long as the caller has http access to it. Web Service Provider module is a building block that can be re-used within any dissemination environment requiring its functionality. In case it is re-used as a package, SDMX internal model has to be attached to the API since the output created is on SDMX Query instance with the structure of the internal SDMX Model. *The "Web Service Provider" component is released as open-source software (OSS), thus it can be either re-used as is (as a packaged) or by using its source code (in case modifications are needed).

Web Service Solution Mapping must be already configured STEP 1 Load SDMX Structures (CategoryScheme, DataFlow, DSD) STEP 2 Map local database schema (Dataset) STEP 3 Map local Concepts to SDMX ones (Mapping Set) STEP 4 Map local Codes to SDMX ones (Transcoding) 7

NSI Web Service Example hands-on following the instructions of the documentation provided. 8

SDMX-RI Web Services Evaluation 1. Which of the modules has the capacity to connect to the data bases? The Data Retriever The Query Parser SDMX Data Model SDMX Data Generator 2. Can this modules work independent each other? No, we need the four modules and the SDMX Model as it is to make a complete solution. Yes, we can take each module independent and use it for different projects but not changing the source code itself. Use one of the modules implies to use the others because the output and input parameters are related between the different modules. Any of the answers is correct. 3. Where is the XML data file (dataset) created? Query Parser module. Data Generator module. Data Retriever module. The user has to create a client application to convert any output of the solution to a XML data file. 4. If any of the source codes of the modules is changed and we want to create a complete solution with all of them… We can create a SDMX Internal Model to use it as parameter between the modules. The SDMX Intermal model already created must be used. We don’t need to use nothing else than the four modules, and all the other parameters are normal .NET objects.