5. SDMX: General input requirements

Slides:



Advertisements
Similar presentations
Survey Data Management and Combined use of DDI and SDMX DDI and SDMX use case Labor Force Statistics.
Advertisements

13-Jul-07 Implementation of SDMX for data and metadata exchange Balance of Payments Working Group 2-3 April 2012 Daniel Suranyi Eurostat B5 Management.
1 Eurostat Unit B5 – Statistical Information Technologies SDMX Basics – October 2011 SDMX Basics Core Elements Information Model Data Structure Definition.
1 Exchange of data between OECD and Statistics Norway Marianne Vik Dysterud, Statistics Norway Meeting of the OECD Expert Group on Statistical.
Eurostat 1 7a. Practical use case 1: Pesticides Use Project Blanaru Cristina Eurostat Unit B5: “Central data and metadata services” SDMX Basics course,
Model and Representations
Eurostat 6. SDMX: A non-technical overview of the SDMX architecture and IT tools 1 Raynald Palmieri Eurostat Unit B5: “Central data and metadata services”
Eurostat 4. SDMX: Main objects for data exchange 1 Raynald Palmieri Eurostat Unit B5: “Central data and metadata services” SDMX Basics course, October.
SDMX IT Tools Introduction
2.An overview of SDMX (What is SDMX? Part I) 1 Edward Cook Eurostat Unit B5: “Central data and metadata services” SDMX Basics course, October 2015.
IS4STAT Vittorio Viaggi Eurostat
SDMX IT Tools SDMX use in practice in NA
Implementation of SDMX for Balance of Payments Balance of Payments Working Group 9-10 April 2013 BP Daniel Suranyi Eurostat B5 Management of statistical.
Eurostat November 2015 Eurostat Unit B3 – IT and standards for data and metadata exchange SDMX IT Tools SDMX Converter Jean-Francois LEBLANC Christian.
Eurostat November 2015 Eurostat Unit B3 – IT and standards for data and metadata exchange Jean-Francois LEBLANC Christian SEBASTIAN SDMX IT Tools SDMX.
Eurostat 6. SDMX: A non-technical overview of the SDMX architecture and IT tools 1 Raynald Palmieri Eurostat Unit B5: “Central data and metadata services”
IAEA International Atomic Energy Agency Implementing SDMX for Energy Domain: From Discussion to Actual Implementation and Testing Andrii Gritsevskyi Oslo.
The evolution of the SDMX infrastructure and services
4. SDMX: Main objects for data exchange
Progress Update MSIS: Bratislava, April 2005
Interoperable data formats: SDMX
SDMX Opportunities MED Meeting 14 May 2013 Daniel Suranyi Eurostat B5
Practical use case of SDMX (1): Short-term Statistics (STS)
SDMX Converter Raynald PALMIERI June 2015
SDMX: A brief introduction
11. The future of SDMX Introducing the SDMX Roadmap 2020
SDMX Reference Infrastructure Introduction
SDMX Introduction and practical exercises
Disseminating statistics: Internet and Publications course
Jean-Francois LEBLANC Christian SEBASTIAN
2. An overview of SDMX (What is SDMX? Part I)
Eurostat – Units E2, B5 Cristina BLANARU
2. An overview of SDMX (What is SDMX? Part I)
ESS technical standards and tools for quality reporting
SDMX Tools Architecture
Workshop on ESA 2010 transmission programme – What and how?
Task Force on Annual Financial Accounts
SDMX implementation at Eurostat and in the Member States
SDMX in the S-DWH Layered Architecture
SDMX Tools Overview and architecture
Statistical Information Technology
SDMX IT Tools SDMX Converter
SDMX as basis for water data reporting
Validation services developed in the ESS
ESS VIP ICT Project Task Force Meeting 5-6 March 2013.
Generate SDMX files.
SDMX IT Tools Data Structure Wizard
SODI Live Demonstration
SDMX IT Tools SDMX use in practice in NA
SDMX Progress and implementation A. Götzfried, Unit B6
Item 7.3 (b) SDMX for UOE data collection
9. Practical use case 3: Pesticides Use Project
M. Henrard, B5 N. Buysse and H. Linden, B6 Eurostat
13. Knowing more about SDMX
Presentation of Project Joint meeting of the ESS.VIP.BUS ICT Project
European Statistical System Metadata Handler ESS MH (Super) Providers
Eurostat Unit B3 – IT and standards for data and metadata exchange
Eurostat Unit B3 – IT and standards for data and metadata exchange
Eurostat Unit B3 – IT and standards for data and metadata exchange
ESS technical standards and tools for quality reporting
Eurostat Unit B3 – IT and standards for data and metadata exchange
Presentation plan Accessing and Retrieving SDMX data
7. Introduction to the main SDMX objects for metadata exchange
Developing SDMX artefacts for data exchange, sharing and dissemination
SDMX: Frequently Asked Questions
GESMES and SDMX-ML - Practical issues
Knowing more about SDMX
Presentation transcript:

5. SDMX: General input requirements Raynald Palmieri Eurostat Unit B5: “Central data and metadata services” SDMX Basics course, 1-2 March 2017

Note The scope of this presentation is to give general information on SDMX. It lists the main questions received during the implementation of SDMX exchanges between NSIs and Eurostat.

Questions (1): How to start sending data in SDMX format? Where to find SDMX objects? Format versus version? Use of SDMX 2.0 or 2.1? Version of the Converter to be used?

Questions (2): CSV header versus SDMX header? Use of constraints? Use of the Converter or the SDMX-RI? What to do if my question is not in the list?

How to start sending data in SDMX format?

How to start sending data in SDMX format? When a request comes from Eurostat, the Production Unit sends the guidelines describing the data exchange. All information needed to create data in SDMX format should be included in this document. Use the appropriate SDMX tools according to the data system in the NSI and taking into account the complexity of the domain

Where to find SDMX objects?

Where to find SDMX objects? The information concerning the name, the version and the location of SDMX objects to be used for the data exchange should be included in the guidelines sent by the Production Unit in Eurostat Usually, these SDMX objects can be downloaded from a SDMX registry.

Format versus version?

Format versus version? Use "Format" for SDMX 2.0 or 2.1 Ex: download a DSD in SDMX format 2.0 Use "Version" for SDMX object numbers Ex: DSD named STSALL version 2.1 It is possible to download the DSD STSALL version 2.1 in format SDMX 2.0

Use of SDMX 2.0 or 2.1?

Use of SDMX 2.0 or 2.1? The use of the format SDMX 2.0 or 2.1 for SDMX objects should be transparent Concerning the format used to send data, this information has to be included in the guidelines sent by the Production Unit in Eurostat; the main format used in reception in Eurostat is SDMX 2.0 COMPACT

Version of the Converter to be used?

Version of the Converter to be used? The latest version of the tools can be downloaded from the SDMX Infospace Website No need to upgrade an existing version of the tool when a new one is delivered (except if a problem is detected)

CSV header versus XML header?

CSV header versus SDMX header? The CSV header corresponds to the name of the columns in a CSV file The SDMX header is the description of a data file in XML format For a conversion from CSV to SDMX format, both are needed

Use of constraints?

Use of constraints? The constraints are used for validation purpose. They correspond to a subset of codes allowed in a data exchange. If needed for a data exchange, they are included in dataflows listed in the guidelines sent by the Production Unit in Eurostat.

Use of the Converter or the SDMX-RI?

Use of the Converter or the SDMX-RI? It depends on the complexity of the data exchange NSI could choose the better solution depending on their system (except special requirements from Eurostat) The Converter can be used as an intermediate step because it is faster to configure.

What to do if my question is not in this presentation?

What to do if my question is not in the list? Do not hesitate to send any further question to : ESTAT-SUPPORT-SDMX@ec.europa.eu