Presentation is loading. Please wait.

Presentation is loading. Please wait.

Implementation of SDMX for Balance of Payments Balance of Payments Working Group 9-10 April 2013 BP-13-11 Daniel Suranyi Eurostat B5 Management of statistical.

Published byJack Tate Modified over 9 years ago

Similar presentations

Presentation on theme: "Implementation of SDMX for Balance of Payments Balance of Payments Working Group 9-10 April 2013 BP-13-11 Daniel Suranyi Eurostat B5 Management of statistical."— Presentation transcript:

1 Implementation of SDMX for Balance of Payments Balance of Payments Working Group 9-10 April 2013 BP-13-11 Daniel Suranyi Eurostat B5 Management of statistical data and metadata

2 09/10-Apr-2013 #2 Recap: Implementation Process Terminology: GESMES  SDMX Where to find the BOP DSD? How do the SDMX Data Flows work? What can data providers do? Questions

3 09/10-Apr-2013 #3 Eurostat SDMX Implementation Process 3

4 09/10-Apr-2013 #4 Recap: Implementation Process Terminology: GESMES  SDMX Where to find the BOP DSD? How do the SDMX Data Flows work? What can data providers do? Questions

5 Transition from GESMES to SDMX GESMES Key Family Dataset Identifier Flat text (EDI) (one line per observation) Data only SDMX Data Structure Definition Data Flow XML tree (Dataset  Series  Observation) Tags include metadata

6 Dataset Identifier  Data Flow Preferred SDMX-ML format: 2.0 compact Examples GESMESSDMX-ML

7 09/10-Apr-2013 #7 Recap: Implementation Process Terminology: GESMES  SDMX Where to find the BOP DSD? How do the SDMX Data Flows work? What can data providers do? Questions

8 09/10-Apr-2013 #8 Recap: Messages from last year Central management of structures and code lists  SDMX Registry Notification on changes possible Web service interaction possible Downloading structures and code lists from registry Opening pull mode for data to international organisations

9 09/10-Apr-2013 #9 Where to find the BOP DSD Today: IMF Sandbox Registry http://imfsandbox.sdmxregistry.org/FusionRegistry/ Visual: Structures  Agency IMF  Data Structure Defintions Machine: Web Service  Structure Query Finally: SDMX Global Registry Important: For Eurostat: SDMX Version 2.0 !

10 09/10-Apr-2013 #10 Recap: Implementation Process Terminology: GESMES  SDMX Where to find the BOP DSD? How do the SDMX Data Flows work? What can data providers do? Questions

11 09/10-Apr-2013 #11 BOP Implementation Model Constraints Data Flows Data Structure BOP BPM6BOP BOP Constraint IIP IIP Constraint ITS ITS Constraint …

12 09/10-Apr-2013 #12 Data Validation Process  Before/During Transmission (“First Level”) - Performed in Member States (EDAMIS) - Format Check (SDMX-ML) - Code Check (SDMX DSD)  After Transmission ( “Second Level”) - Performed in Eurostat (EDIT Validation) - Data flow constraints - Detailed value check - …

13 09/10-Apr-2013 #13 Eurostat EDIT Integration Exposes full API as Web Services Integrated with EDAMIS  detect incoming files and process them in unattended mode  publish validation results to the Feedback Channel Integrated with the SDMX Registry  fetch DSDs into EDIT structures  load codelists from the Registry

14 09/10-Apr-2013 #14 Recap: Implementation Process Terminology: GESMES  SDMX Where to find the BOP DSD? How do the SDMX Data Flows work? What can data providers do? Questions

15 09/10-Apr-2013 #15 SDMX Implementation in Member States 15 Tools offeredAction Web Forms (only selected domains) No costs for organisation Manual work for senders (type, copy/paste) SDMX Converter (sender’s PC) Installation on sender’s PC Manual work for senders (convert) SDMX Converter (batch mode) Installation on server SDMX Reference Infrastructure Installation on server Mapping of database to DSDs Own SDMX Implementation Local development in organisations

16 09/10-Apr-2013 #16 SDMX Implementation in Member States 16  Example SDMX Converter 1.Generate local data file 2.Take DSD and data file 3.Produce SDMX-ML  All steps each time  Example SDMX-RI (installed in ~20 NSIs for Census Project) 1.Take DSD 2.Link to database 3.Produce SDMX-ML  Step 1 & 2 only once  Only step 3 each time

17 09/10-Apr-2013 #17 What is the Reference Infrastructure? Set of pick and choose building blocks To expose data from a data warehouse to SDMX On-the-fly mapping and transcoding to DSDs Open source packages in Java and.NET

18 09/10-Apr-2013 #18 SDMX-RI Workflow Data ProviderData Collector Non-SDMX local database SDMX data set SDMX Registry DSD SDMX-RI Mapping Assistant

19 09/10-Apr-2013 #19 Support for data providers SDMX Reference Infrastructure Installed in ~20 countries (NSIs) for Census Hub Can be extended to other domains 1st contact point - Local Transmission Coordinators In National Statistical Institutes Experience with EDAMIS and SDMX 2nd contact point - Eurostat support teams

20 09/10-Apr-2013 #20 Questions? 20 Support Teams SDMX: ESTAT-Support-SDMX@ec.europa.euESTAT-Support-SDMX@ec.europa.eu Valdiation: ESTAT-Validation@ec.europa.euESTAT-Validation@ec.europa.eu SDMX Website http://www.sdmx.org Eurostat SDMX Info Space https://webgate.ec.europa.eu/fpfis/mwikis/sdmx Eurostat EDIT https://circabc.europa.eu/webdav/CircaBC/ESTAT/EDITT/Information/index.html

Download ppt "Implementation of SDMX for Balance of Payments Balance of Payments Working Group 9-10 April 2013 BP-13-11 Daniel Suranyi Eurostat B5 Management of statistical."

Similar presentations

Eurostat Progress report SDMX-NA ESTAT, Unit C.2.

Eurostat Progress report SDMX-NA ESTAT, Unit C.2.
Introduction to SDMX Seminar Eurostat/ECLAC 02 October 2012 August Götzfried Head of Unit, Eurostat B5 Management of statistical data and metadata.

Introduction to SDMX Seminar Eurostat/ECLAC 02 October 2012 August Götzfried Head of Unit, Eurostat B5 Management of statistical data and metadata.
Slide 1 Eurostat Directorate B – Statistical methods and tools; dissemination Towards implementation of SDMX – 9/11 January 2007 SDMX Open Data Interchange.

Slide 1 Eurostat Directorate B – Statistical methods and tools; dissemination Towards implementation of SDMX – 9/11 January 2007 SDMX Open Data Interchange.
Agenda Item 3.3 SDMX reference architecture for NSIs Francesco Rizzo 24 th Meeting of the STNE Working Group “Statistics, Telematic Network & EDI” 16-17.

Agenda Item 3.3 SDMX reference architecture for NSIs Francesco Rizzo 24 th Meeting of the STNE Working Group “Statistics, Telematic Network & EDI”
Eurostat Unit B3 – Statistical Information Technologies Data transmission tools and services 15/05/2008 1 eDAMIS The standard solution for transmitting.

Eurostat Unit B3 – Statistical Information Technologies Data transmission tools and services 15/05/ eDAMIS The standard solution for transmitting.
Global SDMX Implementation Experience from on-going projects Daniel Suranyi, Eurostat Project Officer for SDMX implementation SDMX Expert Group, 13-14.

Global SDMX Implementation Experience from on-going projects Daniel Suranyi, Eurostat Project Officer for SDMX implementation SDMX Expert Group,
CountryData SDMX for Development Indicators Metadata in DevInfo: Creation, Mapping and Registration.

CountryData SDMX for Development Indicators Metadata in DevInfo: Creation, Mapping and Registration.
Overview of SDMX: Statistical Data and Metadata eXchange Technical and Content Standards for Statistical Data Ann McPhail, Division Chief Statistics Department,

Overview of SDMX: Statistical Data and Metadata eXchange Technical and Content Standards for Statistical Data Ann McPhail, Division Chief Statistics Department,
Restricted Views expressed are those of the presenter and not necessarily those of the BIS 1 Building a Data Portal with SDMX The BIS SDMX Sandbox exercise.

Restricted Views expressed are those of the presenter and not necessarily those of the BIS 1 Building a Data Portal with SDMX The BIS SDMX Sandbox exercise.
CountryData Development Improving the collation, availability and dissemination of development indicators (including the MDGs) Nairobi, 27 November 2013.

CountryData Development Improving the collation, availability and dissemination of development indicators (including the MDGs) Nairobi, 27 November 2013.
SDMX at the IMF Progress Report Expert Group on Statistical Data and Metadata Exchange (SDMX 2007), Geneva, May 8-11, 2007 Patrick Hinderdael, Economic.

SDMX at the IMF Progress Report Expert Group on Statistical Data and Metadata Exchange (SDMX 2007), Geneva, May 8-11, 2007 Patrick Hinderdael, Economic.
Restricted 13/14 September 2012 1 Building a Data Portal with SDMX The BIS SDMX Sandbox exercise 1 Gabriele Becker, Massimo Bruschi Bank for International.

Restricted 13/14 September Building a Data Portal with SDMX The BIS SDMX Sandbox exercise 1 Gabriele Becker, Massimo Bruschi Bank for International.
Restricted Daejeon, 26-29 April 2010 1 An SDMX based unified data catalogue (UDC) MSIS – Meeting on the Management of Statistical Information Systems 1.

Restricted Daejeon, April An SDMX based unified data catalogue (UDC) MSIS – Meeting on the Management of Statistical Information Systems 1.
Implementation of SDMX for data and metadata exchange SDMX Basics Course 12 April 2013 Daniel Suranyi Eurostat B5 Management of statistical data and metadata.

Implementation of SDMX for data and metadata exchange SDMX Basics Course 12 April 2013 Daniel Suranyi Eurostat B5 Management of statistical data and metadata.
Eurostat Unit B3 – IT and standards for data and metadata exchange SDMX Basics Training – 2012 IT architectures for data exchange SDMX-RI and the Hub approach.

Eurostat Unit B3 – IT and standards for data and metadata exchange SDMX Basics Training – 2012 IT architectures for data exchange SDMX-RI and the Hub approach.
Eurostat Global Implementation of SDMX in National Accounts Committee for the Coordination of Statistical Activities 22 nd Session 4-6 September Ankara,

Eurostat Global Implementation of SDMX in National Accounts Committee for the Coordination of Statistical Activities 22 nd Session 4-6 September Ankara,
13-Jul-07 Implementation of SDMX for data and metadata exchange Balance of Payments Working Group 2-3 April 2012 Daniel Suranyi Eurostat B5 Management.

13-Jul-07 Implementation of SDMX for data and metadata exchange Balance of Payments Working Group 2-3 April 2012 Daniel Suranyi Eurostat B5 Management.
1 Meeting on the Management of Statistical Information Systems (MSIS 2010) SDMX architecture for data sharing and interoperability Francesco Rizzo, ISTAT,

1 Meeting on the Management of Statistical Information Systems (MSIS 2010) SDMX architecture for data sharing and interoperability Francesco Rizzo, ISTAT,
ESCWA SDMX Workshop Session: Reporting Scenarios.

ESCWA SDMX Workshop Session: Reporting Scenarios.
Basics David Barraclough OECD SDMX Coordinator

Basics David Barraclough OECD SDMX Coordinator

Similar presentations

Ads by Google