Global SDMX Implementation Experience from on-going projects Daniel Suranyi, Eurostat Project Officer for SDMX implementation SDMX Expert Group, 13-14.

Slides:

Advertisements

Similar presentations

OECD Expert Group on Statistical Data and Metadata Exchange (SDMX) Paris, September 2012 Governance of commonly used SDMX artefacts A.Götzfried.

Advertisements

Eurostat Progress report SDMX-NA ESTAT, Unit C.2.

Reproductions of this material, or any parts of it, should refer to the IMF Statistics Department as the source. IMF Statistics Department Louis Marc Ducharme.

For National Accounts (incl. GFS), BOP and FDI Meeting of the Advisory Expert Group (AEG) on National Accounts September 8-10, 2014, Washington, DC.

SDMX training session on basic principles, data structure definitions and data file implementation 29 November

Data Sharing Werner Bier Deputy Director-General Statistics European Central Bank Inter-Agency Group on Economic and Financial Statistics (IAG) G-20 Data.

Better data quality through global data and metadata sharing

SDMX Data Structure Definition for BPM6 and EBOPS Working Party on International Trade in Goods and Trade in Services Statistics Paris, France November.

SDMX at United Nations Statistics Division Experience, Challenges, Strategies.

SDMX – AN OECD PERSPECTIVE Paul Schreyer OECD CCSA Special Session, September 2014 Rome.

Global Merchandise Trade SDMX Data Structure Definition Overview Markie Muryawan United Nations Statistics Division WCO IT Conference and Exhibition ©

The views expressed herein are those of the author and should not be attributed to the IMF, its Executive Board, or its management Meeting on the Management.

Economic and Financial Statistics and Indicators for Multilateral Surveillance PEEIs, PGIs and International Data Templates Werner Bier Deputy Director.

SDMX AND DATA DISSEMINATION SDMX Training BANK INDONESIA SEPTEMBER 2015 YOGYAKARTA, INDONESIA.

SDMX Training Bank Indonesia September 2015

Restricted 13/14 September Building a Data Portal with SDMX The BIS SDMX Sandbox exercise 1 Gabriele Becker, Massimo Bruschi Bank for International.

Implementation of SDMX for data and metadata exchange SDMX Basics Course 12 April 2013 Daniel Suranyi Eurostat B5 Management of statistical data and metadata.

Eurostat Global Implementation of SDMX in National Accounts Committee for the Coordination of Statistical Activities 22 nd Session 4-6 September Ankara,

13-Jul-07 Implementation of SDMX for data and metadata exchange Balance of Payments Working Group 2-3 April 2012 Daniel Suranyi Eurostat B5 Management.

SDMX data structure definition for BPM6-based data BP Balance of PaymentsWorking Group Luxembourg, 2-3 April 2012.

ADB/ESCAP Pilot Project: Implementation of Global SDMX Data Structure Definitions in Asia-Pacific Region - Putting SDMX into practice MSIS, Manila,

SDMX Implementation in the European Statistical System P. Everaers, A. Götzfried Eurostat.

Basics David Barraclough OECD SDMX Coordinator

Model and Representations

A Data Structure Definition for Eurostat's short-term business statistics Jan Planovsky, Eurostat SDMX Global Conference Bangkok, September 2015.

Eurostat 4. SDMX: Main objects for data exchange 1 Raynald Palmieri Eurostat Unit B5: “Central data and metadata services” SDMX Basics course, October.

1 SDMX-initiative for exchanging national accounts data.

7c. SDMX practical use case: National Accounts

8. SDMX: Governance. Understanding Shared Responsibilities

SDMX IN DATA COLLECTION AND DATA DISSEMINATION Workshop on Statistical Data Collection, Washington DC, 29 April - 1 May 2015.

SDMX IT Tools SDMX use in practice in NA

Eurostat 1.SDMX: Background and purpose 1 Edward Cook Eurostat Unit B5: “Central data and metadata services” SDMX Basics course, October 2015.

Implementation of SDMX for Balance of Payments Balance of Payments Working Group 9-10 April 2013 BP Daniel Suranyi Eurostat B5 Management of statistical.

CCSA session on SDMX implementation Werner Bier and Per Nymand-Andersen European Central Bank CCSA session on SDMX implementation, FAO headquarters, 11.

Eurostat 1 3.An overview of the SDMX implementation process Edward Cook Eurostat Unit B5: “Central data and metadata services” SDMX Basics course,

Eurostat November 2015 Eurostat Unit B3 – IT and standards for data and metadata exchange Jean-Francois LEBLANC Christian SEBASTIAN SDMX IT Tools SDMX.

Briefing on the work of the Inter-agency Group on Economic and Financial Statistics Future organisation of the data flow among national and international.

Implementation of SDMX for data and metadata exchange SDMX Basics Course October 2012 Daniel Suranyi Eurostat B5 Management of statistical data and.

SDMX Basics course, March 2016 Eurostat SDMX Basics course, March Introducing the Roadmap Marco Pellegrino Eurostat Unit B5: “Data and.

Meeting of the Advisory Expert Group (AEG) on National Accounts April 13-15, 2016, Paris.

Global data structure definitions

Metadata Standards for Statistical Classifications

Exchanging Reference Metadata using SDMX

Interoperable data formats: SDMX

SDMX Opportunities MED Meeting 14 May 2013 Daniel Suranyi Eurostat B5

Using the Checklist for SDMX Data Providers

7. SDMX practical use case: National Accounts

11. The future of SDMX Introducing the SDMX Roadmap 2020

SDMX Introduction and practical exercises

Workshop on ESA 2010 transmission programme – What and how?

Updates from the SDMX Sponsors and SDMX Secretariat

9. SDMX Governance Understanding shared responsibilities and governance rules Marco Pellegrino Unit B1: “Methodology and corporate architecture” SDMX Basic.

Data Transmission Tools & Services EDAMIS, SDMX, Validation

Implementation of SDMX in the ESS

3b. SDMX: Governance. Understanding Shared Responsibilities

SDMX as basis for water data reporting

August Götzfried Eurostat unit B 4

Welcome SDMX in National Accounts Governance & Maintenance

ESS VIP ICT Project Task Force Meeting 5-6 March 2013.

SDMX : General introduction H. Linden, Eurostat, Unit B5

SDMX IT Tools SDMX use in practice in NA

SDMX Progress and implementation A. Götzfried, Unit B6

Item 7.11 SDMX Progress report

SDMX Implementation The National Accounts use case

1. SDMX: Background and purpose

Modernisation of Validation in the ESS Collaboration with countries

Developing SDMX artefacts for data exchange, sharing and dissemination

14. SDMX: Global and regional implementation projects

Daniel Suranyi, Krassimir Ivanov

Presentation transcript:

Global SDMX Implementation Experience from on-going projects Daniel Suranyi, Eurostat Project Officer for SDMX implementation SDMX Expert Group, September, Paris

Challenge: Global DSD Statistical Domain International Harmonisation SDMX

International Projects (Eurostat perspective) DomainPartnersPilotProduction FisheriesUN (FAO) Balance of Payments SDMX Sponsors (IMF coordinating) Q3/201209/2014 National Accounts SDMX Sponsors (Eurostat coordinating) Q1/201309/2014 Research & Development OECD, UNESCO EducationOECD, UNECETBD HealthOECD, WHOTBD External TradeOECD, UNTBD

Balance of Payments, National Accounts The SDMX sponsors mandated –ECB, Eurostat, IMFECB, Eurostat, OECD To propose Data Structure Definitions for –BPM 6SNA 2008 Governance –Steering Group ↔ Coordination ↔ Technical Group

Roadmap – National Accounts Preparation Development Consultations Implementation Production & Maintenance Organisation, planning, data flows Domain concepts, draft DSDs, fine tuning Pilot projects, system adaption, release SDMX & NA expert review, acceptance

General Approach Definition of domain concepts Grouping –cross-domain –NA & BoP –NA specific Coding Draft DSD Review

Reporting matrix into SDMX artefacts Concept Scheme Data Flow Code ListsData Structure Definitions CL Constraints

Comparison: Use a single "Global DSD" "Not applicable" code in all dimensions Constraints for sub-setting code lists "Entry gate" problem –Push: validate selection of data flow –Pull: queries more complex Complex validation

Comparison: Using multiple derived DSDs No direct reference to "Global DSD" –to concept scheme and code lists Multiple files / identifiers  Push: DSD ↔ data flow  Pull: direct query Maintenance –On DSD level instead of complex mechanisms

Use case: reference multiple code lists Reporting Country National Accounts ISO 2 NA Aggregates Research & Development ISO 2 NUTS 2 R&D Aggregates Activity Eurostat NACE 2 Custom Aggregates OECD ISIC 4 Custom Aggregates Currently not possible in SDMX 2.1 –to extend code lists by reference –to reference multiple code lists by concept –to use hierarchical code lists for reporting Current solution –build domain code lists based on COG

Statistical Domain International Harmonisation SDMX Messages "SDMX Implementation" ≠ "Global DSD" –Data flows  Concepts  Reporting matrix / code lists –Best practise: domain & SDMX experts from the start A single global DSD per domain is not sufficient –Harmonise reporting needs as far as possible –Additional intelligence around the DSD needed –Derive DSDs, but handle with care Some technical limitations –Common way of using existing possibilities –Foresee in next version of standard