SDMX Implementation for National Accounts ECB MUFA and GFS Guidelines Data flows and DataSet Identifiers Workshop on ESA2010 transmission programme June.

Slides:



Advertisements
Similar presentations
The use of SDMX at the ECB Xavier Sosnovsky European Central Bank Bonn,
Advertisements

SDMX training session on basic principles, data structure definitions and data file implementation 29 November
SDMX – AN OECD PERSPECTIVE Paul Schreyer OECD CCSA Special Session, September 2014 Rome.
Global Merchandise Trade SDMX Data Structure Definition Overview Markie Muryawan United Nations Statistics Division WCO IT Conference and Exhibition ©
ESA 2010 transmission programme
The implementation of the SDMX standards by the ECB and the European System of Central Banks Werner Bier (ECB) Gérard Salou (ECB) Sami Airo (Bank.
Global SDMX Implementation Experience from on-going projects Daniel Suranyi, Eurostat Project Officer for SDMX implementation SDMX Expert Group,
Sdmx web services Strutural data
1 Annual National Accounts  1. Situation of OECD annual national accounts database  2. New features of the joint OECD-Eurostat questionnaire  3. COFOG2.
CountryData Technologies for Data Exchange SDMX Information Model: An Introduction.
13-Jul-07 Implementation of SDMX for data and metadata exchange Balance of Payments Working Group 2-3 April 2012 Daniel Suranyi Eurostat B5 Management.
1 Eurostat Unit B5 – Statistical Information Technologies SDMX Basics – October 2011 SDMX Basics Core Elements Information Model Data Structure Definition.
Situation of ANA data and metadata in 2008 Transmission to the OECD : progress report.
Basics David Barraclough OECD SDMX Coordinator
Eurostat 1 7a. Practical use case 1: Pesticides Use Project Blanaru Cristina Eurostat Unit B5: “Central data and metadata services” SDMX Basics course,
Model and Representations
A Data Structure Definition for Eurostat's short-term business statistics Jan Planovsky, Eurostat SDMX Global Conference Bangkok, September 2015.
Eurostat 6. SDMX: A non-technical overview of the SDMX architecture and IT tools 1 Raynald Palmieri Eurostat Unit B5: “Central data and metadata services”
Eurostat SDMX and Global Standardisation Marco Pellegrino Eurostat, Statistical Office of the European Union Bangkok,
Eurostat 4. SDMX: Main objects for data exchange 1 Raynald Palmieri Eurostat Unit B5: “Central data and metadata services” SDMX Basics course, October.
2.An overview of SDMX (What is SDMX? Part I) 1 Edward Cook Eurostat Unit B5: “Central data and metadata services” SDMX Basics course, October 2015.
7c. SDMX practical use case: National Accounts
SDMX IN DATA COLLECTION AND DATA DISSEMINATION Workshop on Statistical Data Collection, Washington DC, 29 April - 1 May 2015.
SDMX IT Tools SDMX use in practice in NA
Implementation of SDMX for Balance of Payments Balance of Payments Working Group 9-10 April 2013 BP Daniel Suranyi Eurostat B5 Management of statistical.
CCSA session on SDMX implementation Werner Bier and Per Nymand-Andersen European Central Bank CCSA session on SDMX implementation, FAO headquarters, 11.
1 Joint UNECE/EUROSTAT/OECD METIS Work Session (Geneva, March 2010) The On-Going Review of the SDMX Technical Specifications Marco Pellegrino, Håkan.
Eurostat Reporting every number only once: International data cooperation for National Accounts Walter Radermacher Director-General Eurostat.
Eurostat November 2015 Eurostat Unit B3 – IT and standards for data and metadata exchange Jean-Francois LEBLANC Christian SEBASTIAN SDMX IT Tools SDMX.
SDMX Basics course, March 2016 Eurostat SDMX Basics course, March Introducing the Roadmap Marco Pellegrino Eurostat Unit B5: “Data and.
Global data structure definitions
Metadata Standards for Statistical Classifications
Progress Update MSIS: Bratislava, April 2005
Exchanging Reference Metadata using SDMX
SDMX Information Model
7. SDMX practical use case: National Accounts
SDMX Converter Raynald PALMIERI June 2015
SDMX Introduction and practical exercises
ESCWA SDMX Workshop Session: Constraints.
2. An overview of SDMX (What is SDMX? Part I)
Eurostat – Units E2, B5 Cristina BLANARU
Ivana Đurović National Bank of Serbia Luxembourg, June 2015
2. An overview of SDMX (What is SDMX? Part I)
Workshop on ESA 2010 transmission programme – What and how?
Task Force on Annual Financial Accounts
Case Study ESTP Workshop on SDMX in National Accounts
Regional Seminar on Developing a Program for the Implementation of the 2008 SNA and Supporting Statistics Gülfer DİKBAYIR September 2013 Ankara.
Working Group on Population and Housing Censuses
SDMX in the S-DWH Layered Architecture
SDMX Tools Overview and architecture
SDMX IT Tools SDMX Converter
Progress Report on Annual Financial Accounts
August Götzfried Eurostat unit B 4
Welcome SDMX in National Accounts Governance & Maintenance
ESS VIP ICT Project Task Force Meeting 5-6 March 2013.
SDMX Tools Interactive demonstrations Structural Validation Service
Agenda Item SDMX 2.1 for LCI -
SDMX : General introduction H. Linden, Eurostat, Unit B5
ESA 2010 and the Transmission Programme Introduction
SDMX IT Tools SDMX use in practice in NA
9. Practical use case 3: Pesticides Use Project
SDMX Implementation The National Accounts use case
Eurostat Unit B3 – IT and standards for data and metadata exchange
7. Introduction to the main SDMX objects for metadata exchange
Developing SDMX artefacts for data exchange, sharing and dissemination
14. SDMX: Global and regional implementation projects
SDMX: Frequently Asked Questions
Integrated Statistical Production System WITH GSBPM
Data Validation in the ESS (National Accounts - Case of Albania)
Presentation transcript:

SDMX Implementation for National Accounts ECB MUFA and GFS Guidelines Data flows and DataSet Identifiers Workshop on ESA2010 transmission programme June 10-11, 2013 - Luxembourg Zlatina Balabanova Lisbeth Yancis zlatina.balabanova@ecb.int lisbeth.yancis@ecb.int

Common DSDs DSD ID DSD Title Tables in transmission programs from 2014 MAIN Main aggregates ESA / OECD: 1, 3, 5, 20, 22 SEC Sector accounts and government finance ESA / OECD: 2, 6, 7, 8, 9,11, 26, 27, 28 ECB: MUFA, GFS EDP: 1, 2, 3, 4 OECD: 119, 7HH, 7II, PSD G20: Recommendation 15 SU Supply / use and input / output statistics ESA : 15, 16, 17, 18, 19 REG Regional statistics ESA : 10, 12, 13 PENS Pension schemes ESA: 29

Example-ECB MUFA Guideline Currently there are 13 dimensions Using the new DSD the dimensions will be 18 FREQ REF_AREA ADJUSTMENT PRICES STO INSTR_ASSET REF_SECTOR COUNTERPART_AREA COUNTERPART_SECTOR ACCOUNTING_ENTRY CONSOLIDATION UNIT_MEASURE SUFFIX Q FI N V LE F41 S1 A1 S 1 Z FREQ REF_AREA ADJUSTMENT TRANSFORMATION PRICES STO INSTR_ASSET MATURITY REF_SECTOR COUNTERPART_AREA COUNTERPART_SECTOR ACCOUNTING_ENTRY CONSOLIDATION UNIT_MEASURE VALUATION COFOG CURRENCY_DENOM CUST_BREAKDOWN Q FI N V LE F4 S S1 W0 A XDC _Z _T

Example-ECB GFS Guideline Currently there are 8 dimensions Using the new DSD the dimensions will be 18 FREQ REF_AREA ADJUSTMENT REF_SECTOR INSTR_ASSET COUNTERPART_SECTOR VALUATION UNIT_MEASURE A BE N B0X13 MAL B1300 SA E FREQ REF_AREA ADJUSTMENT TRANSFORMATION PRICES STO INSTR_ASSET MATURITY REF_SECTOR COUNTERPART_AREA COUNTERPART_SECTOR ACCOUNTING_ENTRY CONSOLIDATION UNIT_MEASURE VALUATION COFOG CURRENCY_DENOM CUST_BREAKDOWN A BE N V LE GD T S13 W0 S1 L C XDC F _Z _T

SNA data exchange in ESCB context Use of EXDI (ESCB data exchange infrastructure) SDMX reporting format supported: SDMX-EDI (Gesmes/TS) SDMX-ML compact format version 2.0 SDMX-ML structure specific version 2.1 Starting date for the transition period: from September 2013 onwards MUFA test transmission – November 2013 Use of the test environment for the new SNA DSDs for the test transmissions and the production for the current SNA flows

Data flows A data flow is characterised by: a Data Structure Definition (DSD) constraints = list of expected series keys / combination of valid codes in series key dimensions providing and receiving institutions a reporting deadline Data flows are equivalent to the Data Set Identifier in SDMX/EDI terminology

Compatibility: SDMX-EDI/SDMX-ML SDMX-EDI and SDMX-ML data files must be easily convertible into each other The data model underlying the pure data part of data files is the same for SDMX-EDI and SDMX-ML Easy conversion between the two formats requires the same information model also to apply to the information contained in the header of the file The mandatory pieces of information for SDMX-EDI and their counterparts in SDMX-ML, 2.1 in the example below, are highlighted in bold red

SDMX-EDI (Interchange level) UNB+UNOC:3+4F0+V12+120726:1510+IREF121557++GESMES/TS' ( sender, recipient, preparation time, IREF, message type and test string if relevant) (Message level) UNH+MREF000001+GESMES:2:1:E6' (MREF) BGM+74' (data message, a data structure message uses 73) NAD+Z02+ECB' (maintenance agency of key family) NAD+MR+V12' (recipient) NAD+MS+4F0' (sender) IDE+10+ECB_EXR1 EU EERs update (EXR)' DSI+ECB_EXR1' (Data Set Identifier) STS+3+7' (Update message, a Delete message uses value 6) DTM+Z02:1961010120111011:711 (optional: (reporting begin and end period) IDE+5+ECB_EXR1' (key family)   SDMX-ML 2.1  (Interchange level) <message:Header> <message:ID>IREF121557</message:ID>   <message:Test>false</message:Test>   <common:Name>ECB_EXR1 EU EERs update (EXR)</common:Name>   <message:Prepared>2013-02-21T10:37:00+01:00</message:Prepared>   <message:Sender id="4F0" />   <message:Receiver id="V12" /> <message:Structure dimensionAtObservation="TIME_PERIOD" structureID="ECB_BSI1" (key family) namespace="urn:sdmx:org.sdmx.infomodel.datastructure.DataStructure=ECB:ECB_BSI1(1.0):ObsLevelDim:TIME_PERIOD"> <common:Structure>   <Ref agencyID="ECB" id="ECB_EXR1" /> (key family)   </common:Structure>   </message:Structure>   <message:DataSetID>ECB_EXR1</message:DataSetID> (dsi)   <message:Extracted>2012-07-26T15:10:00+01:00</message:Extracted>   </message:Header> <message:DataSet data:action="Replace" data:structureRef="ECB_EXR1" (key family) data:dataScope="DataStructure" xsi:type="dsd:DataSetType">

SNA data flows At this stage, some technical details still need to be further clarified and agreed between IOs in terms of: Data flow definitions from reporting institutions to IOs between IOs Data file content Updates and Revisions data files (U&R) versus full refreshment Transmission of attributes Data transmissions to ECB using the new SDMX-NA DSD will take place from September 2014 onwards