Presentation is loading. Please wait.

Presentation is loading. Please wait.

Workshop on ESA 2010 transmission programme – What and how?

Published byJean-Marie Antonin Desjardins Modified over 6 years ago

Similar presentations

Presentation on theme: "Workshop on ESA 2010 transmission programme – What and how?"— Presentation transcript:

1 Workshop on ESA 2010 transmission programme – What and how?
EUROSTAT: Julio Cabeca Fabien Jacquet Silke Stapel-Weber Daniel Suranyi Hans Wouters

2 SDMX-NA Workshop – Part B
SDMX-NA Project overview SDMX – how do I get there? Demonstrations SDMX Converter SDMX Reference Infrastructure (SDMX-RI) SDMX-RI Mapping Assistant SDMX-RI test client (PUSH Mode) SDMX-RI web client (PUSH and PULL Mode) Questions & Answers

3 The SDMX Components SDMX Information Model Content Oriented Guidelines
IT Infrastructure for exchange and sharing Content Oriented Guidelines SDMX Information Model 3 3

4 The SDMX Components Describe statistics in a standard way
Objects and their relationships Data Structure Definition (DSD), Concepts, Code List Central management and standard access SDMX Registry, SDMX Web Services Cross Domain Concepts Cross Domain Code Lists Statistical Domains Metadata Common Vocabulary Push Provider generates and sends file to receiver Pull Provider opens web service to data Receiver downloads regularly Hub Special case of pull: receiver downloads on end user request 4 4

5 Timeline Preparation Q3/2011 - Q1/2012
Governance, Organisation, Planning Development Q4/ Q2/2013 Data Flows, Concepts, Code Lists DSDs and other artefacts Consultations Q3/ Q1/2013 NA and IT expert groups SDMX Sponsors & working groups Implementation Q4/ Q2/2014 Pilots 1+2, content review, technical review Release Adaption of production systems Production Sept 2014 Maintenance Regular Production Item 5.4 DMES 14/3/13

6 State of play and next steps
Content review (concepts, code lists, DSD matrix) 12/ /2013 Follow-up on content review Development of DSD and other artefacts Development of EXCEL visualisation templates Q1/2013 Technical review phase (DSD, other artefacts, end to end tests) /2013 Follow-up on technical review Release of DSDs and associated artefacts Start of implementation (NSI, NB, ESTAT, other IO) Summer 2013 SDMX Global Conference Paris, France September 2013 Item 5.4 DMES 14/3/13

7 Technical Review Phase – Contents
Pilot package (April) DSD Guidelines DSD Matrix Pilot 1 issue log Questionnaire Samples for table 1 Excel package (May) Samples for most tables Related SDMX-ML files Tables missing (GFS): 2, 9, 11, 25, 27, 28 Excel 2 SDMX converter module, pilot version (on demand)

8 Introduction: data transmission task
SDMX MS: NA data production environment EXCEL DB national coding and DS NA data transmission environment Manual Macros matching with ESA codes and DS ESTAT: single entry point Different production environ-ments ESA codes and DS

9 One goal – different possibilites
Excel sheets SDMX Converter SDMX-ML file Database export Database SDMX Reference Infrastructure SDMX-ML file SDMX Web Service

10 Always needed: Data Structure Definitions (DSDs)
DSD ID DSD Title Tables in transmission programs from 2014 MAIN Main aggregates ESA / OECD: 1, 3, 5, 20, 22 SEC Sector accounts and government finance ESA / OECD: 2, 6, 7, 8, 9,11, 26, 27, 28 ECB: MUFA, GFS EDP: 1, 2, 3, 4 OECD: 119, 7HH, 7II, PSD G20: Recommendation 15 SU Supply / use and input / output statistics ESA : 15, 16, 17, 18, 19 REG Regional statistics ESA : 10, 12, 13 PENS Pension schemes ESA: 29

11 SDMX-NA pilot registry & sandbox
Browse code lists Download DSDs Pilot sandbox Structural validation CSV, Gesmes, SDMX Data visualisation

12

13 SDMX-NA Workshop – Part B
SDMX-NA Project overview SDMX – how do I get there? Demonstrations SDMX Converter SDMX Reference Infrastructure (SDMX-RI) SDMX-RI Mapping Assistant SDMX-RI test client (PUSH Mode) SDMX-RI web client (PUSH and PULL Mode) Questions & Answers

14 SDMX-NA Workshop – Part B
SDMX-NA Project overview SDMX – how do I get there? Demonstrations SDMX Converter SDMX Reference Infrastructure (SDMX-RI) SDMX-RI Mapping Assistant SDMX-RI test client (PUSH Mode) SDMX-RI web client (PUSH and PULL Mode) Questions & Answers

15 SDMX Converter https://webgate. ec. europa. eu/fpfis/mwikis/sdmx/index
File based conversion Open source and platform independend (Java) Different ways of using it: Graphical user interface Batch file (server or client side) Web Service interface Reusing source code in your own Java application Formats: SDMX-ML 2.0, SDMX-EDI (Gesmes), FLR, CSV, Google DSPL, XLS, XLSX (2014)

16 SDMX-NA Workshop – Part B
SDMX-NA Project overview SDMX – how do I get there? Demonstrations SDMX Converter SDMX Reference Infrastructure (SDMX-RI) SDMX-RI Mapping Assistant SDMX-RI test client (PUSH Mode) SDMX-RI web client (PUSH and PULL Mode) Questions & Answers

17 SDMX-NA Workshop – Part B
SDMX-NA Project overview SDMX – how do I get there? Demonstrations SDMX Converter SDMX Reference Infrastructure (SDMX-RI) SDMX-RI Mapping Assistant SDMX-RI test client (PUSH Mode) SDMX-RI web client (PUSH and PULL Mode) Questions & Answers

18 SDMX Reference Infrastructure https://webgate. ec. europa
Data Provider Data Collector SDMX Registry Mapping Assistant DSD Web Svc Web Client Test Client Non-SDMX local database SDMX data set SDMX-RI

19 SDMX Reference Infrastructure https://webgate. ec. europa
Data Provider Data Collector SDMX Registry Mapping Assistant DSD Web Svc Web Client Test Client Non-SDMX local database SDMX data set SDMX-RI

20 SDMX Reference Infrastructure https://webgate. ec. europa
Data Provider Data Collector SDMX Registry Mapping Assistant DSD Web Svc Web Client Test Client Non-SDMX local database SDMX data set SDMX-RI

21 SDMX-NA Workshop – Part B
SDMX-NA Project overview SDMX – how do I get there? Demonstrations SDMX Converter SDMX Reference Infrastructure (SDMX-RI) SDMX-RI Mapping Assistant SDMX-RI test client (PUSH Mode) SDMX-RI web client (PUSH and PULL Mode) Questions & Answers

22 SDMX Tools – Summary http://www.sdmxtools.org
Eurostat tools  Eurostat SDMX Info Space SDMX Converter SDMX Reference Infrastructure & Mapping Assistant SDMX Registry & Data Structure Wizard Other tools availble in the community Fusion Weaver (validation, transformation, creation) Fusion Transformer (command line conversion) Fusion Registry ECB Checker/Loader (conversion and validation) FAO OpenSDMX project

23 SDMX-NA Workshop – Part B
SDMX-NA Project overview SDMX – how do I get there? Demonstrations SDMX Converter SDMX Reference Infrastructure (SDMX-RI) SDMX-RI Mapping Assistant SDMX-RI test client (PUSH Mode) SDMX-RI web client (PUSH and PULL Mode) Questions & Answers

24 Questions & Answers HELP – We do not have a database! No worries.
Excel templates are available Conversion will be supported through the SDMX converter. However: use the opportunity to start!

25 ? Quesions & Answers I want to have a database. What should I do?
SDMX-NA ?

26 Questions & Answers When do we need to start sending SDMX-ML?
For which tables? When do we need to start using PULL / HUB mode? For Eurostat: start with ESA2010 (September 2014) All tables are covered Only PUSH is required ESS: PULL may be implemented voluntarily HUB is not planned in National Accounts

27 Questions & Answers Which versions / formats should we use?
SDMX-EDI (Gesmes/TS) supported, deprecated SDMX-ML 2.0 (compact) preferred SDMX-ML 2.1 (structure specific) in preparation

28 Questions & Answers Where will the DSDs be managed?
When will we have the final versions? What will happen to the sandbox? DSDs will be managed in the global SDMX registry Final versions will be released in September 2013 The sandbox is only available for the pilot phase Validation will be managed by receiving organisations

29 Questions & no Answers yet
Some coding details still subject to change Usage of conditional (metadata) attributes Usage of sibling group Data flows Final number of data flows Update/Revision or Replace mode Constraints linked to data flows Will be included in final DSD Guidelines

30 Questions? SDMX Support Team SDMX Website Eurostat SDMX Info Space
SDMX Website Eurostat SDMX Info Space SDMX-NA pilot project page SDMX Global Conference Paris, France September 2013

Download ppt "Workshop on ESA 2010 transmission programme – What and how?"

Similar presentations

Eurostat Progress report SDMX-NA ESTAT, Unit C.2.

Eurostat Progress report SDMX-NA ESTAT, Unit C.2.
SDMX training session on basic principles, data structure definitions and data file implementation 29 November 2007 2.

SDMX training session on basic principles, data structure definitions and data file implementation 29 November
Introduction to SDMX Seminar Eurostat/ECLAC 02 October 2012 August Götzfried Head of Unit, Eurostat B5 Management of statistical data and metadata.

Introduction to SDMX Seminar Eurostat/ECLAC 02 October 2012 August Götzfried Head of Unit, Eurostat B5 Management of statistical data and metadata.
Global SDMX Implementation Experience from on-going projects Daniel Suranyi, Eurostat Project Officer for SDMX implementation SDMX Expert Group, 13-14.

Global SDMX Implementation Experience from on-going projects Daniel Suranyi, Eurostat Project Officer for SDMX implementation SDMX Expert Group,
Overview of SDMX: Statistical Data and Metadata eXchange Technical and Content Standards for Statistical Data Ann McPhail, Division Chief Statistics Department,

Overview of SDMX: Statistical Data and Metadata eXchange Technical and Content Standards for Statistical Data Ann McPhail, Division Chief Statistics Department,
Implementation of SDMX for data and metadata exchange SDMX Basics Course 12 April 2013 Daniel Suranyi Eurostat B5 Management of statistical data and metadata.

Implementation of SDMX for data and metadata exchange SDMX Basics Course 12 April 2013 Daniel Suranyi Eurostat B5 Management of statistical data and metadata.
Eurostat Global Implementation of SDMX in National Accounts Committee for the Coordination of Statistical Activities 22 nd Session 4-6 September Ankara,

Eurostat Global Implementation of SDMX in National Accounts Committee for the Coordination of Statistical Activities 22 nd Session 4-6 September Ankara,
13-Jul-07 Implementation of SDMX for data and metadata exchange Balance of Payments Working Group 2-3 April 2012 Daniel Suranyi Eurostat B5 Management.

13-Jul-07 Implementation of SDMX for data and metadata exchange Balance of Payments Working Group 2-3 April 2012 Daniel Suranyi Eurostat B5 Management.
Basics David Barraclough OECD SDMX Coordinator

Basics David Barraclough OECD SDMX Coordinator
Model and Representations

Model and Representations
Eurostat 6. SDMX: A non-technical overview of the SDMX architecture and IT tools 1 Raynald Palmieri Eurostat Unit B5: “Central data and metadata services”

Eurostat 6. SDMX: A non-technical overview of the SDMX architecture and IT tools 1 Raynald Palmieri Eurostat Unit B5: “Central data and metadata services”
Eurostat 4. SDMX: Main objects for data exchange 1 Raynald Palmieri Eurostat Unit B5: “Central data and metadata services” SDMX Basics course, 27-29 October.

Eurostat 4. SDMX: Main objects for data exchange 1 Raynald Palmieri Eurostat Unit B5: “Central data and metadata services” SDMX Basics course, October.
SDMX IT Tools Introduction

SDMX IT Tools Introduction
2.An overview of SDMX (What is SDMX? Part I) 1 Edward Cook Eurostat Unit B5: “Central data and metadata services” SDMX Basics course, 27-29 October 2015.

2.An overview of SDMX (What is SDMX? Part I) 1 Edward Cook Eurostat Unit B5: “Central data and metadata services” SDMX Basics course, October 2015.
7c. SDMX practical use case: National Accounts

7c. SDMX practical use case: National Accounts
Eurostat SDMX Reference Infrastructure: Tools demonstration November 2015 Eurostat Unit B3 – IT and standards for data and metadata exchange Jean-Francois.

Eurostat SDMX Reference Infrastructure: Tools demonstration November 2015 Eurostat Unit B3 – IT and standards for data and metadata exchange Jean-Francois.
SDMX IT Tools SDMX use in practice in NA

SDMX IT Tools SDMX use in practice in NA
Eurostat November 2015 Eurostat Unit B3 – IT and standards for data and metadata exchange Jean-Francois LEBLANC Christian SEBASTIAN SDMX IT Tools SDMX.

Eurostat November 2015 Eurostat Unit B3 – IT and standards for data and metadata exchange Jean-Francois LEBLANC Christian SEBASTIAN SDMX IT Tools SDMX.
7b. SDMX practical use case: Census Hub

7b. SDMX practical use case: Census Hub
Implementation of SDMX for Balance of Payments Balance of Payments Working Group 9-10 April 2013 BP-13-11 Daniel Suranyi Eurostat B5 Management of statistical.

Implementation of SDMX for Balance of Payments Balance of Payments Working Group 9-10 April 2013 BP Daniel Suranyi Eurostat B5 Management of statistical.

Similar presentations

Ads by Google