SDMX FROM NEEDS Kamel ABDELLAOUI Rafik Mahjoubi

Slides:



Advertisements
Similar presentations
April, 2004 Lars Thygesen International Trade Expert meeting Whats going on at OECD: statistical information management.
Advertisements

Database Management Systems and Enterprise Software
Introduction to SDMX Seminar Eurostat/ECLAC 02 October 2012 August Götzfried Head of Unit, Eurostat B5 Management of statistical data and metadata.
SERVER web page repository WEB PAGE instructions stores information and instructions BROWSER retrieves web page and follows instructions Server Web Server.
MDG Data Coordination Neda Jafar Workshop on MDG Data Reconciliation: Employment Indicators July, Beirut Workshop on MDG Data Reconciliation:
MIS 385/MBA 664 Systems Implementation with DBMS/ Database Management Dave Salisbury ( )
Eurostat – Directorate B: Corporate statistical and IT services SDMX Basics Training – 2013 SDMX basics Marco Pellegrino Eurostat, Directorate B.
Creating Dynamic Web Pages Using PHP and MySQL CS 320.
13-Jul-07 Implementation of SDMX for data and metadata exchange Balance of Payments Working Group 2-3 April 2012 Daniel Suranyi Eurostat B5 Management.
Microsoft FrontPage 2003 Illustrated Complete Creating a Form.
ECEN “Internet Protocols and Modeling”, Spring 2012 Course Materials: Papers, Reference Texts: Bertsekas/Gallager, Stuber, Stallings, etc Class.
Slide 1 Eurostat Unit B3 – Statistical Information Technologies CoRD Meeting – 4 June 2007 Agenda Item 8 Preliminary ideas for a 2011 census hub Giuseppe.
Eurostat 6. SDMX: A non-technical overview of the SDMX architecture and IT tools 1 Raynald Palmieri Eurostat Unit B5: “Central data and metadata services”
Eurostat 4. SDMX: Main objects for data exchange 1 Raynald Palmieri Eurostat Unit B5: “Central data and metadata services” SDMX Basics course, October.
1 Integration of the Eurostat and ESS Metadata Systems A. Götzfried Head of Unit B6 Eurostat.
SDMX IT Tools Introduction
2.An overview of SDMX (What is SDMX? Part I) 1 Edward Cook Eurostat Unit B5: “Central data and metadata services” SDMX Basics course, October 2015.
SDMX IT Tools SDMX use in practice in NA
Server-Side Solutions Steve Perry
Eurostat 1.SDMX: Background and purpose 1 Edward Cook Eurostat Unit B5: “Central data and metadata services” SDMX Basics course, October 2015.
7b. SDMX practical use case: Census Hub
OECD Expert Group on Statistical Data and Metadata Exchange (Geneva, May 2007) Update on technical standards, guidelines and tools Metadata Common.
Eurostat 6. SDMX: A non-technical overview of the SDMX architecture and IT tools 1 Raynald Palmieri Eurostat Unit B5: “Central data and metadata services”
The Eurostat Metadata Handler Götzfried Eurostat (Head of Unit B6)
The ESS vision, ESSnets and SDMX
A Metadata System for Geomagnetism
The evolution of the SDMX infrastructure and services
Wednesday, September 19, 2018 What Is the Internet?
Progress Update MSIS: Bratislava, April 2005
Building an Observation Data Layer
Interoperable data formats: SDMX
Dissemination Working Group
SDMX Opportunities MED Meeting 14 May 2013 Daniel Suranyi Eurostat B5
SDMX Information Model
SDMX: Enabling World Bank to automate data ingestion
MSDs and combined metadata reporting
Census Hub in practice Working Group "European Statistical Data Support" Luxembourg, 29 April 2015.
SDMX: A brief introduction
11. The future of SDMX Introducing the SDMX Roadmap 2020
The new Eurostat publications program
Presentation contents:
Metadata in the modernization of statistical production at Statistics Canada Carmen Greenough June 2, 2014.
2. An overview of SDMX (What is SDMX? Part I)
2. An overview of SDMX (What is SDMX? Part I)
Introduction to computers
Lecture 1 File Systems and Databases.
SDMX Information Model: An Introduction
Part of Chapter 1 Key Concepts Networks
Data Transmission Tools & Services EDAMIS, SDMX, Validation
SDMX in Statistical Information System, INS TUNISIA
Implementation of SDMX in the ESS
SDMX in the S-DWH Layered Architecture
SDMX Tools Overview and architecture
Statistical Information Technology
Chapter 16 The World Wide Web.
SDMX as basis for water data reporting
August Götzfried Eurostat unit B 4
SDMX : General introduction H. Linden, Eurostat, Unit B5
SODI Live Demonstration
Demography applications of SDMX Giuseppe SINDONI, Unit B3
The role of metadata in census data dissemination
The Database Environment
1. SDMX: Background and purpose
MIS 385/MBA 664 Systems Implementation with DBMS/ Database Management
Work Session on Statistical Metadata (Geneva, Switzerland May 2013)
Database Management Systems and Enterprise Software
SDMX IT building blocks
Daniel Suranyi, Krassimir Ivanov
Presentation transcript:

SDMX FROM NEEDS Kamel ABDELLAOUI Rafik Mahjoubi abdellaoui.kamel@ins.tn Rafik.MAHJOUBI@oecd.org

Case 1: Data reporting Receiver 1 Data 1 Sender Data 2 Receiver 2 Usually we’re involved to send data to more than one receiver . In some cases we have to send the same data in diffrent formats and diffrent way to serveral receivers . In addition , the receivers exchanges part of this data that’s replicated . So we lost many time to adopt structure with a poor metadata …. Receiver 2

Case 2: Data Collecting Receiver 1 Trade Data 1 Sender Data 2 Social Receiver 1 Trade Data 1 Sender Data 2 Short term In some cases , the entity who is in charge data reporting collects from several sources in many formats . So a harmonization of structure is stongly needed to be able to send data to “receivers” . Receiver 2 Census

Background issues Data being collected in multiple ways (surveys, files, web queries, metadata etc.); Data being transmitted in various formats (paper, excel, flat files etc.) Data being transmitted in various media (email, CD-ROMs, file uploads etc.); Data being stored in various places (USB, hard drive, servers, cloud etc.);

Background issues Multiple organisations collecting similar or same data; Similar concepts in wording can have a different content; Increasing burden on organisations (collection, maintenance and managing); The intensive and manual nature of data collection; Errors and inconsistencies;

Data exchange, How ? Dataset1 Sender Receiver Data Structure Let’s see what we mean by sending /reporting datasets ! So we send values , variables , codes , facts …. That’s mean we have to send data (values) and metadata . But how we can understand the structure of my data by a wide users . May I add texts to explain ? Whitch vocabulary I will adopt ?

Data exchange, How ? Standard Message Common Vocablory List of Tools Information Model Standard Message Content Oriented Guidelines Common Vocablory Based on List of Tools Through List of rule to harmonize message using Commun vocablory . To implement that we need list of tools . There’s SDMX repository of tools . Most of them are free and open source like SDMX RI IT Infrastructure for exchange and sharing

Data exchange, How ? SDMX is about changing from a multiple, diverse and complex exchange system, to a common, harmonised and standardised exchange system.

Ressources SDMX web site : www.sdmx.org