SDMX: From Labour Force Department to the Statistical Database

Slides:



Advertisements
Similar presentations
Reproductions of this material, or any parts of it, should refer to the IMF Statistics Department as the source. IMF Statistics Department Louis Marc Ducharme.
Advertisements

CASE STUDY: IMPLEMENTING SDMX EXCHANGE WITH MEMBER COUNTRIES IN SHORT-TERM ECONOMIC STATISTICS (STES)
Introduction to SDMX Seminar Eurostat/ECLAC 02 October 2012 August Götzfried Head of Unit, Eurostat B5 Management of statistical data and metadata.
CountryData SDMX for Development Indicators Metadata in DevInfo: Creation, Mapping and Registration.
Overview of SDMX: Statistical Data and Metadata eXchange Technical and Content Standards for Statistical Data Ann McPhail, Division Chief Statistics Department,
Implementation of SDMX for data and metadata exchange SDMX Basics Course 12 April 2013 Daniel Suranyi Eurostat B5 Management of statistical data and metadata.
Implementing SDMX within Morocco’s Statistical Data Base (BDS) BY Mr. Houssam EL OUINKHIR : Computer developer and DBA oracle 1 UNSD-DFID Project:
13-Jul-07 Implementation of SDMX for data and metadata exchange Balance of Payments Working Group 2-3 April 2012 Daniel Suranyi Eurostat B5 Management.
Eurostat 1 7a. Practical use case 1: Pesticides Use Project Blanaru Cristina Eurostat Unit B5: “Central data and metadata services” SDMX Basics course,
Eurostat 6. SDMX: A non-technical overview of the SDMX architecture and IT tools 1 Raynald Palmieri Eurostat Unit B5: “Central data and metadata services”
Eurostat achievements and challenges Emanuele Baldacci, Director European Commission - Eurostat Director Methodology; Corporate statistical.
Eurostat SDMX and Global Standardisation Marco Pellegrino Eurostat, Statistical Office of the European Union Bangkok,
Eurostat 4. SDMX: Main objects for data exchange 1 Raynald Palmieri Eurostat Unit B5: “Central data and metadata services” SDMX Basics course, October.
SDMX IT Tools Introduction
2.An overview of SDMX (What is SDMX? Part I) 1 Edward Cook Eurostat Unit B5: “Central data and metadata services” SDMX Basics course, October 2015.
SDMX IN DATA COLLECTION AND DATA DISSEMINATION Workshop on Statistical Data Collection, Washington DC, 29 April - 1 May 2015.
SDMX IT Tools SDMX use in practice in NA
Eurostat 1.SDMX: Background and purpose 1 Edward Cook Eurostat Unit B5: “Central data and metadata services” SDMX Basics course, October 2015.
Implementation of SDMX for Balance of Payments Balance of Payments Working Group 9-10 April 2013 BP Daniel Suranyi Eurostat B5 Management of statistical.
Eurostat 6. SDMX: A non-technical overview of the SDMX architecture and IT tools 1 Raynald Palmieri Eurostat Unit B5: “Central data and metadata services”
IAEA International Atomic Energy Agency Implementing SDMX for Energy Domain: From Discussion to Actual Implementation and Testing Andrii Gritsevskyi Oslo.
Global data structure definitions
Progress Update MSIS: Bratislava, April 2005
Exchanging Reference Metadata using SDMX
Interoperable data formats: SDMX
SDMX Opportunities MED Meeting 14 May 2013 Daniel Suranyi Eurostat B5
The 6th SDMX Global Conference
Using SDMX structures to facilitate data reporting
SDMX: Enabling World Bank to automate data ingestion
SDMX for SDGs What it means for you
SDMX: A brief introduction
11. The future of SDMX Introducing the SDMX Roadmap 2020
Data collection of 2012: Data transmission standards and tools
SDMX Reference Infrastructure Introduction
SDMX Introduction and practical exercises
Disseminating statistics: Internet and Publications course
2. An overview of SDMX (What is SDMX? Part I)
Eurostat – Units E2, B5 Cristina BLANARU
SDMX Implementation for PESTICIDES
Ivana Đurović National Bank of Serbia Luxembourg, June 2015
2. An overview of SDMX (What is SDMX? Part I)
Workshop on ESA 2010 transmission programme – What and how?
Most important point of developments
Validation process and the IT tools used at KAS
Data Transmission Tools & Services EDAMIS, SDMX, Validation
SDMX: an Overview Abdulla Gozalov UNSD.
Statistical Information Technology
SDMX as basis for water data reporting
August Götzfried Eurostat unit B 4
SDMX for MDG Indicators
Generate SDMX files.
August Götzfried Eurostat unit B 4
SDMX Progress and implementation A. Götzfried, Unit B6
9. Practical use case 3: Pesticides Use Project
SDMX Implementation The National Accounts use case
1. SDMX: Background and purpose
European Statistical System Metadata Handler ESS MH (Super) Providers
5. SDMX: General input requirements
7. Introduction to the main SDMX objects for metadata exchange
Developing SDMX artefacts for data exchange, sharing and dissemination
14. SDMX: Global and regional implementation projects
SDMX: Frequently Asked Questions
Validation at Insee.
SDMX IT Tools SDMX Registry
SDMX IT building blocks
SDMX in AFRICA SDMX Roadmap th SDMX Global Conference
A non-statistical data exchange scenario
Presentation transcript:

SDMX: From Labour Force Department to the Statistical Database 7th SDMX Global Conference 16-19 September Budapest - Hungary SDMX: From Labour Force Department to the Statistical Database Houssam El Ouinkhir Kamel Gaanoun h.elouinkhir@hcp.ma k.gaanoun@hcp.ma

Statistical Database Created early 80s. Contains 900 indicators. Covers various themes: social, demographic and economic. Published under open data recommendations via this link: bds.hcp.ma (214 indicators published)

SDB updating mode LFS Data More than 170 LFS indicators, including quarterly and annual results both for urban and rural areas Generated from SPSS in an Excel format by the LFS department Sent regularly by email to the SDB unit All indicators are manually entered in the SDB by the SDB unit technicians if any update is needed, the same process is then repeated

The challenge Human error Time consuming Manual data entry Non standard input Excel format

The SDMX Solution Enable automatic SDB Update Mapping DSD SPSS 1 Construct DSD Mapping DSD SPSS 2 3 Generate SDMX file 4 Mapping DSD SDB 5 Enable automatic SDB Update

The SDMX Solution DSD No common LFS DSD was available at the time of the implementation Various sources were used : With respect of SDMX Guidelines (COG,DSD Design, Cross domains CL) SDMX Global Registry IMF SDMX Central EURO SDMX Registry HCP’s Specific code_lists Use of the Eurostat Data Structure Wizard (DSW) for DSD generation.

The SDMX Solution DSD

The SDMX Solution From SPSS to SDMX First solution : Generate Excel files from SPSS Convert to SDMX using Eurostat SDMX Converter Second solution : Generate XML file from SPSS Extract Dimensions from the XML Map to the DSD

The SDMX Solution SDB automatic update The SDB automatic update is enabled towards the following two steps: Mapping between SDB and Labor force DSD. Using mapping file and SDMX file to update the SDB. The SDB update is done by a python batch.

Conclusion SDMX allowed us to : Reduce human-error rate Save data-entry time Standardise the update Get ready to futur SDMX exchanges Even if : Learning/training consumes time DSD construction (especially for LF) isn’t straightforward Generalisation of the process to other operations should be studied (training, concepts complexity, DSD’s Availability…)

Houssam El Ouinkhir Kamel Gaanoun h.elouinkhir@hcp.ma k.gaanoun@hcp.ma THANKS Houssam El Ouinkhir Kamel Gaanoun h.elouinkhir@hcp.ma k.gaanoun@hcp.ma