Using SDMX structures to facilitate data reporting

Slides:



Advertisements
Similar presentations
Archiving Trevor Croft MICS3 Data Archiving, Dissemination and Further Analysis Workshop Geneva - November 6th, 2006.
Advertisements


CESSDA Question Databank Tender, results and future Maarten Hoogerwerf, CESSDA expert seminar 2009.
Africa Information Highway and SDMX implementation in Africa Beejaye Kokil Economic & Social Statistics Division African Development Bank
Survey Data Management and Combined use of DDI and SDMX DDI and SDMX use case Labor Force Statistics.
International Conference on Millennium Development Goals Statistics (ICMDGS) Dusit Thani Hotel, Manila, Philippines October 2011 IMPROVING THE COLLATION,
Situation of ANA data and metadata in 2008 Transmission to the OECD : progress report.
ILO Department of Statistics Edgardo Greising
Model and Representations
Eurostat 6. SDMX: A non-technical overview of the SDMX architecture and IT tools 1 Raynald Palmieri Eurostat Unit B5: “Central data and metadata services”
Eurostat 4. SDMX: Main objects for data exchange 1 Raynald Palmieri Eurostat Unit B5: “Central data and metadata services” SDMX Basics course, October.
SDMX IT Tools Introduction
2.An overview of SDMX (What is SDMX? Part I) 1 Edward Cook Eurostat Unit B5: “Central data and metadata services” SDMX Basics course, October 2015.
Edgardo Greising MSIS 2013 – International Organizations Session.
SDMX IT Tools SDMX use in practice in NA
7b. SDMX practical use case: Census Hub
Eurostat 6. SDMX: A non-technical overview of the SDMX architecture and IT tools 1 Raynald Palmieri Eurostat Unit B5: “Central data and metadata services”
UNEP Live. What is UNEP Live? - An on-line knowledge management platform - Focuses on open access to global, regional and national data and knowledge.
IAEA International Atomic Energy Agency Implementing SDMX for Energy Domain: From Discussion to Actual Implementation and Testing Andrii Gritsevskyi Oslo.
DDI and GSIM – Impacts, Context, and Future Possibilities
Outline Purpose of IMIS Features of IMIS
System Overview Training on the use of the new countrystat
SDMX for SDG Indicators
Global data structure definitions
Metadata Standards for Statistical Classifications
Interoperable data formats: SDMX
SDMX Opportunities MED Meeting 14 May 2013 Daniel Suranyi Eurostat B5
SDMX Information Model
TRAINING OF FOCAL POINTS ON THE CountrySTAT/FENIX SYSTEM
System Overview Training on the use of the new countrystat
SDMX: Enabling World Bank to automate data ingestion
SDMX for SDG Indicators
Generic Statistical Business Process Model (GSBPM)
SDMX for SDGs What it means for you
SDMX: A brief introduction
Data collection of 2012: Data transmission standards and tools
SDMX Introduction and practical exercises
2. An overview of SDMX (What is SDMX? Part I)
2. An overview of SDMX (What is SDMX? Part I)
SDMX Tools Architecture
Workshop on ESA 2010 transmission programme – What and how?
SDMX in Statistical Information System, INS TUNISIA
LOD reference architecture
SDMX in the S-DWH Layered Architecture
SDMX: an Overview Abdulla Gozalov UNSD.
SDMX Tools Overview and architecture
Statistical Information Technology
ESS VIP ICT Project Task Force Meeting 5-6 March 2013.
Education and Training Statistics Working Group – 2-3 June 2016
SDMX : General introduction H. Linden, Eurostat, Unit B5
Introduction to Dataflows in Power BI
SDMX IT Tools SDMX use in practice in NA
SDMX Implementation The National Accounts use case
1. SDMX: Background and purpose
DDI and GSIM – Impacts, Context, and Future Possibilities
Eurostat Unit B3 – IT and standards for data and metadata exchange
Developing SDMX artefacts for data exchange, sharing and dissemination
14. SDMX: Global and regional implementation projects
Standardizing and industrializing a business process – the dissemination use case Alessio Cardacino - ESTP Course “Information standards.
SDMX at the International Labour Organization
Integrated Statistical Production System WITH GSBPM
SDMX IT building blocks
SDMX in AFRICA SDMX Roadmap th SDMX Global Conference
Palestinian Central Bureau of Statistics
SDMX: From Labour Force Department to the Statistical Database
SDMX for Sustainable Development Goals Indicators: The Way Forward
A non-statistical data exchange scenario
“Argentina´s first steps in SDMX”
Presentation transcript:

Using SDMX structures to facilitate data reporting ILO Department of Statistics

@ SDMX at the ILO ILOSTAT SMART ILO Department of Statistics WESO Dashboard ILOSTAT Excel Add-ins ILOSTAT Data Publisher (for .Stat) ILOSTAT Country Profiles (Desktop and Mobile Apps) Global Artefacts for Labour, Prices Indices and SDG ILOSTAT DataMapper NEW DEVELOPMENTS (New ILOSTAT API & .Stat V7+) ILO Knowledge Management Gateway ILOSTAT SMART ILO Department of Statistics

Data Reporting Data reporting without a real SDMX architecture in place One year ago, during the “Meeting of Experts 2016” in Aguascalientes, MEX, we discussed during the Breakout Session 2 “How to design and build an SDMX Enterprise Architecture”. Amongst the three basic scenarios presented, the so called “Light” intended for data reporting only and without a real SDMX architecture in place, happened to be recognized as a quite common situation along data producers in developing countries. Many of them lack a central repository of indicators, and the information to be reported is “spread” inside the institution in a number of different formats and media. Some tools are available from the SDMX community to help initiating the data reporting in SDMX, like the SDMX-RI Mapping tools to generate a “PUSH” mode flow, or the SDMX Converter if no database where SDMX-RI can be plugged in. Nonetheless, quite often (just to make it a bit more difficult) the structure of the indicators calculated by the data producer for its internal use differs from the specification of the information to be reported which, for example, uses a different variant of a classification breakdown. In this case, the microdata needs to be re-processed to generate the outputs with the right structure. Questionnaires in Excel, require manual transcription of data (and metadata)  Experts won’t do this job. Questionnaires arrive late, when the survey has already been processed and published  Experts are likely to be engaged in another project. Breakdowns are different from those used at national level  Requires re-processing including new mappings Variables definitions may differ from those used at national level  Requires re-processing including new calculations Primary Statistical Activity ILO Department of Statistics

Data Reporting ILO Department of Statistics

ILOSTAT SMART ILOSTAT SMART SDMX Registry DSD Structural Metadata ILOSTAT SMART Dataset DATA REPORTING DATA CONVERSION Microdata ILOSTAT-ART is a free basic statistical processor that can compute statistical tables (reported indicators) defined by DSD’s, either by processing microdata sets or transcoding aggregate input data. It relies strongly on mappings between input variables and DSD's concepts, which can be saved and reused. This approach ensures the consistency of the output codes since they match the structure of the DSD. Different file formats can be processed (e.g. Stata, SPSS, csv, SDMX), and produces output “data packages” in Excel, csv or SDMX formats, ready to fulfil the data reporting requirements or feed a .Stat dissemination platform. LMIS UPLOAD LMI ANALYSIS Aggregated Data Dataset MAPPING ILO Department of Statistics

Why use ILOSTAT SMART? ILO Department of Statistics

ILOSTAT SMART Demo ILO Department of Statistics

ILOSTAT SMART facts No indicators’ database is required Tables defined dynamically via a DSD Selectable classifications’ versions and variants Flexible mapping Conditions applied on-the-fly to tally/sum/avg Mapping can be saved and re-used Multi-language ILO standard routines for derived variables (*) Stand alone + on line access to any SDMX registry Process microdata or aggregate datasets in Stata, SPSS, SDMX and csv Several output formats: .xls, pdf, csv, sdmx Desktop and Online(*) versions (*) Coming soon ILO Department of Statistics