ESS VIP ICT Project Mapping Assistant in use (ICT domain)

Slides:



Advertisements
Similar presentations
ESSnet on SDMX phase II Laura Vignola ISTAT Rome, 3-4 December 2012.
Advertisements

WP.5 - DDI-SDMX Integration
WP.5 - DDI-SDMX Integration E.S.S. cross-cutting project on Information Models and Standards Marco Pellegrino, Denis Grofils Eurostat METIS Work Session6-8.
Survey Data Management and Combined use of DDI and SDMX DDI and SDMX use case Labor Force Statistics.
DATA PORTAL SDMX Training BANK INDONESIA SEPTEMBER 2015 YOGYAKARTA, INDONESIA.
Restricted Views expressed are those of the presenter and not necessarily those of the BIS 1 Building a Data Portal with SDMX The BIS SDMX Sandbox exercise.
SDMX AND DATA DISSEMINATION SDMX Training BANK INDONESIA SEPTEMBER 2015 YOGYAKARTA, INDONESIA.
1 Meeting on the Management of Statistical Information Systems (MSIS 2010) SDMX architecture for data sharing and interoperability Francesco Rizzo, ISTAT,
Eurostat B.4 Enhancements Implemented SDMX RI User Group Luxembourg, September 2013.
Eurostat 6. SDMX: A non-technical overview of the SDMX architecture and IT tools 1 Raynald Palmieri Eurostat Unit B5: “Central data and metadata services”
Eurostat 4. SDMX: Main objects for data exchange 1 Raynald Palmieri Eurostat Unit B5: “Central data and metadata services” SDMX Basics course, October.
2.An overview of SDMX (What is SDMX? Part I) 1 Edward Cook Eurostat Unit B5: “Central data and metadata services” SDMX Basics course, October 2015.
Eurostat SDMX Reference Infrastructure: Tools demonstration November 2015 Eurostat Unit B3 – IT and standards for data and metadata exchange Jean-Francois.
1 The EDIT System, Overview European Commission – Eurostat.
SDMX IT Tools SDMX use in practice in NA
7b. SDMX practical use case: Census Hub
Eurostat November 2015 Eurostat Unit B3 – IT and standards for data and metadata exchange SDMX IT Tools SDMX Converter Jean-Francois LEBLANC Christian.
Eurostat Report on SDMX Reference Infrastructure User Group 1 st meeting in Luxembourg Sept 2012 Item 5.2 of the agenda November 2012IT Director's.
Eurostat 6. SDMX: A non-technical overview of the SDMX architecture and IT tools 1 Raynald Palmieri Eurostat Unit B5: “Central data and metadata services”
Eurostat Mapping Assistant May 2016 Eurostat, Unit B3 – IT solutions for statistical production Jean-Francois LEBLANC Christian SEBASTIAN 1.
Eurostat May 2016 Eurostat, Unit B3 – IT solutions for statistical production Test Client Jean-Francois LEBLANC Christian SEBASTIAN.
IAEA International Atomic Energy Agency Implementing SDMX for Energy Domain: From Discussion to Actual Implementation and Testing Andrii Gritsevskyi Oslo.
ONS API Progress / Plans July 2010 Census Web Services Working Group.
B.6 Roadmap 2013 – 2014 SDMX RI User Group Luxembourg, September 2013.
Building a Data Portal with SDMX
Jeremiah Insights for ArcGIS Jeremiah
The evolution of the SDMX infrastructure and services
SDMX Opportunities MED Meeting 14 May 2013 Daniel Suranyi Eurostat B5
SDMX: Enabling World Bank to automate data ingestion
Usage of National Reference Metadata Editor (NRME)
11. The future of SDMX Introducing the SDMX Roadmap 2020
(VIP-EDC) Point 6 of the agenda
SDMX Reference Infrastructure Introduction
Working Group on Population and Housing Censuses
Task force for the strategic project on the development & use of common ESS tools and services for dissemination Luxembourg 23 & 24/05/2013 Marc Vanderperren,
Jean-Francois LEBLANC Christian SEBASTIAN
2. An overview of SDMX (What is SDMX? Part I)
2. An overview of SDMX (What is SDMX? Part I)
SDMX Tools Architecture
SDMX Reference Infrastructure
Statistical Data and Metadata eXchange (SDMX)
Workshop on ESA 2010 transmission programme – What and how?
Communications & Computer Networks Resource Notes - Introduction
Task Force on Annual Financial Accounts
Ioannis Xirouchakis / Unit B3
SDMX Tools Overview and architecture
ESTP WORKSHOP ON SDMX IN NATIONAL ACCOUNTS
SDMX as basis for water data reporting
Practical use cases of SDMX: Census Hub
ESS VIP ICT Project Task Force Meeting 5-6 March 2013.
Generate SDMX files.
Ioannis Xirouchakis / Unit B3
Census Hub: current plans and timetable
Working Group "Education and Training Statistics" April 2013
9. Practical use cases of SDMX: Census Hub
What Kind of Data Structures do we Work on?
SDMX IT Tools SDMX use in practice in NA
2nd SISAI meeting Luxembourg, June 2012
X-DIS project: progress report Leonhard Maqua, Unit B3
Jean-Francois LEBLANC Christian SEBASTIAN
Eurostat Unit B3 – IT and standards for data and metadata exchange
Eurostat Unit B3 – IT and standards for data and metadata exchange
Eurostat Unit B3 – IT and standards for data and metadata exchange
7. Introduction to the main SDMX objects for metadata exchange
SDMX: Frequently Asked Questions
Standardizing and industrializing a business process – the dissemination use case Alessio Cardacino - ESTP Course “Information standards.
SDMX IT building blocks
Jean-Francois LEBLANC Christian SEBASTIAN
Presentation transcript:

ESS VIP ICT Project Mapping Assistant in use (ICT domain) Task Force Meeting 5-6 March 2013

Facilitate the use of SDMX-RI 1. Dissemination database 2. Mapping Store 3. Web Service Provider (SDMX-RI) 4. Mapping Assistance

Dissemination database* Scenario 1: use the same data base as for the Census test purposes PROS no database instance need to be created existing users and connections can be reused; CONS internal impact (on data access) * hardware/performance

Dissemination database* Scenario 2: use different database PROS complete independence from the Census CONS database instance need to be created; users and connections need to be defined; Recommendations: if you are using the dissemination database for test purposes reuse the already existing set up (Scenario 1) for the pilot (ICT/Census) * hardware/performance

Mapping Store* Scenario 1: Use new Mapping store PROS Complete independence from the Census 2011 domain Can update and test it independently from the Census domain CONS New instance of the Web Service need to be deployed Mapping store instance need to be created Users and connections need to be defined * hardware/performance

Mapping Store* Scenario 2: Use the same mapping store as for the Census Hub PROS No need to install a new Web Service instance Existing mapping store instance will be reused Existing users and connections will be reused CONS The same end point is going to be used for Census and ICT data It is not independent from the Census 2011 domain Cannot update and test it independently from the Census domain NB! Scenario 2 is applicable only for test/pilot environment * hardware/performance

Web Service* Scenario 1: Install a new Web service instance PROS Complete independence from the Census 2011 domain Can update and test it independently from the Census domain CONS New instance of the Web Service need to be deployed Configuration to be done (mapping store – existing or new) * hardware/performance

Web Service* Scenario 2: Use existing Web service instance (Census Hub) PROS No need to deploy a new instance of the Web Service Existing configuration can be reused Only valid for existing mapping store CONS No independence from the Census 2011 domain not possible to update/test * hardware/performance

Mapping Assistant (1) Mapping Assistant with a new mapping store (Step 1 to 9) Mapping Assistant with an existing (census test) mapping store (Step 3 to 9)

Mapping Assistant (2) Step 1*: create a new Mapping Store with required permissions (or ask your local database administrator) Step 2*: connect from the Mapping Assistant to the new Mapping Store and the Dissemination database * Only for a new mapping store

Mapping Assistant (3) Step 3: Load the ICT category scheme in the Mapping Assistant Step 4: Load the ICT concept scheme in the Mapping Assistant Step 5: Load the codelist files in the Mapping Assistant Step 6: Load the DSD file in the mapping Assistant Step 7: Load the DataFlow file in the Mapping Assistant

Mapping Assistant (4) Step 8: define a dataset Link the dataset to several dataflows * OR make a dataset per dataflow Step 9: define a mapping set ** * useful to store data in one data table ** use copy functionality to copy the same mapping for different dataflows

Mapping Assistant reusing the existing (census test) Mapping store How to proceed Step 1: Load the ICT category scheme in the Mapping Assistant Step 2: Load the ICT concept scheme in the Mapping Assistant Step 3: Load the codelist files in the Mapping Assistant Step 4: Load the DSD file in the mapping Assistant Step 5: Load the DataFlow file in the Mapping Assistant

Mapping Assistant reusing the existing (census test) Mapping store How to proceed Step 6: define a dataset Link the dataset to several dataflows * OR make a dataset per dataflow Step 7: define a mapping set ** * useful to store data in one data table ** use copy functionality to copy the same mapping for different dataflows