(VIP-EDC) Point 6 of the agenda

Slides:

Advertisements

Similar presentations

1 SDMX Reference Infrastructure (SDMX-RI) Work in progress, status and plans Bengt-Åke Lindblad, Adam Wroński Eurostat Eurostat Unit B3 – IT and standards.

Advertisements

Stefania Bergamasco, Cecilia Colasanti An integrated approach to turn statistics into knowledge combining data warehouse, controlled vocabularies and advanced.

Semantic Web and Web Mining: Networking with Industry and Academia İsmail Hakkı Toroslu IST EVENT 2006.

Overview of Search Engines

1 Vision Infrastructure Project (VIP) Enhanced Dissemination Chain 2 nd SISAI meeting, June 2012 B4 – IT for statistical production Unit B5 – Management.

IAEA International Atomic Energy Agency Agenda item 2.6 INIS Collection Search 36 th Consultative Meeting of INIS Liaison Officers 4-5 October 2012, Vienna,

Using the SAS® Information Delivery Portal

Overview of SDMX: Statistical Data and Metadata eXchange Technical and Content Standards for Statistical Data Ann McPhail, Division Chief Statistics Department,

Presentation Outline (hidden slide) Technical Level: 100 Intended Audience: TDMs, ITPros, ITDMs, BI specialists Objectives (what do you want the audience.

University of Dublin Trinity College Localisation and Personalisation: Dynamic Retrieval & Adaptation of Multi-lingual Multimedia Content Prof Vincent.

1 Peter Fox Xinformatics 4400/6400 Week 11, April 16, 2013 Information Audit and dealing with Unstructured Information.

13-Jul-07 Implementation of SDMX for data and metadata exchange Balance of Payments Working Group 2-3 April 2012 Daniel Suranyi Eurostat B5 Management.

Project Methodology May 2, System Development Life Cycle Overview.

Interactive Statistical Data Portal & Open Data for Mauritius.

SDMX IT Tools SDMX Reference Infrastructure

Renovation of Eurostat dissemination chain

Reflection on graphical interfaces for illustrating European statistics UNECE Work Session on Statistical Dissemination and Communication May 2008.

IAEA International Atomic Energy Agency Implementing SDMX for Energy Domain: From Discussion to Actual Implementation and Testing Andrii Gritsevskyi Oslo.

European Monitoring Platform for Mapping of QoS and QoE

The Eurostat Metadata Handler Götzfried Eurostat (Head of Unit B6)

Statistical Information Systems Introducing SIS tool .Stat

Results from Essnet for SDMX WP7 PC-Axis SDMX Integration

Principles of Eurostat's dissemination strategy

Structural and reference metadata in the European Statistical System

The CVD Metadata Handler

Vision Infrastructure Project (VIP) Enhanced Dissemination Chain

Implementing the ESS Vision 2020

European Statistical Week Going public: data dissemination Celia Santos and Chris Laevaert Unit B6– Dissemination 23 October 2012.

Marek Šturc European Commission - Eurostat

DIME ITDG, Luxembourg 28 June 2016

Usage of National Reference Metadata Editor (NRME)

The Vision Infrastructure Project “Enhanced Dissemination Chain”

SDMX Reference Infrastructure Introduction

Eurostat internet tools Point 17: DWG 15-16th April 2010

Disseminating regional and urban statistics The new visualisation tool of Eurostat Teodora Brandmüller Unit E4 Regional statistics and geographical information.

Working Group on Population and Housing Censuses

The European Statistical System

Country Specific Notes Agenda point 11

The new metadata structure & Country Specific Notes

Task force for the strategic project on the development & use of common ESS tools and services for dissemination Luxembourg 23 & 24/05/2013 Marc Vanderperren,

2. An overview of SDMX (What is SDMX? Part I)

Eurostat – Units E2, B5 Cristina BLANARU

2. An overview of SDMX (What is SDMX? Part I)

SDMX Tools Overview and architecture

Giuliano Amerini Unit E6 (Transport)

Eurostat Internet tools Unit D4

Report on Dissemination B.Le Goff Unit D4

Implementation of a more efficient way of collecting data SBS: electronic data collection Statistics Belgium.

ESS VIP ICT Project Task Force Meeting 5-6 March 2013.

ESS VIP programme: Cross-cutting project on ESS data warehouses for production and dissemination John Allen Agenda point 5 Dissemination Working Group.

Renovation of the Eurostat dissemination chain & Reusable solution for the dissemination of statistics Dissemination Working Group Agenda Point 11 15/11/2017.

Report On Free dissemination

Vision Infrastructure Project (VIP) Enhanced Dissemination Chain

X-DIS project: final report

Towards a new tool for seasonal adjustments: Demetra+

A review of the 2011 census round in the EU, including the successful implementation of a detailed European legal base First meeting of the Technical Coordination.

Item of the Agenda Towards an integrated Eurostat metadata handler – Eurostat SDMX Registry services for Member States Francesco Rizzo Unit B3 13.

Information. Knowledge. Decision

“Enhanced Dissemination Chain”

SDMX Progress and implementation A. Götzfried, Unit B6

Eurostat dashboards Luxembourg 23 & 24/05/2013

Streamlining statistical production

Reportnet 3.0 Database Feasibility Study – Approach

Strategic project on the development and use of common ESS tools and services for dissemination Point 10 of the agenda Marc Vanderperren Eurostat B6: Dissemination.

Metadata on quality of statistical information

M. Henrard, B5 N. Buysse and H. Linden, B6 Eurostat

Needs of Data Journalists

Eurostat Unit B3 – IT and standards for data and metadata exchange

Widgets and Statistics Illustrated

Presentation transcript:

(VIP-EDC) Point 6 of the agenda Marc Vanderperren Eurostat B6: Dissemination Marc.Vanderperren@ec.europa.eu

Motivations for running the project … Increase stability & reliability Extend the Eurostat dissemination chain to the ESS Meet needs of Eurostat production units and of users for improvements in dissemination Dissemination Working Group 17-18/10/2013

Motivations for running the project … Increase stability & reliability Extend the Eurostat dissemination chain to the ESS Meet needs of Eurostat production units and of users for improvements in dissemination Dissemination Working Group 17-18/10/2013

Motivations for running the project … Increase stability & reliability Extend the Eurostat dissemination chain to the ESS Meet needs of Eurostat production units and of users for improvements in dissemination Dissemination Working Group 17-18/10/2013

Project context 1 2 3 4 Actions Deliverables Development towards a Eurostat / ESS data warehouse Strategy (context: enterprise architecture) Checking algorithms in Eurobase 2 Simplification and integration of the Eurostat Dissemination Chain ESTAT Dissemination Processes Impact Manager Possible direct connection betw. Data Explorer & Eurobase 3 More functionality for producing and disseminating Eurostat policy indicators New production line for indicator tables Flexible dashboards for policy indicators 4 More integration of Eurostat data and metadata in NSI dissemination Embeddable visualisation tool SDMX-compliant web services Dissemination Working Group 17-18/10/2013

Concepts & feasibility studies Results Concepts & feasibility studies Visualisation tools Services & support Dissemination Working Group 17-18/10/2013

Concepts & feasibility studies Results Concepts & feasibility studies Visualisation tools Services & support Dissemination Working Group 17-18/10/2013

Dissemination Working Group Results Visualisation tools Dissemination Working Group 17-18/10/2013

Project context NSI Development towards a Eurostat / ESS data warehouse Simplification and integration of the Eurostat Dissemination Chain More functionality for producing and disseminating Eurostat policy indicators NSI More integration of Eurostat data and metadata in NSI dissemination Embeddable visualisation tool Dissemination Working Group 17-18/10/2013

Dissemination Working Group Visualisation tools Simple visualisation tools to be embedded in any website Dissemination Working Group 17-18/10/2013

Dissemination Working Group Visualisation tools Dissemination Working Group 17-18/10/2013

Dissemination Working Group Visualisation tools Widgets Dissemination Working Group 17-18/10/2013

Dissemination Working Group Widgets Data Dissemination Working Group 17-18/10/2013

Dissemination Working Group Widgets Data Dissemination Working Group 17-18/10/2013

Dissemination Working Group Widgets Dynamic Dissemination Working Group 17-18/10/2013

Dissemination Working Group Widgets Mobility Dissemination Working Group 17-18/10/2013

Dissemination Working Group Widgets Link + action (e.g. sharing content) Dissemination Working Group 17-18/10/2013

Dissemination Working Group Widgets Simple visualisation components To be embedded in any website Dissemination Working Group 17-18/10/2013

Dissemination Working Group 17-18/10/2013

Dissemination Working Group 17-18/10/2013

Dissemination Working Group Results Visualisation tools Dissemination Working Group 17-18/10/2013

Project context Development towards a Eurostat / ESS data warehouse Simplification and integration of the Eurostat Dissemination Chain More functionality for producing and disseminating Eurostat policy indicators Flexible dashboards for policy indicators More integration of Eurostat data and metadata in NSI dissemination Dissemination Working Group 17-18/10/2013

Dissemination Working Group Flexible dashboards Creation and publication of statistical data dashboards Visual representations and explanations Dissemination Working Group 17-18/10/2013

Dissemination Working Group Before … Needs & features Use cases Software Development Technical testing Functional testing Acceptance testing Packaging & delivery Dissemination Working Group 17-18/10/2013

Dissemination Working Group Before … Needs & features Use cases Software Development Technical testing Functional testing Acceptance testing Packaging & delivery Finally there ! Dissemination Working Group 17-18/10/2013

Settings definitions & composition After What data? Which visualisation components? Settings definitions & composition Dissemination Working Group 17-18/10/2013

Settings definitions & composition After What data? Which visualisation components? Settings definitions & composition Already there ! Dissemination Working Group 17-18/10/2013

Settings definitions & composition Flexible dashboard What data? Which visualisation components? Settings definitions & composition Already there ! Dissemination Working Group 17-18/10/2013

Dissemination Working Group Flexible dashboards At Eurostat, decentralised set up of visualisations IT development bottleneck is removed For end users, interactivity inside the dashboards Visualisations which can be used by a wide audience Dissemination Working Group 17-18/10/2013

Dissemination Working Group 17-18/10/2013

Dissemination Working Group 31 Dissemination Working Group 17-18/10/2013

Project context Development towards a Eurostat / ESS data warehouse Simplification and integration of the Eurostat Dissemination Chain More functionality for producing and disseminating Eurostat policy indicators Flexible dashboards for policy indicators More integration of Eurostat data and metadata in NSI dissemination Embeddable visualisation tool Dissemination Working Group 17-18/10/2013

Project context Development towards a Eurostat / ESS data warehouse Simplification and integration of the Eurostat Dissemination Chain More functionality for producing and disseminating Eurostat policy indicators REST web services for fully automated data delivery More integration of Eurostat data and metadata in NSI dissemination Dissemination Working Group 17-18/10/2013

Dissemination Working Group Results Services & support Dissemination Working Group 17-18/10/2013

Project context Development towards a Eurostat / ESS data warehouse Simplification and integration of the Eurostat Dissemination Chain ESTAT Dissemination Processes Impact Manager More functionality for producing and disseminating Eurostat policy indicators More integration of Eurostat data and metadata in NSI dissemination Dissemination Working Group 17-18/10/2013

Dissemination Working Group EDPIM Simple (to use) application monitoring the functioning and performance of the Eurostat Dissemination Chain and other dissemination systems (e.g. Eurostat website) Dissemination Working Group 17-18/10/2013

Eurostat Dissemination Chain Dissemination Working Group 17-18/10/2013

Dissemination Working Group Problem statement Many systems Many state changes Multiple sources of information … & formats Deep knowledge & multiple skills requirements Time to reaction, impacts on business processes Expertise Dissemination Working Group 17-18/10/2013

Dissemination Working Group Problem statement Many systems Many state changes Multiple sources of information … & formats Deep knowledge & multiple skills requirements Time to reaction, impacts on business processes Expertise Dissemination Working Group 17-18/10/2013

Dissemination Working Group EDPIM Monitor & Control Access processing information Share information & knowledge Users (operations) Steps Availability Systems & components Assess impacts Business processes Dissemination Working Group 17-18/10/2013

Dissemination Working Group Purpose Collect continuously data processing & systems information … Detect & scan dissemination chain "events" Assess potential impacts on business processes Identify & manage dissemination chain "incidents" Report & alert when relevant Dissemination Working Group 17-18/10/2013

Dissemination Working Group 17-18/10/2013

Dissemination Working Group 17-18/10/2013

Dissemination Working Group 17-18/10/2013

Dissemination Working Group Purpose One shared tool to keep the overview of the dissemination chain Knowledge sharing, support for operational decision making Dissemination Working Group 17-18/10/2013

Services Development towards a Eurostat / ESS data warehouse Checking algorithms in Eurobase Simplification and integration of the Eurostat Dissemination Chain More functionality for producing and disseminating Eurostat policy indicators More integration of Eurostat data and metadata in NSI dissemination Dissemination Working Group 17-18/10/2013

Checking algorithms in Eurobase Ex-post data quality controls offered as a service to Domain Managers Dissemination Working Group 17-18/10/2013

Services Development towards a Eurostat / ESS data warehouse Simplification and integration of the Eurostat Dissemination Chain More functionality for producing and disseminating Eurostat policy indicators New production line for indicator tables More integration of Eurostat data and metadata in NSI dissemination Dissemination Working Group 17-18/10/2013

New production line for indicator tables Based on Eurobase functionalities, new production line is an additional option to create derived indicators New indicators can be made available faster Dissemination Working Group 17-18/10/2013

Services Development towards a Eurostat / ESS data warehouse Simplification and integration of the Eurostat Dissemination Chain More functionality for producing and disseminating Eurostat policy indicators More integration of Eurostat data and metadata in NSI dissemination SDMX-compliant web services Dissemination Working Group 17-18/10/2013

Dissemination Chain Systems Data visualisation tools Data extraction tools Dissemination Working Group 17-18/10/2013

Dissemination Chain Systems Data Explorer, Tables Graphs & Maps, … Data visualisation tools Data extraction tools Data Explorer, Tables Graphs & Maps, … Dissemination Working Group 17-18/10/2013

Dissemination Chain Systems Bulk download / NavTree Data visualisation tools Data extraction tools Bulk download / NavTree Dissemination Working Group 17-18/10/2013

Dissemination Chain Systems Bulk download / NavTree Data visualisation tools Data extraction tools Bulk download / NavTree web service Dissemination Working Group 17-18/10/2013

Dissemination Chain Systems Data visualisation tools Data extraction tools Bulk download / NavTree Dissemination Web Service Dissemination Working Group 17-18/10/2013

Data retrieval process Identify data Navigation Tree (search database) RSS feed Get list of available datasets http://epp.eurostat.ec.europa.eu/portal/page/portal/statistics/search_database http://ec.europa.eu/eurostat/SDMX/diss-web/en/rss.rss http://ec.europa.eu/eurostat/SDMX/diss-web/rest/dataflow/ESTAT/all/latest Dissemination Working Group 17-18/10/2013

Data retrieval process Identify data Retrieve DSD http://www.ec.europa.eu/eurostat/SDMX/diss-web /rest/datastructure/ESTAT/DSD_prc_hicp_midx/latest Dissemination Working Group 17-18/10/2013

Data retrieval process Identify data Retrieve DSD Retrieve Data http://www.ec.europa.eu/eurostat/SDMX/diss-web /rest/data/prc_hicp_midx/..CP00.EU+DE+FR Dissemination Working Group 17-18/10/2013

Project context 1 2 3 4 Actions Deliverables Development towards a Eurostat / ESS data warehouse Strategy (context: enterprise architecture) Checking algorithms in Eurobase 2 Simplification and integration of the Eurostat Dissemination Chain ESTAT Dissemination Processes Impact Manager Possible direct connection betw. Data Explorer & Eurobase 3 More functionality for producing and disseminating Eurostat policy indicators New production line for indicator tables Flexible dashboards for policy indicators 4 More integration of Eurostat data and metadata in NSI dissemination Embeddable visualisation tool SDMX-compliant web services Dissemination Working Group 17-18/10/2013

(VIP-EDC) Point 6 of the agenda Marc Vanderperren Eurostat B: Dissemination Marc.Vanderperren@ec.europa.eu