Presentation of Project Joint meeting of the ESS.VIP.BUS ICT Project

Slides:



Advertisements
Similar presentations
23-25/5/2011 Modernisation of ESS infrastructure: The ESS instruments - a review E. di Meglio – P. Jacques – J.M. Museux.
Advertisements

ESS VIP project on Validation
International Seminar on Modernizing Official Statistics:
The European Statistical System Vision Infrastructure Programme Daniel Defays, Director Directorate B, Eurostat Eurostat Workshop on the Modernisation.
ESS-VIP ICT Project ESSnet Workshop, Rome, 3-4 December 2012.
WP.5 - DDI-SDMX Integration
WP.5 - DDI-SDMX Integration E.S.S. cross-cutting project on Information Models and Standards Marco Pellegrino, Denis Grofils Eurostat METIS Work Session6-8.
Implementing ESS standards for reference metadata and quality reporting at Istat Work Session on Statistical Metadata Topic (i): Metadata standards and.
SDMX and DDI Working Together Technical Workshop 5-7 June 2013
Development of metadata in the National Statistical Institute of Spain Work Session on Statistical Metadata Genève, 6-8 May-2013 Ana Isabel Sánchez-Luengo.
Eurostat Expression language (EL) in Eurostat SDMX - TWG Luxembourg, 5 Jun 2013 Adam Wroński.
Metadata driven application for data processing – from local toward global solution Rudi Seljak Statistical Office of the Republic of Slovenia.
Francesco Rizzo (ISTAT - Italy) Stefano De Francisci (ISTAT – Italy) An integration approach for the Statistical Information System of Istat using SDMX.
07-08/6/2011 Methodological and IT innovation mechanisms in the ESS- a review E. di Meglio – P. Jacques – J.M. Museux Unit B2 : Methodology & Research.
ESS-VIP ICT Project Work Package III Task Force Meeting, Luxembourg, 5 March 2013.
Work Session on Statistical Metadata 2013 Session III: Metadata in the Statistical Business Process Better documenting statistical business processes:
Eurostat Report on SDMX Reference Infrastructure User Group 1 st meeting in Luxembourg Sept 2012 Item 5.2 of the agenda November 2012IT Director's.
From Intrastat to SIMSTAT and ESS.VIP Programme ESTAT Walter Radermacher.
Validation Architecture in the ESS CSPA Workshop, Geneva June 2016 Geneva June 2016 Eurostat, Vincent TRONET, Unit B1.
Quality declarations Study visit from Ukraine 19. March 2015
UNECE-CES Work session on Statistical Data Editing
The ESS vision, ESSnets and SDMX
Structural and reference metadata in the European Statistical System
ESS-VIP ICT Project Task Force Meeting, Luxembourg, 5 March 2013.
Implementing the ESS Vision 2020
ESTP TRAINING ON EGR Luxembourg – December 2014
ESS VIP-ESBRs European System of interoperable statistical Business Registers 2012 ESSnet Workshop, Rome  3-4 December 2012 Eurostat.
Warehouse approach: reusing data
Rolling Review of Education Statistics
The ESS.VIP Programme: an update
The ESS VIP programme: a response to the challenges facing the ESS
Eurostat – Unit E2 Arturo de la Fuente
ESS Vision 2020: ESS.VIP Validation
Eurostat – Units E2, B5 Cristina BLANARU
Joint meeting of the ESS.VIP.BUS ICT Project
Draft EP/Council Regulation for processes, standards and
Opinions after the 24/25 February 2016 Plenary
Ioannis Xirouchakis / Unit B3
Agenda Item 2.1 SES 2014: follow-up
EGR and BR ESS work and plans
ESS.VIP VALIDATION An ESS.VIP project for mutual benefits
Giuliano Amerini Unit E6 (Transport)
ITDG meeting of of October 2011
August Götzfried Eurostat unit B 4
ESS VIP ICT Project Task Force Meeting 5-6 March 2013.
Reference Manual update Item 6.2 of the agenda
ESS VIP programme: Cross-cutting project on ESS data warehouses for production and dissemination John Allen Agenda point 5 Dissemination Working Group.
Education and Training Statistics Working Group – 2-3 June 2016
Point 6. Eurostat plans for Time Use Survey data processing and dissemination Working Group on Time Use Surveys 10 April 2013.
Draft EP/Council Regulation on processes, standards and metadata for the exchange and dissemination of European statistics A. Götzfried Head of.
Agenda Item 3.1 Labour Cost Survey 2016
SISAI STATISTICAL INFORMATION SYSTEMS ARCHITECTURE AND INTEGRATION
Ioannis Xirouchakis / Unit B3
Mapping Data Production Processes to the GSBPM
Agenda item 5.3 EHIS - Implementing Regulation
ESS.VIP Validation Item 5.1
Legislative strategy for cross-cutting ESS legislation
Streamlining statistical production
European Census Hub: a cooperation model for dissemination of EU statistics Paper prepared by Ioannis Xirouchakis Presentation: Christine WIRTZ, Eurostat.
Metadata on quality of statistical information
Business architecture
Joint meeting of the ESS.VIP.BUS ICT Project
Work Session on Statistical Metadata (Geneva, Switzerland May 2013)
Modernisation of Validation in the ESS Collaboration with countries
European Statistical System Metadata Handler ESS MH (Super) Providers
ESS Vision and VALIDATION
SILC draft implementing and delegated acts Item 3.4 of the agenda
5. SDMX: General input requirements
The ESS quality reporting implementation process
Presentation transcript:

Presentation of Project Joint meeting of the ESS.VIP.BUS ICT Project and the ESS.VIP IT TF Luxembourg, 3 March 2014 Daniel Rase / Unit G4

The origin of the project (1) Information Society statistics are collected on the basis of a Framework Regulation There are two processes implementing the surveys described in the document: Enterprise and Household Aggregated data is sent by MS for enterprises and micro data is sent for households The production processes of G4 are good examples of the 'stovepipe' model and of 'mainstream' processes Data is collected using formatted files (EXCEL,CSV), validation and calculations are made with JAVA applications using Access and Oracle databases

The origin of the project (2) Advantages of this approach: Solution tailor made and flexible (40% change in variables each year) JAVA based validation program easy to install in MS Disadvantages: Duplication of work in ESTAT units Solution is not 'corporate' Production dependent on one IT specialist in the unit (high risk for business continuity) Solution is not making use of standards (i.e. SDMX for data and metadta transfer) Discussions between Dir B and Dir G lead us to the conclusion that ICT was a good business case for an ESS VIP project The ICT statistics production processes are very representative of other mainstream processes in Eurostat. Moreover, the ICT project is covering all the aspects of the value chain from data collection to dissemination, including aggregated data and micro data treatment. However, the nature of the ICT domain requires a very flexible approach. Every year, almost 40 % of the variables are changing in order to follow the continuous developments in the field. In addition, ICT is one of the few domain for which data is collected and published the same year. It is therefore a very challenging use case.

The ESS VIP.BUS project (1) Project scope In a narrow sense, the purpose of ICT is to reengineer the production and dissemination processes of ICT statistics In a broader sense, ICT should generalise the proposed solutions to establish a generic approach to statistical data production and at ESS level Expected benefits Industrialisation of the production and dissemination process Flexibility based on service oriented architecture Smart use of data and metadata exchange formats Higher quality Development of shareable services (validation, …) Faster and flexible dissemination according to user needs

The ESS VIP.BUS project (2) Original planning Phase Duration Activity Phase I.1 01/13-02/13 Analysis and documentation of processes. Phase I.2 03/13-12/13 Methodological study on data models, data transmission and confidentiality issues for aggregate data and micro-data. Phase I.3 06/13-12/13 Prototype for dissemination of aggregate data (Enterprise survey) Phase I.4 Drafting of guidelines to generalise the solutions proposed Phase II.1 01/14-12/14 Building up of a prototype for a new production system of ICT statistics based on aggregated data Phase III 01/15-12/15 Implementation of the new production process for Enterprise survey in Member States Phase IV.1 01/15-12/16 Building up of a prototype for a new production system of ICT statistics based on micro-data (Household survey) Phase IV.2 06/16-12/16 Drafting of guidelines to generalise the solutions proposed for micro-data Phase IV.3 01/17-12/17 Implementation of the new production process for Household survey in Member States The original planning proposed a phased approach, each of them adding complexity to the previous one. Originally, the two first years were dedicated to the reengineering of the ‘Enterprise’ survey production process. In phase III (2015), it was planned to put the new solution for enterprises into production. After that, it was planned to tackle the modernization of the ‘Household’ process to be put in production in 2017.

The ESS VIP.BUS project-Phase I Two parallel strands in 2013 Prototype for DISSEMINATION of aggregated data from Enterprise survey using the SDMX standard Methodological study to reflect on data models, data transmission, processing and data confidentiality of aggregate and micro-data

Thank you for your attention! Contact: Daniel.Rase@ec.europa.eu Unit G4, Eurostat