Applying the ESS EARF in a VIP project: The ESS.VIP Validation example

Slides:



Advertisements
Similar presentations
Eurostat The ESS.VIP Validation and its implementation in waste statistics Q2014 – Session 13 4 June 2014 Hartmut Schrör, Eurostat.
Advertisements

ESS VIP project on Validation
International Seminar on Modernizing Official Statistics:
The European Statistical System Vision Infrastructure Programme Daniel Defays, Director Directorate B, Eurostat Eurostat Workshop on the Modernisation.
Background Data validation, a critical issue for the E.S.S.
Eurostat Expression language (EL) in Eurostat SDMX - TWG Luxembourg, 5 Jun 2013 Adam Wroński.
Addressing the challenge of producing European comparable data using administrative data Mihaela AGAFIŢEI Sorina VÂJU UNECE Seminar on Statistical Data.
ESS-VIP ICT Project Work Package III Task Force Meeting, Luxembourg, 5 March 2013.
Sponsorship on Standardisation Background and overview Daniel Defays Forwardlooking Feedback Workshop, The Hague, 30/31 May 2013.
Statistical data editing - UNECE work session – OSLO September 2012 Proposal of a revised approach for data validation within the European Statistical.
Item 5 of the Agenda of the DIME/ITDG SG 24 February 2015 ESS EA TF : Progress report Enterprise Architecture Reference Framework (ESS EA RF)
Enterprise Architecture Reference Framework Generalities
Eurostat Standardisation DIME-ITDG 2015 Item 6 DIME-ITDG February
1 Recent developments in quality related matters in the ESS High level seminar for Eastern Europe, Caucasus and Central Asia countries Claudia Junker,
ESS Enterprise Architecture Reference Framework Jean-Marc Museux, Eurostat 2016 UNECE CSPA Workshop on CSPA Geneva
Validation Architecture in the ESS CSPA Workshop, Geneva June 2016 Geneva June 2016 Eurostat, Vincent TRONET, Unit B1.
Theme (iv): Standards and international collaboration
GAMSO in context Denis GROFILS & Jean-Marc MUSEUX, Eurostat
CSPA and the Digital Transformation in the ESS
Investment Intentions Survey 2016
UNECE-CES Work session on Statistical Data Editing
Achievements in 2016 Data Integration Linked Open Metadata
The ESS vision, ESSnets and SDMX
Joint UNECE/Eurostat CSPA workshop
Validation in the ESS CoE Data Warehousing 23./
Progress on ESS Validation Project
ESS Validation State of Play and next steps
Implementing the ESS Vision 2020
MSDs and combined metadata reporting
Methodology and Corporate Architecture
ESS Vision 2020 Validation: Implementation of deliverables
Validation Break-out sessions
Towards an ESS architecture ITDG Item 3.4
Logical information model LIM Geneva june
ESS Vision 2020 Resource Directors Group – June 2015
Towards a European validation architecture
Oslo Group’s Mandate Address issues related to energy statistics
ESS Vision 2020: ESS.VIP Validation
Data Validation in the ESS Context
Working Group European Statistical System – Learning and Development Framework (ess-ldf) & Human Resources Management (hrm) ESTP III ( ) Item.
Working Group on Standards June 2018 Jean-Marc MUSEUX, Unit B1
ESS Validation Project State of Play and next steps
Business and IT Architecture for ESS validation
Data Validation in the ESS Context
Giuliano Amerini Unit E6 (Transport)
Draft Methodology for impact analysis of ESS.VIP Projects
3rd WGM Meeting 3 May 2018 Item 2.3 Possible standards for ESS Validation.
ESS Validation Project State of Play and next steps
Portfolio, Programme and Project
ESS Standardisation DIME / ITDG steering group – Item for information
Shared Tools Expert Group
ESS.VIP ADMIN EssNet on Quality in Multi-source Statistics, progress report 19TH WORKING GROUP ON QUALITY IN STATISTICS, 6 December 2016 Fabrice Gras,
ESS.VIPs and IT related aspects
Policy Group on Statistical Cooperation October 2015, Herceg-Novi
ESS.VIP Validation Item 5.1
Legislative strategy for cross-cutting ESS legislation
Data integration methods
Streamlining statistical production
DIME&ITDG SG meeting 28/06/2016 ESS Enterprise Architecture:
Measuring, reporting and communicating quality of National Accounts statistics (ESA 2010) in an integrated way with data production Christos LIOURIS,
2.4 Business Architecture For ESS Validation
Business architecture
Generic Statistical Information Model (GSIM)
ESTP Training Course “Enterprise Architecture and the different EA layers, application to the ESS context ” Rome, 16 – 19 October 2017.
ESS.VIP.SERV Shared Services
Modernisation of Validation in the ESS Status report
Modernisation of Validation in the ESS Collaboration with countries
ESS Vision and VALIDATION
ESS Enterprise Architecture
Eurostat validation grants: outcomes
Presentation transcript:

Applying the ESS EARF in a VIP project: The ESS.VIP Validation example Luca GRAMAGLIA Eurostat, Unit B1

ESS Vision 2020 "We will develop an ESS reference enterprise architecture to enable a systematic and coherent approach to the production of European statistics."  "We will adopt enterprise architecture as a common reference framework"

ESS.VIP Validation example

What is Data validation? ESS Methodological handbook on validation: "Data Validation is an activity verifying whether or not a combination of values is a member of a set of acceptable combinations." It is not: An activity to check or assess process metadata: validation focuses on data Editing or imputation: these are separate activities which may be performed based on the outcomes of validation

Focus of ESS.VIP Validation Member State Eurostat Validation can take place in several points of the ESS statistical production process

Current situation

Current problems in ESS validation No clear picture of who in the ESS is doing what as regards validation: Risk of validation gaps Time-consuming validation "ping-pong" Subjective assessment of data quality Lack of standards and of a common architecture for shareable and reusable validation services: Duplication of IT development costs within the ESS Manual work due to low integration between the different tools

Step 1: Identify target capabilities

Step 2: Find pain points in current state Capability 2 Capability 1

Step 3: Draw to-be situation

Step 3: Draw to-be situation Process step name

Step 3: Draw to-be situation Business-Information Link Process step inputs Process step outputs

Step 3: Draw to-be situation Information - Application Link

Step 3: Draw to-be situation Application Layer

Step 3: Draw to-be situation Collaboration scenarios

Step 4: Down to the logical level Information layer Determine implementation standards for GSIM objects identified: Data structure: SDMX Validation rules: VTL Etc…

Step 4: Down to the logical level Application layer

Step 5: Physical level

Benefits from the approach Clear translation of strategic objectives into operational tasks Clear communication across organisations Reference: Business and IT architecture for validation in the ESS

Benefits from the approach Clear translation of strategic objectives into operational tasks Clear communication across organisations Reference: Business and IT architecture for validation in the ESS

QUESTIONS ?