Business and IT Architecture for ESS validation

Slides:



Advertisements
Similar presentations
Identifying Needs and Establishing Requirements John Thiesfeld Jeff Morton Josh Edwards.
Advertisements

Standardisation in the European Statistical System Barteld Braaksma, Cecilia Colasanti, Piero Demetrio Falorsi, Wim Kloek, Miguel Angel Martínez Vidal,
8-11-Jul-07 How to increase quality of Principal European Economic Indicators? Roberto Barcellan, Brian Newson, Klaus Wurm Eurostat.
Quality issues on the way from survey to administrative data: the case of SBS statistics of microenterprises in Slovakia Andrej Vallo, Andrea Bielakova.
Eurostat Expression language (EL) in Eurostat SDMX - TWG Luxembourg, 5 Jun 2013 Adam Wroński.
Census Quality: another dimension! Paper for Q2008 conference, Rome Louisa Blackwell Quality Assurance Manager, 2011 Census.
Addressing the challenge of producing European comparable data using administrative data Mihaela AGAFIŢEI Sorina VÂJU UNECE Seminar on Statistical Data.
Statistical data editing - UNECE work session – OSLO September 2012 Proposal of a revised approach for data validation within the European Statistical.
Reporting – outcomes & ways forward Ilia Neudecker, Foxgloves Consultancy Make it Work Conference Regulatory Insights, Experiences and Enlightenment -
Standardisation in the European Statistical System inventory of normative documents and the standard-setting process – results of the ESSnet on Standardisation.
Census quality evaluation: Considerations from an international perspective Bernard Baffour and Paolo Valente UNECE Statistical Division Joint UNECE/Eurostat.
Eurostat Report on SDMX Reference Infrastructure User Group 1 st meeting in Luxembourg Sept 2012 Item 5.2 of the agenda November 2012IT Director's.
Eurostat Sharing data validation services Item 5.1 of the agenda.
What makes for good standards in Apprenticeships? Jeremy Benson – Executive Director for Vocational Qualifications Bryan Horne - Associate Director, Standards.
1 Recent developments in quality related matters in the ESS High level seminar for Eastern Europe, Caucasus and Central Asia countries Claudia Junker,
Validation Architecture in the ESS CSPA Workshop, Geneva June 2016 Geneva June 2016 Eurostat, Vincent TRONET, Unit B1.
UNECE-CES Work session on Statistical Data Editing
Project Quality Management
Software Quality Control and Quality Assurance: Introduction
The Systems Engineering Context
Progress on ESS Validation Project
ESS Validation State of Play and next steps
EUROSTAT Unit B3 IT for statistical production Ewa Stacewicz
Workshop on the Validation of Waste Statistics
"IT principles" Context, roadmap
ESTP TRAINING ON EGR Luxembourg – December 2014
ESS Vision 2020 Validation: Implementation of deliverables
SISAI STATISTICAL INFORMATION SYSTEMS ARCHITECTURE AND INTEGRATION
Validation Break-out sessions
22 February, ITDG/DIME Item 2 – Progress and deployment
Practical tools for conflict resolution
Towards a European validation architecture
ESS Vision 2020: ESS.VIP Validation
A handbook on validation methodology Marco Di Zio Istat
Data Validation in the ESS Context
Working Group European Statistical System – Learning and Development Framework (ess-ldf) & Human Resources Management (hrm) ESTP III ( ) Item.
Task Force on Annual Financial Accounts
ESS.VIP VALIDATION An ESS.VIP project for mutual benefits
VTL: Validation and Transformation Language
ESS Validation Project State of Play and next steps
Quality assessment ESTP Training Course “Quality Management and survey Quality Measurement” Rome, 24 – 27 September 2013 Giorgia Simeoni Researcher Unit.
Giuliano Amerini Unit E6 (Transport)
Draft Methodology for impact analysis of ESS.VIP Projects
ITDG meeting of of October 2011
3rd WGM Meeting 3 May 2018 Item 2.3 Possible standards for ESS Validation.
Validation services developed in the ESS
How to conduct Effective Stage-1 Audit
ESTP course on International Trade in Goods Statistics
ESS Validation Project State of Play and next steps
Applying the ESS EARF in a VIP project: The ESS.VIP Validation example
ESTP Advanced course on quality reporting
ESS.VIP Validation Item 5.1
Assessment of quality of standards
Working Group European Statistical System – Learning and Development Framework (ess-ldf) & Human Resources Management (hrm) ESTP II evaluation Item 4a.
Actions on Data validation
SDMX Implementation: the process
2.4 Business Architecture For ESS Validation
Kees Zeelenberg, Winfried Ypma, Peter Struijs; Statistics Netherlands
ESTP Training Course “Enterprise Architecture and the different EA layers, application to the ESS context ” Rome, 16 – 19 October 2017.
ESS.VIP.SERV Shared Services
Item 4.2 EUROMOD latest developments
Modernisation of Validation in the ESS Status report
3. An overview of the SDMX implementation process
A handbook on validation methodology. Metrics.
Modernisation of Validation in the ESS Collaboration with countries
ESS Vision and VALIDATION
The ESS quality reporting implementation process
THOMAS COOK CRM STANDARDS ASSESSMENT
Item 9 Validation in UOE data collection
Presentation transcript:

Business and IT Architecture for ESS validation ESTP course Item 03 Luxembourg, 21-22 Nov 2017 Vincent.tronet@ec.europa.eu Eurostat, Unit B1

Business and IT Architecture What is Validation and Where is it? What it does? What is the situation today? What are the Validation principles applied? What will be the situation tomorrow? What are the severity levels in case of failure ? What are the IT building blocks? What are the optional scenarios for implementation?

What is validation? ESS handbook – "Methodology for data validation": "Data Validation is an activity verifying whether or not a combination of values is a member of a set of acceptable combinations." It is not: An activity to check or assess process metadata: validation focuses on data Editing or imputation: these are separate activities which may be performed based on the outcomes of validation The ESS.VIP Validation took as a starting point for its activities the following definition given by the UNECE: Data validation is "an activity aimed at verifying whether the value of a data item comes from the given (finite or infinite) set of acceptable values." Data validation is focused on checking the validity/consistency of data. Checking process or structural metadata is not within the scope of validation, though process or structural metadata may serve as input to validation procedures.

Focus of ESS.VIP Validation NSI ESTAT Validation can take place in several points of the ESS statistical production process

What does the business architecture for validation do? Sets basic principles for validation in the ESS Defines the to-be state Clarifies the roles of Eurostat and Member States in the validation of data sent to Eurostat Clarifies how common validation services could be used by Member States and Eurostat

As-is situation

Validation Principles Validation processes must be designed to be able to correct errors as soon as possible, so that data editing can be performed at the stage where the knowledge is available to do this properly and efficiently. The sooner, the better Trust, but verify Well-documented and appropriately communicated validation rules Well-documented and appropriately communicated validation errors Comply of explain Good enough is the new perfect When exchanging data between organisations, data producers should be trusted to have checked the data before and data consumers should verify the data on the common rules agreed. Validation rules must be clearly and unambiguously defined and documented in order to achieve a common understanding and implementation among the different actors involved The error messages related to the validation rules need to be clearly and unambiguously defined and documented, so that they can be communicated appropriately to ensure a common understanding on the result of the validation process. Validation rules must be satisfied or reasonably well explained. Validation rules should be fit-for-purpose: they should balance data consistency and accuracy requirements with timeliness and feasibility constraints.

To-be situation and Validation Principles Where would you put principle ? The sooner, the better Well documented validation errors Well-documented validation rules Comply or explain Good enough is the new perfect Trust, but verify Well documented validation errors The sooner, the better Well-documented validation rules Comply or explain C A Good enough is the new perfect D B Trust, but verify

Severity levels and acceptance Errors: Wrong values. Data containing errors are not considered acceptable. Warnings: suspicious values. Data with warnings may be accepted after justification. Information: Potentially suspicious values. Do not usually require further justification for acceptance. Minimum standard for compliance: data with no errors must be received before deadline

Validation in the ESS – IT building blocks VRM STRUVAL CONVAL

Scenario 1 Member States receive the common rules and implement them in their own validation systems

Scenario 2 Member States use common ESS services in their process for validation (as shared or replicated services) Shared service Replicated services

Scenario 3 Member States use common ESS processes for validation

Thank you for your attention! Any questions?