Validation Break-out sessions 2nd Meeting of the Working Group on Methodology Luxembourg, 5 April 2017 Eurostat, Unit B1

Objectives of break-out sessions exchange views on practical implications for NSI of the deployment of an ESS validation framework: Methodology Business and IT Architecture Tools and services VTL Outcomes of discussions are expected to feed the work in the ESS (TF, ESSnet, between countries, …)

Organisation in 5 steps and 1H45' (10') Plenary: introduction and choice of sessions (40') Work in sessions (spokesperson needed) (15') Coffee Break (4*5') Plenary: Report by 4 spokespersons and Q/A (10-20') Plenary: Overall conclusions

Session 1: Methodology Context & Objectives Need for a common framework for validation in ESS: Definitions, Classifications, Metrics, ... Methodological handbook created by ESSnet Objective: feed work in the ESS Improvement of the handbook (metrics, …), Standard for Validation report Standard description of validation rules and roles …

Suggested discussion points Session 1: Methodology Suggested discussion points Description of validation rules Types of validation rules Metrics Validation reports Warnings …

Session 2: Business Architecture Context & Objectives The Business and IT Architecture was developed by the TF Validation. The document: Introduces a list of validation principles Describes the “To be state” of validation in the ESS Presents the three different ways MS could validate data prior to transmission to Eurostat Provides a common classification of rule severity and proposes a standard data acceptance process

Session 2: Business Architecture Suggested discussion points What kind of documentation/information would be useful for MS to be able to choose the most appropriate scenario? What kind of support would be necessary to implement the to-be state (communication/training)? Implementation of the Business Architecture: Criteria to prioritise specific domains? Which ESS body to monitor the implementation? Comments on the data acceptance process?

Session 3: Tools and services Context & Objectives Increase understanding of the use and re-use of validation tools and services in the ESS, Learning from others concerning the use of validation tools and services, Identify needs in the area of validation tools and services, Discuss interest and potential maturity for sharing tools and services in the ESS.

Session 3: Tools and services Suggested discussion points What commercial tools and services are used for data validation? What custom (developed) tools and services are used for data validation? What tools/services – developed by other statistical organisations like Eurostat or NSI's from other countries – are used for data validation Which validation service would add the greatest value to you concerning production of European Statistics? Are you familiar / do you participate in initiatives like CSPA and ESS Shared Services?

Session 4: VTL Context & Objectives A standardization of validation rules and validation reports guarantees: the transparency of the validation process within the ESS creating ESS interoperable IT services Session on VTL – exchange of view on: the current situation in countries on a corporate approach for data validation the level of understanding of VTL and plans to use VTL

Suggested discussion points Session 4: VTL Suggested discussion points With regard to data validation in your NSI, have you developed: 1.a Common validation language 1.b. Repository of validation rules 1.c Common metadata repository (for data structures etc.) 1.d Typologies of validation rules 1.e Standard methods How much do you (your NSI) know about VTL? 2.a Participated to the TF VTL 2.b Participated to the public review 2.c Read the manual What could be the potential for VTL in your NSI? 3.a Use VTL to pre-validate data sent to Eurostat, ECB, OECD, IMF 3.b Use VTL internally, for your own data collections 3.c Use VTL for communicating the validation rules with your partners (e.g. raw data providers)

QUESTIONS ?