EUROSTAT Unit B3 IT for statistical production Ewa Stacewicz

Slides:



Advertisements
Similar presentations
1 SDMX Reference Infrastructure (SDMX-RI) Work in progress, status and plans Bengt-Åke Lindblad, Adam Wroński Eurostat Eurostat Unit B3 – IT and standards.
Advertisements

24/5/2011 MSIS 2011 – May 2011, Luxembourg 1 Statistical data editing near the source using cloud computing concepts George Pongas, Christine Wirtz.
1 Vision Infrastructure Project (VIP) Enhanced Dissemination Chain 2 nd SISAI meeting, June 2012 B4 – IT for statistical production Unit B5 – Management.
Eurostat Unit B3 – Statistical Information Technologies Data transmission tools and services 15/05/ eDAMIS The standard solution for transmitting.
Implementation of SDMX for data and metadata exchange SDMX Basics Course 12 April 2013 Daniel Suranyi Eurostat B5 Management of statistical data and metadata.
1 EDIT 2013 User Interface Enhancements European Commission – Eurostat.
Eurostat Expression language (EL) in Eurostat SDMX - TWG Luxembourg, 5 Jun 2013 Adam Wroński.
13-Jul-07 Implementation of SDMX for data and metadata exchange Balance of Payments Working Group 2-3 April 2012 Daniel Suranyi Eurostat B5 Management.
Editing Building Block (EBB) Validation Tool for FDI and ITS Balance of Payments Working Group 02 April 2012 Unit B4, IT for Statistical Production Georges.
Statistical data editing - UNECE work session – OSLO September 2012 Proposal of a revised approach for data validation within the European Statistical.
1 The EDIT System, Overview European Commission – Eurostat.
SDMX IT Tools SDMX use in practice in NA
7b. SDMX practical use case: Census Hub
Implementation of SDMX for Balance of Payments Balance of Payments Working Group 9-10 April 2013 BP Daniel Suranyi Eurostat B5 Management of statistical.
ESDEN - modernisation of data exchange in the ESS
IT Directors’ Group Meeting October 2010 Sharing data validation tools in the ESS Christine WIRTZ – Head of Unit B3 Georges PONGAS – Unit B3 Daniel.
Eurostat Sharing data validation services Item 5.1 of the agenda.
Implementation of SDMX for data and metadata exchange SDMX Basics Course October 2012 Daniel Suranyi Eurostat B5 Management of statistical data and.
Eurostat 6. SDMX: A non-technical overview of the SDMX architecture and IT tools 1 Raynald Palmieri Eurostat Unit B5: “Central data and metadata services”
Training Course on EDIT
Training Course on EDIT 2013
Validation in the ESS CoE Data Warehousing 23./
SDMX Opportunities MED Meeting 14 May 2013 Daniel Suranyi Eurostat B5
Validation Tools and Services: Current developments at Eurostat
Migration to the new EDAMIS
Workshop on the Validation of Waste Statistics
NUAC meeting June Validation – where are we?
ESS Vision 2020 Validation: Implementation of deliverables
Census Hub in practice Working Group "European Statistical Data Support" Luxembourg, 29 April 2015.
SIMSTAT IS progress report
ESS Vision 2020 Recent developments
Kristina Dourmashkin Eurostat Unit E4
Census Hub: Progress report
ESS Vision 2020: ESS.VIP Validation
Eurostat – Units E2, B5 Cristina BLANARU
Kristina Dourmashkin Eurostat Unit E4
ESTP October 2012, Luxembourg Item 5 of the agenda
Data Validation in the ESS Context
Task Force on Annual Financial Accounts
Data Transmission Tools & Services EDAMIS, SDMX, Validation
ESS.VIP VALIDATION An ESS.VIP project for mutual benefits
Implementation of SDMX in the ESS
Business and IT Architecture for ESS validation
EDIT User Group - services
Working Group on Population and Housing Censuses
SDMX as basis for water data reporting
Sharing data validation activities in the ESS.
Validation services developed in the ESS
ESS VIP ICT Project Task Force Meeting 5-6 March 2013.
Education and Training Statistics Working Group – 2-3 June 2016
Prepared by Peter Boško, Luxembourg June 2012
A review of the 2011 census round in the EU, including the successful implementation of a detailed European legal base First meeting of the Technical Coordination.
Unit D2: Regional Statistics New Eurostat rules Data Transmissions
Agricultural Data Collection System
WG on Statistical Confidentiality (TRansport Information System)
ESS.VIP Validation Item 5.1
Statistical data editing near the source using cloud computing concepts George Pongas, Christine Wirtz -Eurostat.
Education and Training Statistics Working Group – 1-2 June 2017
Item 5.1 of agenda EVUG Meeting 2015 Eurostat, Unit B3
ESDEN - modernisation of data exchange in the ESS
The migration to the new EDAMIS
GENEDI EUROPEAN COMMISSION - EUROSTAT GENERIC EDI TOOLBOX
Modernisation of Validation in the ESS Collaboration with countries
European Statistical System Metadata Handler ESS MH (Super) Providers
Data compilation and pre-validation
The migration to the new EDAMIS
EDIT data validation system Ewa Stacewicz EUROSTAT VALIDATION TEAM
Validation Activities in the ESS What you will hear today…
Validation at Insee.
Presentation transcript:

EUROSTAT Unit B3 IT for statistical production Ewa Stacewicz EDIT Data Validation System for the BoP (Balance of Payments) Statistics EUROSTAT Unit B3 IT for statistical production Ewa Stacewicz Luxembourg, 2nd of June 2015

EDIT as a part of the ESS EDIT is the statistical data validation software used for the validation services provided by EUROSTAT EDIT was selected as a base of the validation service for the implementation of several projects under the ESS.VIP Programme Some statistics: EDIT is used at Eurostat in 27 statistical domains EDIT is used by the Member States and other institutions in 13 statistical domains ESS Vision 2020 Implementation Portfolio

EDIT use in Member States EDIT Domains used by the Member States: BoP ITS – International Trade in Services BoP FDI – Foreign Direct Investment ASYLUM statistics TOURISM statistics SBS – Structural Business Statistics Business Demography FSS - Farm Structure Survey EHSIS - European Health and Social Inclusion Survey …

Advantages of using EDIT by Member States Validation is performed "at the beginning" of the production process (the sooner, the better), by the data provider (NSIs) All MSs are using the same, agreed data validation rules The validation done by MS has positive impact on the whole business process – the workload and data exchanges between MSs and Eurostat are reduced considerably Both sides (Eurostat and MSs) have more time to concentrate on data analysis

EDIT Introduction Data validation and editing tool Allowing users to: import data run validation programs browse or export validation results Friendly web-based User Interface Available as a standalone application – can be installed locally on the user's PC and serve for the validation of confidential data 5

User Workflow Data Import Job Execution Job Results 6

EDIT local version for the BoP Statistics Download from CIRCABC Easy deployment All components running locally on the user’s machine Local authentication 7

User Module Functionality Change Password Allows users to change their password Dataset Import/Export Allows users to import and export data to and from the System as well as monitor any ongoing import/export processes Job Execution Allows users to execute programs on imported datasets and view the results of the execution 8

Validation types for BoP data As far: File Structure (number of fields, mandatory fields, length, data types) – executed at the data import step Intra-dataset checks correctness of codes - code lists integrity checks – breakdowns Enhancements planned in 2015: Separate reports for each set of integrity rules (grouped by dimensions) For integrity rules - the difference and the ratio will be shown in the error report along with an error info Completeness check in some dimensions

User interface – Data Import (simplified) Predefined Import Templates

User interface – Data Import User can adjust manually the file properties

User interface – Create Job User can overwrite the default values User selects a file for validation

User Interface – Error report Statistics

User Interface – View Error report

Error report – export to a CSV file

More info on EDIT EDIT webinars: 14 October 2015 registration via ESTAT-VALIDATION@ec.europa.eu For next webinars please check the section Editing & Validation Events on: https://webgate.ec.europa.eu/fpfis/mwikis/ESSValidServ

THANK YOU FOR YOUR ATTENTION I want to use it! You can contact the validation support team of EDIT at: ESTAT-VALIDATION@ec.europa.eu 17 17