Kristina Dourmashkin Eurostat Unit E4 Overview of data Kristina Dourmashkin Eurostat Unit E4 NUAC meeting 10/05/2017, Brussels
eDamis EDIT + .csv Error report Import + publication Data delivered by eDamis to our directory EDIT + .csv EDIT scans for .csv files, imports to EDIT, validates Error report Errors returned to NSI Import + publication This is what happens when a datafile is sent by eDamis.
EDIT + CSV Check structure Check duplicates Extract relevant data from production database Merged datafile validated EDIT + CSV The validation goes through three steps: Rough checks for right structure, right type, numbers where expected etc. Then it checks for duplicates in the file. If there are any errors in these steps, the datafile is rejected. Step 2: EDIT extracts relevant data from the production database Step 3:Validates the merged file for consistency etc, also time series checks.
eDamis EDIT + .csv Error report Import + publication Data delivered by eDamis to our directory EDIT + .csv EDIT scans for .csv files, imports to EDIT, validates Error report Errors returned to NSI Import + publication Back to the workflow chart. The EDIT + .csv part can be accessed online by you.
Web-access You can do it to! If you ask for access .
To validate a file, upload it to EDIT using "File selection" Parameters are set to a default, but you can (I think) Change max accepted difference per year Check only the data file uploaded Validate all data in the database for one country
EDIT – now coming soon Structure check Inter dataset checks with Type check other regional data Length check Range check Presence check Allowed characters check Code list check Uniqueness check Control check Spatial level control check Time series check
All data with reference year 2008 or later has been checked All data received validated using the program
What you can do Send datafiles in comma separated value format Validate data using EDIT Check "old" data using EDIT You are not forced to, but it would help if you could: Send datafiles through eDamis, only in .csv format. Instead of setting up your own validation system, use ours, EDIT is easy to access online, just ask. If you want you can check all the exiting data, also before 2008
https://webgate. ec. europa. eu/fpfis/mwikis/ESSValidServ/index https://webgate.ec.europa.eu/fpfis/mwikis/ESSValidServ/index.php/Main_Page For more information on Eurostat's validation and the EDIT tools, look up the ESS page on Editing and Validation standards
Thank you for your attention! Any comments? Contact: kristina.dourmashkin@ec.europa.eu, E4 ESTAT-Urban-Audit@ec.europa.eu