CRIME - Data Transmission 19 February 2009 eDAMIS The standard solution for transmitting your statistical data files to Eurostat Single Entry Point Eurostat Unit B3 – Statistical Information Technologies Data transmission tools and services

Position of the management 12/2/2008: Eurostat Directors Meeting decided that eDAMIS will be compulsory for the transmission of all regular datasets as of 1 July 2008. Any exception would have to be justified by the Director concerned. 14/2/2008: Statistical Programme Committee (SPC) represented by the Directors General of the NSI reaffirmed its support to the Single Entry Point (SEP) strategy and confirmed their effort to target 100% coverage of the SEP. Eurostat Unit B3 – Statistical Information Technologies Data transmission tools and services 2

What is eDAMIS? eDAMIS is an environment which : Implements the concept of the Single Entry Point (SEP) Usage is simple (no installation on the user PC) Provides adapted solutions to several needs and users profiles (NSI and other organisations) Facilitates fully automated data transmissions Guaranties secure transmissions Offers value added services such as: traffic monitoring, acknowledgements, reminders … Eurostat Unit B3 – Statistical Information Technologies Data transmission tools and services 2

Single User-ID for all services Use your CIRCA user-id/password. How to get a CIRCA user-id/password? Go to eDAMIS Web Portal at https://webgate.ec.europa.eu/edamis Link: “Self registration (I have no CIRCA User-ID)” This slide give the practical information on how to get a userid for CIRCA. CIRCA is the main collaboration tool used in the relation between Eurostat and Member States. There is a central user DB. Eurostat Unit B3 – Statistical Information Technologies Data transmission tools and services

eDAMIS – Naming convention allows automatic recognition by eDAMIS same name used by all parties involved in data transmission Dataset Id Domain Id _ Dataset structure Id _ Periodicity CRIME_NEWSTAT_A ROAD_A1_Q Examples: Dataset Occurrence Id Dataset Id _ Country Code _ Year _ Period Dataset-ID used in the inventory Dataset occurrence: one dataset for one country and one period or time series (in this case the last period is mentioned). A data file naming convention is also used to deliver data files in production environments. It contains, in addition to the dataset occurrence ID, a version number as well as (possibly) an action code: New, Replace, Append, … Examples: CRIME_NEWSTAT_A_DE_2007_0000 ROAD_A1_Q_UK_2006_0003 Eurostat Unit B3 – Statistical Information Technologies Data transmission tools and services

eDAMIS approaches to provide data to Eurostat NSI (National Statistical Institute) Data eDAMIS server Data eWA (eDAMIS Web Application) Send data @ eWP (eDAMIS Web Portal) Notifies @ eWF (eDAMIS Web Forms) Small data provider Enter data in Web Form Data Transmission Send data file @ Send data Other (MIS users, datasets, ...) @ Special cases and exceptions: all Organisations having eWA installed (not only NSI) should use eWA to send their data in case of problem in eWA, eWP could be used in NSI as fail over solution to send data to Eurostat NSI should use Web Forms in eWP unless they can send directly a SDMX-ML file via eWA Eurostat Unit B3 – Statistical Information Technologies Data transmission tools and services

eDAMIS Web Application (eWA) transmissions (Local installation in NSI) Eurostat NSI Data Production Unit eDAMIS (Basic validation) Monitoring Archive Dispatching Notification Secure Transmission Notification Acknowledgement Data Target: Important Eurostat data providers who are currently users of Stadium Client (Stadium VB or Stadium Web Application). Covers all transmission needs: Big files confidential files (to be encrypted) files to be pre-validated prior to their transmission (or prior to their encryption + transmission) EDI transmissions. eWP can be used as backup (failover) solution for eWA users. Secure transmission Eurostat Unit B3 – Statistical Information Technologies Data transmission tools and services

eDAMIS Web Application – send screen User friendly interface envelope can be pre-filled if filename respects the naming convention possibility to attach explanatory notes to data files possibility to send easily several data files during the same session. Eurostat Unit B3 – Statistical Information Technologies Data transmission tools and services

eDAMIS Web Portal (eWP) transmissions (fail over solution for NSI users) Travel Data Any Place Data Eurostat eDAMIS Basic validation Monitoring Archive Dispatching Notification Production Unit Office Data Acknowledgement Web Portal Notification Data Main target: relatively small Eurostat data providers (who each send relatively few datasets to Eurostat) Secure upload guarantied via the usage of https protocol No need to install any tool (just need to have an internet browser) If Java is enabled, highly secure transmissions can be guarantied (with data compression) Eurostat Unit B3 – Statistical Information Technologies Data transmission tools and services

Direct Web upload with eWP User friendly interface envelope can be pre-filled if filename respects the naming convention possibility to attach explanatory notes to data files possibility to send easily several data files during the same session. Eurostat Unit B3 – Statistical Information Technologies Data transmission tools and services

Monitoring report - example Dataset occurrences of “Road A1” received between February and April 2005 (extract) Explanation: This report gives for all dataset occurrences (one dataset for one period for one country), the following pieces of information: Dataset-id Is this dataset confidential ? Country, year, period and periodicity of transmission Date of first reception of a data file related to this dataset occurrence Date of last reception Indicative deadline (calculated on the bases of the date of termination of the period + the maximum delay for transmission) Delay (in days) between the first reception related to the dataset occurrence and the indicative deadline. In the example highlighted in a orange rectangle, you can notice that: For the confidential Dataset “ROAD_A1_Q” of Finland related to quarter 3 of 2004, the first data file was received on 25th February 2005 and the last on 22th March 2005. 5 data files related to the same dataset occurrence have been received between these 2 dates. The first data file was sent 3 days before the indicative deadline. Eurostat Unit B3 – Statistical Information Technologies Data transmission tools and services

More information In NSI (eDAMIS Web Application): contact your Local Coordinator in your country =>List on eDAMIS Help Centre (section “contacts”) eDAMIS Web Portal (eWP) at https://webgate.ec.europa.eu/edamis “eDAMIS help centre” accessible on eDAMIS Web Portal+ link “eDAMIS Help Centre” Eurostat Support at: estat-support-edamis@ec.europa.eu Eurostat Unit B3 – Statistical Information Technologies Data transmission tools and services 2