1. CRIME - Data Transmission
19 February 2009
eDAMIS
The standard solution for transmitting your statistical data files to Eurostat Single Entry Point
Eurostat Unit B3 – Statistical Information Technologies
Data transmission tools and services

2. Position of the management
12/2/2008: Eurostat Directors Meeting decided that eDAMIS will be compulsory for the transmission of all regular datasets as of 1 July Any exception would have to be justified by the Director concerned.
14/2/2008: Statistical Programme Committee (SPC) represented by the Directors General of the NSI reaffirmed its support to the Single Entry Point (SEP) strategy and confirmed their effort to target 100% coverage of the SEP.
Eurostat Unit B3 – Statistical Information Technologies
Data transmission tools and services 2

3. What is eDAMIS? eDAMIS is an environment which :
Implements the concept of the Single Entry Point (SEP)
Usage is simple (no installation on the user PC)
Provides adapted solutions to several needs and users profiles (NSI and other organisations)
Facilitates fully automated data transmissions
Guaranties secure transmissions
Offers value added services such as: traffic monitoring, acknowledgements, reminders …
Eurostat Unit B3 – Statistical Information Technologies
Data transmission tools and services 2

4. Single User-ID for all services
Use your CIRCA user-id/password.
How to get a CIRCA user-id/password?
Go to eDAMIS Web Portal at
Link: “Self registration (I have no CIRCA User-ID)”
This slide give the practical information on how to get a userid for CIRCA.
CIRCA is the main collaboration tool used in the relation between Eurostat and Member States.
There is a central user DB.
Eurostat Unit B3 – Statistical Information Technologies
Data transmission tools and services

5. eDAMIS – Naming convention
allows automatic recognition by eDAMIS same name used by all parties involved in data transmission
Dataset Id
Domain Id _
Dataset structure Id _
Periodicity
CRIME_NEWSTAT_A
ROAD_A1_Q
Examples:
Dataset Occurrence Id
Dataset Id _
Country Code _
Year _
Period
Dataset-ID used in the inventory
Dataset occurrence: one dataset for one country and one period or time series (in this case the last period is mentioned).
A data file naming convention is also used to deliver data files in production environments. It contains, in addition to the dataset occurrence ID, a version number as well as (possibly) an action code: New, Replace, Append, …
Examples:
CRIME_NEWSTAT_A_DE_2007_0000
ROAD_A1_Q_UK_2006_0003
Eurostat Unit B3 – Statistical Information Technologies
Data transmission tools and services

6. eDAMIS approaches to provide data to Eurostat
NSI (National Statistical Institute)
Data
eDAMIS server
Data
eWA (eDAMIS Web Application)
Send data @
eWP (eDAMIS
Web Portal)
Notifies @
eWF (eDAMIS Web Forms)
Small data provider
Enter data in Web Form
Data
Transmission Send data file @
Send data
Other (MIS users, datasets, ...) @
Special cases and exceptions:
all Organisations having eWA installed (not only NSI) should use eWA to send their data
in case of problem in eWA, eWP could be used in NSI as fail over solution to send data to Eurostat
NSI should use Web Forms in eWP unless they can send directly a SDMX-ML file via eWA
Eurostat Unit B3 – Statistical Information Technologies
Data transmission tools and services

7. eDAMIS Web Application (eWA) transmissions (Local installation in NSI)
Eurostat
NSI
Data
Production
Unit
eDAMIS
(Basic validation)
Monitoring
Archive
Dispatching
Notification
Secure Transmission
Notification
Acknowledgement
Data
Target: Important Eurostat data providers who are currently users of Stadium Client (Stadium VB or Stadium Web Application).
Covers all transmission needs:
Big files
confidential files (to be encrypted)
files to be pre-validated prior to their transmission (or prior to their encryption + transmission)
EDI transmissions.
eWP can be used as backup (failover) solution for eWA users.
Secure transmission
Eurostat Unit B3 – Statistical Information Technologies
Data transmission tools and services

8. eDAMIS Web Application – send screen
User friendly interface
envelope can be pre-filled if filename respects the naming convention
possibility to attach explanatory notes to data files
possibility to send easily several data files during the same session.
Eurostat Unit B3 – Statistical Information Technologies
Data transmission tools and services

9. eDAMIS Web Portal (eWP) transmissions (fail over solution for NSI users)
Travel
Data
Any Place
Data
Eurostat
eDAMIS
Basic validation
Monitoring
Archive
Dispatching
Notification
Production
Unit
Office
Data
Acknowledgement
Web
Portal
Notification
Data
Main target: relatively small Eurostat data providers (who each send relatively few datasets to Eurostat)
Secure upload guarantied via the usage of https protocol
No need to install any tool (just need to have an internet browser)
If Java is enabled, highly secure transmissions can be guarantied (with data compression)
Eurostat Unit B3 – Statistical Information Technologies
Data transmission tools and services

10. Direct Web upload with eWP
User friendly interface
envelope can be pre-filled if filename respects the naming convention
possibility to attach explanatory notes to data files
possibility to send easily several data files during the same session.
Eurostat Unit B3 – Statistical Information Technologies
Data transmission tools and services

11. Monitoring report - example
Dataset occurrences of “Road A1”
received between February and April 2005 (extract)
Explanation:
This report gives for all dataset occurrences (one dataset for one period for one country), the following pieces of information:
Dataset-id
Is this dataset confidential ?
Country, year, period and periodicity of transmission
Date of first reception of a data file related to this dataset occurrence
Date of last reception
Indicative deadline (calculated on the bases of the date of termination of the period + the maximum delay for transmission)
Delay (in days) between the first reception related to the dataset occurrence and the indicative deadline.
In the example highlighted in a orange rectangle, you can notice that:
For the confidential Dataset “ROAD_A1_Q” of Finland related to quarter 3 of 2004, the first data file was received on 25th February 2005 and the last on 22th March 2005.
5 data files related to the same dataset occurrence have been received between these 2 dates.
The first data file was sent 3 days before the indicative deadline.
Eurostat Unit B3 – Statistical Information Technologies
Data transmission tools and services

12. More information
In NSI (eDAMIS Web Application): contact your Local Coordinator in your country =>List on eDAMIS Help Centre (section “contacts”)
eDAMIS Web Portal (eWP) at
“eDAMIS help centre” accessible on eDAMIS Web Portal+ link “eDAMIS Help Centre”
Eurostat Support at:
Eurostat Unit B3 – Statistical Information Technologies
Data transmission tools and services 2