1. ESDEN - modernisation of data exchange in the ESS
Item 4.1 of agenda
EVUG meeting 2015
Alvaro Diez Soto, Eurostat (B3)

2. Introduction Objectives of the project Status of the project
Facts on data exchange
Challenges on the data exchange
Modernisation of the data exchange

3. Objectives of the project
Cross cutting project of the ESS.VIP programme to:
Provide value added services for exchange of confidential and non-confidential statistical data among ESS partners
Define the communication backbone for the future ESS common infrastructure
Support business needs expressed in the ESS.VIP projects

4. Schedule of the project
Phase 1:
Development of SIMSTAT communication infrastructure
ESDEN feasibility study
Phase 2:
Evolution of the network architecture
Integration of SIMSTAT developments
Phase 3:
Migration to the new communication infrastructure
SISAI-Metadata Working Group meeting

5. Status of the project
SIMSTAT network infrastructure delivered on time for the pilot exchange
Ongoing support to the countries for the data exchange

6. Facts on data exchange – EDAMIS data exchange 2014 (files vs volume)

7. Facts on data exchange – EDAMIS vs SIMSTAT 2015 (during SIMSTAT pilot exchange)

8. Challenges on the data exchange
Interface
EWP
EWA
Communication Protocols (HTTP, FTP) Programs (STATEL)
Infrastructure
Hardware
IT environments
Networks (Internet, sTESTA,CCN)

9. Challenges at infrastructure level
Central EDAMIS infrastructure complex and spread across different IT environments
Specific platform requirements in the Member States
Integration and usage of secure networks vs Internet (infrastructure security vs secure protocols)

10. Challenges at communication level
FTP protocol should be abandoned
Security provided at application level (STATEL) and not based on secure protocols
Difficulty to maintain and update the software (STATEL, STATEL GW)

11. Challenges at interface level
Java not supported in future browsers
Synchronisation of DBs between EWAs and Eurostat becoming more and more complex
Duplication of interfaces and functionalities increase the maintenance and support costs impacting the user experience

12. Modernisation of data exchange - Infrastructure
Rationalisation of IT environments in Eurostat
Platform independent requirements for the Member States
Flexible infrastructure connected to Internet and secure networks

13. Modernisation of data exchange - Communication
Creation of a Web Service based gateway:
Usage of HTTPS for communication
Exposing methods for put, get, list and retrieve the status of a data exchange
Available over Internet and secure networks
Creation of supporting documentation for integration in the data providers
Creation of a reference implementation client:
JAVA version of a simple client to access the Web Service based gateway
Open source code to be provided to the data providers

14. Modernisation of data exchange - Interfaces
Pilot project for non-java based version of Web Forms (HTML5 based)
Non-java based version of the secure upload form
EWP to be available via secure networks (for those countries with restricted security policies not allowing internet connection)
Rationalisation of web interfaces avoiding duplicity of functionalities

15. ESDEN – next steps
Set up of the steering committee to guide the project (Member States involvement)
Approval of ESSC for phase 2
Pilot project on Web forms and creation of WS based infrastructure
ESSNet for the creation of future interfaces and modernisation of the data exchange

16. Thank you for your attention!