SISAI STATISTICAL INFORMATION SYSTEMS ARCHITECTURE AND INTEGRATION WORKING GROUP 3rdMEETING 13-14 MAY 2013 ITEM 1.4.3 Cross-Cutting Project “European Statistical Data Exchange Network - ESDEN"

ESS VIP and CRC Programme Cross-Cutting Project “European Statistical Data Exchange Network - ESDEN" ESDEN project team and many others

Objectives Communication network infrastructure Provide services for statistical data exchange Create a Schengen like zone for the ESS Backbone for the future ESS common infrastructure Support business needs expressed in the ESS.VIP projects

Timeline 2013 - 2015 2015 – 2017 Preparatory work Network to cover SIMSTAT and VIPV needs 2015 – 2017 Finalisation of the system Fine-tuning Developement of common services to accomodate other ESS.VIP needs

Timeline 2017 – 2019 Integration of local applications of other Commission level initiatives (CCN2)

So far so good ? Most of ex-ante made in parallel Further reading of other ESS.VIP ex-ante or Business Process Documents is necessary

ESS VIPs and Cross-cutting projects

ESS.CRC2.ESDEN ? ESS.CRC.VIP needs ESS.BUS.VIP needs

ESS.CRC.VIP needs Shared ESS dissemination General-purpose data sharing hub linked to the ESS data warehouse Sharing of services across processes and partners [ESS] Platform for sharing services should be elaborated [ESS secure bus]

ESS.CRC.VIP needs (continued) Move towards a secure network infrastructure Communication through messages (SOA) Frequent exchange of transaction data Micro-data exchanges and sharing Interconnection and automation of services

ESS.BUS.VIP needs Confidentiality and security of the data Communication between components of production systems enabling the ESS to use resources and services of others MS, other partners, Estat developped modules securely used across the ESS Sharing of content validation services across the ESS Need of a workflow monitor system

ESS.BUS.VIP needs (continued) Web services covering the entire business process for producing European statistics on the information society Infrastructure where data is stored, managed,accessed at the most appropriate level in the ESS Services located anywhere in the ESS and made available to all partners Push, Pull, Pull w/Hub modes Coping with data that change frequently Interactive data exchange/sharing with MS's databases

ESS.BUS.VIP needs (continued) Creation of a ESS data Schengen with free flow of data inside the ESS Assessment of a Cloud architecture implementation Integration of a web infrastructure for exchange of micro and macro data into the ESS architecture Develop a net of distributed Business Registers across the ESS implying a continuous growth in data exchange Ensure secure decentralised access to confidential data Regular micro-data exchange between MSs Importance of timeliness of data and performance

ESS.BUS.VIP needs (continued) I.S. where MSs provide acccess to some of their micro-data Rules for confidential data process satisfying the partners requirements High volume of data exchange Rebuilt data collection to respond to increased volume Give preference to existing data transmission solutions A EU legal framework to share data is needed A system of interconnected data warehouses covering the different statistical domains Management of a huge amount of detailed statistical information

Let us summarise Think, act ESSly Increase of volume, movement, interactions, endpoints Type of data to be "transported" (new kinds of communication) Big data Services Messages Events Speed, Scalability, Reliability, Security, Flexibility, Confidentiality, Extensibility, Availability, Usability, Heterogeneity

Who can help us? EDAMIS, STATEL CCN/CSI CCN2 XMLGATE sTESTA Cloud computing ECIDES BISE EDSP SDMX-RI SPEED2 Commercial off-the-shelf What else?

Synergies with other DGs projects Are our ESS needs fulfilled ? Any circular references ? Any transitive dependency ? What if all DGs go CCN/CSI - CCN2 ?

Some issues Wait for other CRC, BUS requirements ? Decide on a solution and refine CRC, BUS requirements accordingly ? e.g.: SIMSTAT could go CCN/SCI

Back to ESDEN objectives … 2013-2015 Current validation data service(s) and EDAMIS interconnected EDAMIS can pull data (SODI Pull Requestor) Reception/sending of confidential data (VIPV, SIMSTAT) Analysis of CRC.VIP, BUS.VIP requirements / needs Analysis of current data collection requirements Manual data collection tool based on SDMX (Excel) Feasibility Study for the networking part

Back to ESDEN objectives … 2015-2017 Definition and development of interfaces to the infrastructure Protocols diversity Synchronous /Asynchronous communication Definition and development of ESDEN services Monitoring Inventory Metadata ….

Back to ESDEN objectives … 2017-2019 Integration of developped solutions Migration plan Testing of representative CRC and BUS functionalities/domains Phasing out of current IS involved

Resources Dir B Dir A Business Directorates DIGIT Contractors EA cell, B3, B4, B2, (B1), B0, LISO Dir A HR, Legal Aspects, Activity Work Plan Business Directorates DIGIT Contractors DGs involved by the synergies aspects ESS partners

Conceptual View

Architectural View

ESS View