Project objectives and benefits ESDEN Project objectives and benefits ESDEN Steering Group meeting Álvaro DÍEZ SOTO Directorate B - Methodology; corporate statistical and IT services Eurostat October 11th, 2017

Agenda What was ESDEN, again? Current project status Objectives and benefits of the ESDEN project Current project status Overall planning What has the project achieved? What will the project do next? For more information

What was ESDEN, again?

ESS Vision 2020 Where do we want to be? How do we get there? Five key areas for delivering our vision: Identifying user needs and cooperation with stakeholders Quality of European statistics New data sources Efficient and robust statistical processes Dissemination and communication on European statistics ESS = European Statistical System The ESS Vision 2020 is a common strategic response of the European Statistical System (Eurostat, EU Member States and EFTA countries) to the challenges that official statistics are facing. It was adopted by the ESS Committee in May 2014. More information on the ESS Vision 2020: http://ec.europa.eu/eurostat/web/ess/about-us/ess-vision-2020 The ESDEN project contributes to two of the five key areas defined in the ESS Vision 2020.

ESS Vision 2020 Key area 3: new data sources We will exploit the potential of new data sources Find suitable technology to use new data sources A digital transformation is taking place across the globe: the data revolution is already presenting official statistics with profound strategic questions. The ever increasing availability of data is a trend that is of strategic relevance for official statistics. We want to harness new data sources to produce meaningful statistics. The possibility of using big data in the production of official statistics will be fully explored.

ESS Vision 2020 Key area 4: efficient and robust processes Collaboration based on standards and common technological and statistical elements Sharing IT services and infrastructure We will use common methods and tools. We will explore other areas and use all the opportunities, in particular when dealing with new technology-driven areas like big data, open data and visualization techniques where we expect concrete opportunities to emerge. We will benefit from exchange of (micro)data, while fully respecting statistical confidentiality. CONCLUSION: all the elements of the ESS Vision 2020 explained so far call for a modernisation of the data exchange infrastructure.

What is ESDEN? ESDEN is a project of the ESS Vision 2020 Objective: "Modernisation of the data exchange services across the ESS, increasing the data exchange capacity and upgrading the security to allow a more efficient and secure data exchange in the ESS"

Data Exchange in the ESS European Statistics are produced by Eurostat alone. The production of European Statistics is only possible thanks to the exchange of statistical data between the organisations that are part of the European Statistical System (ESS).

Data Exchange: secure network In order to perform the exchange of data, organisations in the ESS need an IT infrastructure than can transmit big amounts of data, in a secure way, between organisations. The first objective of the ESDEN project is to provide this secure IT network.

Data Exchange: Single Entry Point In the ESS, the exchange of data revolves around the concept of Single Entry Point: data for all statistical domains arrives at a common reception area in Eurostat where they can be automatically monitored, checked and delivered to the target production environment with a set of common informatics tools.

Data Exchange: Single Entry Point The Single Entry Point concept is implemented by the application EDAMIS, therefore a fundamental part of the effort of the ESDEN focuses on the modernisation of EDAMIS. Single Entry Point (EDAMIS)

ESDEN benefits Provide connectivity to secure networks A new EDAMIS ESDEN has two main objectives, and therefore two main areas of activities: 1. provide connectivity to secure european networks, operated by the European Commission (i.e. TESTA, CCN); and 2. modernise EDAMIS.

ESDEN benefits Provide connectivity to secure networks Capacity to exchange sensitive data through secure networks, avoiding Internet Capacity to transfer higher volumes faster Enable the usage of new data sources

ESDEN benefits A new EDAMIS Increased security Better support for encryption Better traceability Use of standard protocols Easier to plug to national systems Allow automation New EDAMIS portal, faster and easier to use

Current project status

Overall planning Phase 1 (2015-2016) Phase 2 (2016-2017) Secure infrastructure for the pilot on microdata exchange (SIMSTAT) Phase 2 (2016-2017) Connect rest of ESS members to the secure network infrastructure Modernisation of the data exchange infrastructure (EDAMIS) Phase 3 (2018) Migration to the new EDAMIS

Timeline Init. Phase 1 Phase 2 Phase 3 Phases Project life span 2013 2014 2015 2016 2017 2018 2019 2020 Init. Phase 1 Phase 2 Phase 3 Phases Project life span Closure ESSC ESSC ESSC ESSC Decision points Steering Group ESSNet Grants Today

Phase 2 achievements New EDAMIS Connectivity to secure networks New architecture defined Migration plan prepared New version coming up Connectivity to secure networks TESTA network validated Successful tests carried out with the NSIs of Spain, Sweden and The Netherlands The data revolution is already presenting official statistics with profound strategic questions Global digital transformation Ever increasing availability of data We want to harness new data sources to produce meaningful statistics

Secure connectivity: current status Connected to TESTA to CCN Unknown NSIs DK, ES, HU, LV, NL, SE Ongoing: AT, HR, PL, UK Total: 10 AT, BG, CZ, CY, DE, DK, EE, EL, HR, IT, LU, LT, MT, PL, PT, RO, SK, SI Total: 18 BE, IE Total: 2 ONAs ES National Bank ECB All customs Ongoing: BE NBB All other ONAs

Next steps New EDAMIS Connectivity to secure networks Migration to the new version Connectivity to secure networks Connect additional organisations Support micro data exchange in production The data revolution is already presenting official statistics with profound strategic questions Global digital transformation Ever increasing availability of data We want to harness new data sources to produce meaningful statistics

For more information

For more infos, contact Eurostat For questions: The support team can be contacted using the following address estat-support-edamis@ec.europa.eu For information and discussions: Participate to the Yammer group https://www.yammer.com/edamisdevelopmentsusernetwork