The migration to the new EDAMIS ESDEN The migration to the new EDAMIS ESDEN Steering Group meeting Javier MANSO DEL VALLE Directorate B - Methodology; corporate statistical and IT services Eurostat October 11th, 2017

Agenda Overview of the migration Components to migrate The migration, step by step Summary

Overview of the migration

Approach Objective: minimal impact for business Gradual introduction of changes Rollback procedures foreseen Transition phase Both versions running Volunteering organisations involved earlier Phase out of current EDAMIS only after migration completed What else do we want to add to this timetable?

Migration overview P1: develop and test EDAMIS 4 P2: EDAMIS 4 available in parallel P3: stop access to EDAMIS 3 P4: migrate delivery to EDAMIS 4 P5: phase-out of EDAMIS 3 2017 Q4 2018 Q2 2018 Q3 2018 Q4 What else do we want to add to this timetable?

Components to migrate Web Portal Stadium Inventory Including Web Forms New portal, HTML5-based Stadium Routing back-end Replaced by ESDEN Inventory Contains definition of domains, datasets, users, rights, etc.

The migration, step by step

Phase P1: develop & test EDAMIS 4 Web Application Application STADIUM Dataset inventory EDAMIS Web Portal EDAMIS 3 Application What else do we want to add to this timetable? Application NSI

Phase P1: develop & test EDAMIS 4 Environment during this phase EDAMIS 3 operational EDAMIS 4 under development by Eurostat Internal testing by Eurostat Then testing with ESS Member states At the end of this phase Milestone M1: EDAMIS 4 go-live Estimated planning: until December 2017

Phase P2: make new portal available EDAMIS Web Application Application STADIUM Dataset inventory EDAMIS Web Portal EDAMIS 3 Application EDAMIS 4 What else do we want to add to this timetable? Application Dataset inventory NSI EDAMIS 4 Web Portal

Phase P2: make new portal available Environment during this phase EDAMIS 3 fully operational with no changes EDAMIS 4 Web Portal available to be used File delivery is performed by EDAMIS 3 At the end of this phase Milestone M2: EDAMIS 4 used by all organisations Estimated Planning: Jan 2018 to Jun 2018 What happens with WebForms? Should not be used for production before validation of the portal. Should we have a phase for "validation" that is already production?

Phase P2: make new portal available Actions during this phase ESS Members get acquainted with the new tool All ESS Members send files with EDAMIS 4 Migration of Web Forms In case of problems Use EDAMIS 3, which remains unmodified For Web Forms, ESTAT support teams involved

Migration of EDAMIS Web Forms Each form will move on a planned date Before the move Historical data copied by Eurostat Testing by Member States possible The move New URL to access Forms to be filled on Web Forms 4 Web Forms 3 available in read-only What else do we want to add to this timetable?

New in EDAMIS Web Forms New, HTML5-based interface Possibility of pre-validation Validation prior to official submission Coherency of validation rules Common set of rules for Web forms and rest of transmission methods

Coherency of validation rules EDAMIS Web Forms Data provider Validation engine What else do we want to add to this timetable? EDAMIS STADIUM European statistics Statistical production

Phase P3: migrate inventory mgmt. EDAMIS Web Application Application STADIUM Dataset inventory EDAMIS Web Portal EDAMIS 3 Application EDAMIS 4 What else do we want to add to this timetable? Application Dataset inventory NSI EDAMIS 4 Web Portal

Phase P3: migrate inventory mgmt. Environment during this phase EDAMIS 3 Web Portal only available exceptionally EDAMIS 4 Web Portal used by all organisations EDAMIS 3 Web Application still available At the end of this phase Milestone M3: close access to EDAMIS 3 Web Portal Estimated planning: Jul-Aug 2018

Phase P3: migrate inventory mgmt. Actions during this phase Eurostat migrates dataset inventory to EDAMIS 4 Validate reporting and notifications In case of problems Eurostat will rollback to previous situation EDAMIS 3 Web Portal can still be used

Phase P4: migrate delivery to ESDEN EDAMIS Web Application Application STADIUM Dataset inventory EDAMIS Web Portal EDAMIS 3 Application EDAMIS 4 What else do we want to add to this timetable? Application ESDEN NSI EDAMIS 4 Web Portal Dataset inventory

NSI Standard protocols AS4 sFTP access point Application AS4 Automatic data exchange sFTP EDAMIS 4 Application sFTP server EDAMIS 4 What else do we want to add to this timetable? Manual data exchange Web Application ESDEN NSI EDAMIS 4 Web Portal Dataset inventory

Phase P4: migrate delivery to ESDEN Environment during this phase EDAMIS 4 fully operational EDAMIS 3 Web Application still available No changes for users File delivery is gradually moved to EDAMIS 4 At the end of this phase Milestone M4: ESDEN delivers all files Estimated planning: Aug 2018 to Dec 2018

Phase P4: migrate delivery to ESDEN Actions during this phase Eurostat migrates file delivery to ESDEN Work is done per domain – ensure close follow-up Eurostat units validate file delivery works ok In case of problems File delivery can be configured as before EDAMIS 3 Web Portal available exceptionally

Phase P5: phase-out of EDAMIS 3 Web Application Application STADIUM Dataset inventory EDAMIS Web Portal EDAMIS 3 Application EDAMIS 4 What else do we want to add to this timetable? Application ESDEN NSI EDAMIS 4 Web Portal Dataset inventory

Phase P5: phase-out of EDAMIS 3 access point Application Automatic data exchange EDAMIS 4 Application sFTP server What else do we want to add to this timetable? Manual data exchange Application ESDEN NSI EDAMIS 4 Web Portal Dataset inventory

Phase P5: phase-out of EDAMIS 3 Environment during this phase EDAMIS 4 is fully operational EDAMIS 3 Web Applications being phased out At the end of this phase Milestone M5: EDAMIS 3 is shut down Estimated planning: Dec 2018 to Apr 2019

Phase P5: phase-out of EDAMIS 3 Actions during this phase Work per country and organisation at a time Eurostat supports connection to secure networks Eurostat helps migrating from EWA to other transmission means In case of problems Extend use of EDAMIS 3 Web Application

Migration is completed End of project Migration is completed

Timetable 2017 2018 2019 Q3 Q4 Q1 Q2 Acceptance testing EDAMIS portal v3 in production EDAMIS v4 in production Migration of Web Forms Migration of delivery Phase-out of EWA P1 Develop P2 Parallel versions P4 Parallel versions P5: EWA phase-out EDAMIS 4 is primary Close EDAMIS 3 portal End of ESDEN project EVUG 2017