1. The migration to the new EDAMIS
ESDEN
The migration to the new EDAMIS
ESDEN Steering Group meeting
Javier MANSO DEL VALLE
Directorate B - Methodology; corporate statistical and IT services
Eurostat
October 11th, 2017

2. Agenda Overview of the migration Components to migrate
The migration, step by step
Summary

3. Overview of the migration

4. Approach Objective: minimal impact for business
Gradual introduction of changes
Rollback procedures foreseen
Transition phase
Both versions running
Volunteering organisations involved earlier
Phase out of current EDAMIS only after migration completed
What else do we want to add to this timetable?

5. Migration overview P1: develop and test EDAMIS 4
P2: EDAMIS 4 available in parallel
P3: stop access to EDAMIS 3
P4: migrate delivery to EDAMIS 4
P5: phase-out of EDAMIS 3
2017 Q4
2018 Q2
2018 Q3
2018 Q4
What else do we want to add to this timetable?

6. Components to migrate Web Portal Stadium Inventory Including Web Forms
New portal, HTML5-based
Stadium
Routing back-end
Replaced by ESDEN
Inventory
Contains definition of domains, datasets, users, rights, etc.

7. The migration, step by step

8. Phase P1: develop & test EDAMIS 4
Web Application
Application
STADIUM
Dataset
inventory
EDAMIS
Web Portal
EDAMIS 3
Application
What else do we want to add to this timetable?
Application
NSI

9. Phase P1: develop & test EDAMIS 4
Environment during this phase
EDAMIS 3 operational
EDAMIS 4 under development by Eurostat
Internal testing by Eurostat
Then testing with ESS Member states
At the end of this phase
Milestone M1: EDAMIS 4 go-live
Estimated planning: until December 2017

10. Phase P2: make new portal available
EDAMIS
Web Application
Application
STADIUM
Dataset
inventory
EDAMIS
Web Portal
EDAMIS 3
Application
EDAMIS 4
What else do we want to add to this timetable?
Application
Dataset
inventory
NSI
EDAMIS 4
Web Portal

11. Phase P2: make new portal available
Environment during this phase
EDAMIS 3 fully operational with no changes
EDAMIS 4 Web Portal available to be used
File delivery is performed by EDAMIS 3
At the end of this phase
Milestone M2: EDAMIS 4 used by all organisations
Estimated Planning: Jan 2018 to Jun 2018
What happens with WebForms? Should not be used for production before validation of the portal.
Should we have a phase for "validation" that is already production?

12. Phase P2: make new portal available
Actions during this phase
ESS Members get acquainted with the new tool
All ESS Members send files with EDAMIS 4
Migration of Web Forms
In case of problems
Use EDAMIS 3, which remains unmodified
For Web Forms, ESTAT support teams involved

13. Migration of EDAMIS Web Forms
Each form will move on a planned date
Before the move
Historical data copied by Eurostat
Testing by Member States possible
The move
New URL to access
Forms to be filled on Web Forms 4
Web Forms 3 available in read-only
What else do we want to add to this timetable?

14. New in EDAMIS Web Forms New, HTML5-based interface
Possibility of pre-validation
Validation prior to official submission
Coherency of validation rules
Common set of rules for Web forms and rest of transmission methods

15. Coherency of validation rules
EDAMIS Web Forms
Data provider
Validation engine
What else do we want to add to this timetable?
EDAMIS STADIUM
European
statistics
Statistical production

16. Phase P3: migrate inventory mgmt.
EDAMIS
Web Application
Application
STADIUM
Dataset
inventory
EDAMIS
Web Portal
EDAMIS 3
Application
EDAMIS 4
What else do we want to add to this timetable?
Application
Dataset
inventory
NSI
EDAMIS 4
Web Portal

17. Phase P3: migrate inventory mgmt.
Environment during this phase
EDAMIS 3 Web Portal only available exceptionally
EDAMIS 4 Web Portal used by all organisations
EDAMIS 3 Web Application still available
At the end of this phase
Milestone M3: close access to EDAMIS 3 Web Portal
Estimated planning: Jul-Aug 2018

18. Phase P3: migrate inventory mgmt.
Actions during this phase
Eurostat migrates dataset inventory to EDAMIS 4
Validate reporting and notifications
In case of problems
Eurostat will rollback to previous situation
EDAMIS 3 Web Portal can still be used

19. Phase P4: migrate delivery to ESDEN
EDAMIS
Web Application
Application
STADIUM
Dataset
inventory
EDAMIS
Web Portal
EDAMIS 3
Application
EDAMIS 4
What else do we want to add to this timetable?
Application
ESDEN
NSI
EDAMIS 4
Web Portal
Dataset
inventory

20. NSI Standard protocols AS4 sFTP
access point
Application
AS4
Automatic
data exchange
sFTP
EDAMIS 4
Application
sFTP server
EDAMIS 4
What else do we want to add to this timetable?
Manual
data exchange
Web
Application
ESDEN
NSI
EDAMIS 4
Web Portal
Dataset
inventory

21. Phase P4: migrate delivery to ESDEN
Environment during this phase
EDAMIS 4 fully operational
EDAMIS 3 Web Application still available
No changes for users
File delivery is gradually moved to EDAMIS 4
At the end of this phase
Milestone M4: ESDEN delivers all files
Estimated planning: Aug 2018 to Dec 2018

22. Phase P4: migrate delivery to ESDEN
Actions during this phase
Eurostat migrates file delivery to ESDEN
Work is done per domain – ensure close follow-up
Eurostat units validate file delivery works ok
In case of problems
File delivery can be configured as before
EDAMIS 3 Web Portal available exceptionally

23. Phase P5: phase-out of EDAMIS 3
Web Application
Application
STADIUM
Dataset
inventory
EDAMIS
Web Portal
EDAMIS 3
Application
EDAMIS 4
What else do we want to add to this timetable?
Application
ESDEN
NSI
EDAMIS 4
Web Portal
Dataset
inventory

24. Phase P5: phase-out of EDAMIS 3
access point
Application
Automatic
data exchange
EDAMIS 4
Application
sFTP server
What else do we want to add to this timetable?
Manual
data exchange
Application
ESDEN
NSI
EDAMIS 4
Web Portal
Dataset
inventory

25. Phase P5: phase-out of EDAMIS 3
Environment during this phase
EDAMIS 4 is fully operational
EDAMIS 3 Web Applications being phased out
At the end of this phase
Milestone M5: EDAMIS 3 is shut down
Estimated planning: Dec 2018 to Apr 2019

26. Phase P5: phase-out of EDAMIS 3
Actions during this phase
Work per country and organisation at a time
Eurostat supports connection to secure networks
Eurostat helps migrating from EWA to other transmission means
In case of problems
Extend use of EDAMIS 3 Web Application

27. Migration is completed
End of project
Migration is completed

28. Timetable 2017 2018 2019 Q3 Q4 Q1 Q2 Acceptance testing
EDAMIS portal v3
in production
EDAMIS v4
in production
Migration of
Web Forms
Migration of
delivery
Phase-out
of EWA P1
Develop P2
Parallel versions P4
Parallel versions
P5: EWA
phase-out
EDAMIS 4
is primary
Close
EDAMIS 3 portal
End of
ESDEN project
EVUG 2017