1. (VIP-EDC) Point 6 of the agenda
Marc Vanderperren Eurostat B6: Dissemination

2. Motivations for running the project …
Increase stability & reliability
Extend the Eurostat dissemination chain to the ESS
Meet needs of Eurostat production units and of users for improvements in dissemination
Dissemination Working Group
17-18/10/2013

3. Motivations for running the project …
Increase stability & reliability
Extend the Eurostat dissemination chain to the ESS
Meet needs of Eurostat production units and of users for improvements in dissemination
Dissemination Working Group
17-18/10/2013

4. Motivations for running the project …
Increase stability & reliability
Extend the Eurostat dissemination chain to the ESS
Meet needs of Eurostat production units and of users for improvements in dissemination
Dissemination Working Group
17-18/10/2013

5. Project context 1 2 3 4 Actions Deliverables
Development towards a Eurostat / ESS
data warehouse
Strategy (context:
enterprise architecture)
Checking algorithms in Eurobase 2
Simplification and integration of the Eurostat Dissemination Chain
ESTAT Dissemination Processes
Impact Manager
Possible direct connection
betw. Data Explorer & Eurobase 3
More functionality for producing and disseminating Eurostat policy indicators
New production line for
indicator tables
Flexible dashboards for
policy indicators 4
More integration of Eurostat data and metadata in NSI dissemination
Embeddable visualisation tool
SDMX-compliant web services
Dissemination Working Group
17-18/10/2013

6. Concepts & feasibility studies
Results
Concepts & feasibility studies
Visualisation tools
Services & support
Dissemination Working Group
17-18/10/2013

7. Concepts & feasibility studies
Results
Concepts & feasibility studies
Visualisation tools
Services & support
Dissemination Working Group
17-18/10/2013

8. Dissemination Working Group
Results
Visualisation tools
Dissemination Working Group
17-18/10/2013

9. Project context NSI Development towards a Eurostat / ESS
data warehouse
Simplification and integration of the Eurostat Dissemination Chain
More functionality for producing and disseminating Eurostat policy indicators
NSI
More integration of Eurostat data and metadata in NSI dissemination
Embeddable visualisation tool
Dissemination Working Group
17-18/10/2013

10. Dissemination Working Group
Visualisation tools
Simple visualisation tools to be embedded in any website
Dissemination Working Group
17-18/10/2013

11. Dissemination Working Group
Visualisation tools
Dissemination Working Group
17-18/10/2013

12. Dissemination Working Group
Visualisation tools
Widgets
Dissemination Working Group
17-18/10/2013

13. Dissemination Working Group
Widgets
Data
Dissemination Working Group
17-18/10/2013

14. Dissemination Working Group
Widgets
Data
Dissemination Working Group
17-18/10/2013

15. Dissemination Working Group
Widgets
Dynamic
Dissemination Working Group
17-18/10/2013

16. Dissemination Working Group
Widgets
Mobility
Dissemination Working Group
17-18/10/2013

17. Dissemination Working Group
Widgets
Link + action
(e.g. sharing
content)
Dissemination Working Group
17-18/10/2013

18. Dissemination Working Group
Widgets
Simple visualisation components
To be embedded in any website
Dissemination Working Group
17-18/10/2013

19. Dissemination Working Group
17-18/10/2013

20. Dissemination Working Group
17-18/10/2013

21. Dissemination Working Group
Results
Visualisation tools
Dissemination Working Group
17-18/10/2013

22. Project context Development towards a Eurostat / ESS data warehouse
Simplification and integration of the Eurostat Dissemination Chain
More functionality for producing and disseminating Eurostat policy indicators
Flexible dashboards for
policy indicators
More integration of Eurostat data and metadata in NSI dissemination
Dissemination Working Group
17-18/10/2013

23. Dissemination Working Group
Flexible dashboards
Creation and publication of statistical data dashboards
Visual representations and explanations
Dissemination Working Group
17-18/10/2013

24. Dissemination Working Group
Before …
Needs & features
Use cases
Software Development
Technical testing
Functional testing
Acceptance testing
Packaging & delivery
Dissemination Working Group
17-18/10/2013

25. Dissemination Working Group
Before …
Needs & features
Use cases
Software Development
Technical testing
Functional testing
Acceptance testing
Packaging & delivery
Finally there !
Dissemination Working Group
17-18/10/2013

26. Settings definitions & composition
After
What data?
Which visualisation components?
Settings definitions & composition
Dissemination Working Group
17-18/10/2013

27. Settings definitions & composition
After
What data?
Which visualisation components?
Settings definitions & composition
Already there !
Dissemination Working Group
17-18/10/2013

28. Settings definitions & composition
Flexible dashboard
What data?
Which visualisation components?
Settings definitions & composition
Already there !
Dissemination Working Group
17-18/10/2013

29. Dissemination Working Group
Flexible dashboards
At Eurostat, decentralised set up of visualisations
IT development bottleneck is removed
For end users, interactivity inside the dashboards
Visualisations which can be used
by a wide audience
Dissemination Working Group
17-18/10/2013

30. Dissemination Working Group
17-18/10/2013

31. Dissemination Working Group31
Dissemination Working Group
17-18/10/2013

32. Project context Development towards a Eurostat / ESS data warehouse
Simplification and integration of the Eurostat Dissemination Chain
More functionality for producing and disseminating Eurostat policy indicators
Flexible dashboards for
policy indicators
More integration of Eurostat data and metadata in NSI dissemination
Embeddable visualisation tool
Dissemination Working Group
17-18/10/2013

33. Project context Development towards a Eurostat / ESS data warehouse
Simplification and integration of the Eurostat Dissemination Chain
More functionality for producing and disseminating Eurostat policy indicators
REST web services for
fully automated data delivery
More integration of Eurostat data and metadata in NSI dissemination
Dissemination Working Group
17-18/10/2013

34. Dissemination Working Group
Results
Services & support
Dissemination Working Group
17-18/10/2013

35. Project context Development towards a Eurostat / ESS data warehouse
Simplification and integration of the Eurostat Dissemination Chain
ESTAT Dissemination Processes
Impact Manager
More functionality for producing and disseminating Eurostat policy indicators
More integration of Eurostat data and metadata in NSI dissemination
Dissemination Working Group
17-18/10/2013

36. Dissemination Working Group
EDPIM
Simple (to use) application
monitoring the functioning and performance of the
Eurostat Dissemination Chain and other dissemination systems (e.g. Eurostat website)
Dissemination Working Group
17-18/10/2013

37. Eurostat Dissemination Chain
Dissemination Working Group
17-18/10/2013

38. Dissemination Working Group
Problem statement
Many systems
Many state changes
Multiple sources of information … & formats
Deep knowledge & multiple skills requirements
Time to reaction, impacts on business processes
Expertise
Dissemination Working Group
17-18/10/2013

39. Dissemination Working Group
Problem statement
Many systems
Many state changes
Multiple sources of information … & formats
Deep knowledge & multiple skills requirements
Time to reaction, impacts on business processes
Expertise
Dissemination Working Group
17-18/10/2013

40. Dissemination Working Group
EDPIM
Monitor & Control
Access processing information
Share information & knowledge
Users
(operations)
Steps
Availability
Systems & components
Assess impacts
Business
processes
Dissemination Working Group
17-18/10/2013

41. Dissemination Working Group
Purpose
Collect continuously data processing & systems information …
Detect & scan dissemination chain "events"
Assess potential impacts on business processes
Identify & manage dissemination chain "incidents"
Report & alert when relevant
Dissemination Working Group
17-18/10/2013

42. Dissemination Working Group
17-18/10/2013

43. Dissemination Working Group
17-18/10/2013

44. Dissemination Working Group
17-18/10/2013

45. Dissemination Working Group
Purpose
One shared tool to keep the overview of the dissemination chain
Knowledge sharing, support for operational decision making
Dissemination Working Group
17-18/10/2013

46. Services Development towards a Eurostat / ESS data warehouse
Checking algorithms in Eurobase
Simplification and integration of the Eurostat Dissemination Chain
More functionality for producing and disseminating Eurostat policy indicators
More integration of Eurostat data and metadata in NSI dissemination
Dissemination Working Group
17-18/10/2013

47. Checking algorithms in Eurobase
Ex-post data quality controls
offered as a service to
Domain Managers
Dissemination Working Group
17-18/10/2013

48. Services Development towards a Eurostat / ESS data warehouse
Simplification and integration of the Eurostat Dissemination Chain
More functionality for producing and disseminating Eurostat policy indicators
New production line for
indicator tables
More integration of Eurostat data and metadata in NSI dissemination
Dissemination Working Group
17-18/10/2013

49. New production line for indicator tables
Based on Eurobase functionalities, new production line is an additional option to create derived indicators
New indicators can be made available faster
Dissemination Working Group
17-18/10/2013

50. Services Development towards a Eurostat / ESS data warehouse
Simplification and integration of the Eurostat Dissemination Chain
More functionality for producing and disseminating Eurostat policy indicators
More integration of Eurostat data and metadata in NSI dissemination
SDMX-compliant web services
Dissemination Working Group
17-18/10/2013

51. Dissemination Chain Systems
Data visualisation
tools
Data extraction tools
Dissemination Working Group
17-18/10/2013

52. Dissemination Chain Systems Data Explorer, Tables Graphs & Maps, …
Data visualisation
tools
Data extraction tools
Data Explorer, Tables Graphs & Maps, …
Dissemination Working Group
17-18/10/2013

53. Dissemination Chain Systems Bulk download / NavTree
Data visualisation
tools
Data extraction tools
Bulk download / NavTree
Dissemination Working Group
17-18/10/2013

54. Dissemination Chain Systems Bulk download / NavTree
Data visualisation
tools
Data extraction tools
Bulk download / NavTree
web service
Dissemination Working Group
17-18/10/2013

55. Dissemination Chain Systems
Data visualisation
tools
Data extraction tools
Bulk download / NavTree
Dissemination Web Service
Dissemination Working Group
17-18/10/2013

56. Data retrieval process
Identify data
Navigation Tree (search database)
RSS feed
Get list of available datasets
Dissemination Working Group
17-18/10/2013

57. Data retrieval process
Identify data
Retrieve
DSD
/rest/datastructure/ESTAT/DSD_prc_hicp_midx/latest
Dissemination Working Group
17-18/10/2013

58. Data retrieval process
Identify data
Retrieve
DSD
Retrieve
Data
/rest/data/prc_hicp_midx/..CP00.EU+DE+FR
Dissemination Working Group
17-18/10/2013

59. Project context 1 2 3 4 Actions Deliverables
Development towards a Eurostat / ESS
data warehouse
Strategy (context:
enterprise architecture)
Checking algorithms in Eurobase 2
Simplification and integration of the Eurostat Dissemination Chain
ESTAT Dissemination Processes
Impact Manager
Possible direct connection
betw. Data Explorer & Eurobase 3
More functionality for producing and disseminating Eurostat policy indicators
New production line for
indicator tables
Flexible dashboards for
policy indicators 4
More integration of Eurostat data and metadata in NSI dissemination
Embeddable visualisation tool
SDMX-compliant web services
Dissemination Working Group
17-18/10/2013

60. (VIP-EDC) Point 6 of the agenda
Marc Vanderperren Eurostat B: Dissemination