EDAMIS3: CURRENT STATUS Item 2.1 of Agenda DTCG Working Group 17 / 18 June 2019 Eurostat Unit B5
The Return of the Groundhog DTCG Working Group 17 / 18 June 2019
DTCG Working Group 17 / 18 June 2019 Since we last met …. Relative stability of EDAMIS3 (EWP, EWF, EWA) – no new features but ongoing support and maintenance Limited changes to the production dataset inventory but addition of several validation domains and datasets Wide launch of EDAMIS4 for data transmission Testing of new EDAMIS4, ESDEN client and server Work to phase out the use of EWAs (LT, LU …) Work to close down EVE (scheduled for July 2019) Completion of the 2018 Coverage Indicator and Statistics Ongoing support to Countries and within Eurostat DTCG Working Group 17 / 18 June 2019
Active Dataset Inventory as of 31 May 2019 261 domains - 75 solely metadata related 2,173 datasets - 1,517 for data exchange - 584 with linked statistical product(s) 973 Annual 148 Quarterly (including National Accounts x 25, STS x 22) 124 Monthly (including STS x 26) 139 Non-Sequential 131 Webforms (predominantly agriculture, environment, REGWEB) Main changes due to creation of new validation datasets (V*) * Multi- and little used periodicities (A2, O …) have been eliminated * DTCG Working Group 17 / 18 June 2019
(Pre-)Validation Datasets 282 datasets concern (pre-)validation (V*) (up from 110 in 2017 and 196 in 2018) 62 National Accounts (VNAMAIN (23), VNASEC (14)) 45 Short-Term Statistics (VSTSCONS (12), VSTSIND (10), VSTSSERV (11)) 26 EuroGroups Register / Interactive Profiling Tool 21 Urbanreg 12 Harmonised Consumer Price Index (HICP) 12 Fish Asylum, Enforcement of Immigration Legislation, Migration Harmonised Consumer Price Index (HICP) Information Society / Research & Development External Trade (COMEXT) Environment DTCG Working Group 17 / 18 June 2019
DTCG Working Group 17 / 18 June 2019 EDAMIS Inventory – Alignment with Other Tools and Ongoing Improvement Work Ensure the alignment / coherence of datasets and metadataflows between EDAMIS and ESS-Metadata Handler link EDAMIS datasets with the corresponding ESS-MH metadataflows eliminate the metadataflows with names not following the EDAMIS naming convention prepare the platform for the link metadataflows with datasets (for EDAMIS4) Check the current coverage for National metadata implementation Enhance metadata content in EDAMIS (links and reports) Enhance Statistical Data Products content (links and reports) DTCG Working Group 17 / 18 June 2019
Unique Users by Country (Data Transmission) (Year to 31 May 2019) AL 34 LI 12 AT 90 LT 106 BA 31 LU 85 BE 99 LV 95 BG 66 ME 40 CH 62 MK 43 CY 77 MT CZ 108 NL 122 DE 153 NO 119 DK 113 PL 36 EE 81 PT 126 EL RO 37 ES 129 RS 58 FI 188 SE 160 FR 138 SI 120 HR 88 SK HU TR 84 IE UK 186 IS 61 XK 28 IT 104 DTCG Working Group 17 / 18 June 2019
Coverage Indicator for 2018 Significant work was made in early 2019 Substantial input from seven TCOs updates made to Basis for Transmission corrections made to transmissions with incorrect periods, etc. timetables regenerated …… Three countries with 100% coverage – AT, NL, SI EU-28 average for calendar 2018 – 96.2% (2017 – 97.7%) DTCG Working Group 17 / 18 June 2019
Coverage Indicator for 2018 - Overall 100 IE 94 BE 98 IT 99 BG 93 LT CY LU CZ LV 97 DE 96 MT 95 DK NL EE PL EL 81 PT ES RO FI 91 SE FR SI HR SK HU 92 UK DTCG Working Group 17 / 18 June 2019
Coverage Indicator for 2018 - Timeliness Country Received On-Time Expected On-Time Coverage (%) AT 783 879 89.08 IE 660 844 78.20 BE 710 849 83.63 IT 874 81.24 BG 645 810 79.63 LT 773 847 91.26 CY 654 818 79.95 LU 643 840 76.55 CZ 736 86.69 LV 746 821 90.86 DE 841 945 88.99 MT 568 800 71.00 DK 709 853 83.12 NL 824 886 93.00 EE 714 826 86.44 PL 719 84.89 EL 662 981 67.48 PT 802 970 82.68 ES 778 923 84.29 RO 799 84.55 FI 784 939 83.49 SE 750 850 88.24 FR 775 926 83.69 SI 753 848 88.80 HR 688 831 82.79 SK 865 887 97.52 HU 852 83.80 UK 694 845 82.13 DTCG Working Group 17 / 18 June 2019
Transmissions in 2018 – Busiest Days 21 December 1635 20 December 1305 14 December 1049 30 November 1753 29 November 1156 01 October 1061 28 September 2897 27 September 1232 31 August 1367 29 June 2108 28 June 1506 31 May 1561 30 May 1331 29 March 1330 28 February 2653 DTCG Working Group 17 / 18 June 2019
Transmissions in 2018 – Version Numbers 39639 2 17282 3 8556 4 4836 5 3022 6 2075 7 1402 8 1072 9 820 10+ 6775 Non-Periodic 15412 Report 181 Feedback 29746 DTCG Working Group 17 / 18 June 2019
Coverage Indicator / Transmissions for 2018 Two files provided alongside this presentation allow for countries to further dissect the coverage indicator and gain additional insight into the form and type of transmissions charts_eu_coverage_indicator_2018.xlsx charts_transmissions_2018_complete.xlsx DTCG Working Group 17 / 18 June 2019
Validation / Feedback Causing Delays The large number of validation / feedback files now being processed causes some delays, especially on busy days Example - on 28 September 895 feedback files were processed out of a total 2897 transmissions. Work is underway to improve this situation – possibly to restrict the physical files to failed validation only DTCG Working Group 17 / 18 June 2019
Just some of the work planned for the remainder of 2019 Ongoing support for Countries and within Eurostat Input to the design and future development of EDAMIS4 and ESDEN Testing, testing and more testing ….. Migration of User Management and Reports from EDAMIS3 to EDAMIS4 Consideration of the future of Webforms in EDAMIS4 Continue to improve links between EDAMIS and other tools Enhance the data transmission InfoSpace, FAQ, etc. Prepare user documentation for EDAMIS4 Still more testing …. Continued training (via webinars and in-house) Introduce ESDEN to replace the STADIUM server DTCG Working Group 17 / 18 June 2019
Support Requests (Year to 31 May 2019) ( very approximate figures) From Outside (directly from Countries) 1200 From Inside (from Eurostat colleagues) 900 From Outside via Inside (from Countries via Eurostat colleagues) 1100 (includes internal support teams) Total Requests 3200 DTCG Working Group 17 / 18 June 2019
The Marvellouso Michaelo Predictions Very poor success rate for last year's predictions! 20% 0% 0% So this year only the one (and it is a certainty): DTCG Working Group 17 / 18 June 2019
DTCG Working Group 17 / 18 June 2019 estat-support-edamis@ec.europa.eu DTCG Working Group 17 / 18 June 2019