Disseminating statistics: Internet and Publications course Eurostat - Air transport statistics To use descriptive data made available under a license agreement within an SDMX based statistical production process Madrid, 4-6 April 2011 Disseminating statistics: Internet and Publications course
Air transport statistics… EU REGULATION ON AIR TRANSPORT STATISTICS Legal framework Data provision obligation Airports, Aircrafts, Airlines Datasets: A1, B1 and C1 Main data: passengers, freight flight stages, origin/destination data, airport data Data collection via Eurostat Single Entry Point for data Data dissemination via Eurostat Website and.... Eurostat to provide ICAO codes to MS Madrid, 4-6 April 2011 Disseminating statistics: Internet and Publications course
ICAO: International Civil Aviation Organisation ICAO codification system is used for: Reporting country two-letter code. Examples: France, LF; Germany, ED. Airports. Four-letter location indicator (Document 7910). Aircraft type. Aircraft type designators as per Document 8643. Airlines. Four-letter designator (Document 8585). Madrid, 4-6 April 2011 Disseminating statistics: Internet and Publications course
ICAO: International Civil Aviation Organisation Founded in 1944 following a Convention on International Civil Aviation (Chicago Convention) Currently about 189 Contracting States Regarding data dissemination, statistics collected by ICAO are available on-line, free of charge, to staff of the national civil aviation administrations of the Contracting States. For other users, the access is only granted by purchasing a subscription Madrid, 4-6 April 2011 Disseminating statistics: Internet and Publications course
Milestone Eurostat and ICAO signed a license agreement in November 2010! Concerns the regular delivery of ICAO data files (after more than 3 years without any updates…). Limited distribution: only available for a predefined group of users Madrid, 4-6 April 2011 Disseminating statistics: Internet and Publications course
Improvement of data quality SDMX based pre validation of data: eDAMIS validation engine used to validate incoming data files having an SDMX-ML format Allow MS to create data files in SDMX-ML format AIR Data Structure Definition to be distributed to MS via available channels SDMX concept: no special arrangements for meta data to be treated as confidentiality Tools like the SDMX registry do not yet offer public and private areas Madrid, 4-6 April 2011 Disseminating statistics: Internet and Publications course
How do we currently address the problem of code list distribution? For the incoming data: Data Structure definition added to the package send quarterly to official receiver of the ICAO codes Disseminating statistical data on the Eurostat website: no complete code lists anymore only descriptions published Madrid, 4-6 April 2011 Disseminating statistics: Internet and Publications course
What about the future data collection and publication? are these simple measures sustainable? …when more and more other data sources are used to link with statistical data …being made available only under certain conditions ….with changing user needs ….with possibly further commercialisation Madrid, 4-6 April 2011 Disseminating statistics: Internet and Publications course
Disseminating statistics: Internet and Publications course Madrid, 4-6 April 2011 Disseminating statistics: Internet and Publications course
Disseminating statistics: Internet and Publications course SDMX for Data Senders Initiative for common standards across organizations Transmission format for statistical data Based on standard XML SDMX Data Structure Definition (DSD) Collection of Code Lists and Concepts used for a Dataset SDMX Registry Central Repository for SDMX DSDs and Code Lists Madrid, 4-6 April 2011 Disseminating statistics: Internet and Publications course
eDAMIS Validation Engine for … Data Receivers Based on SDMX DSDs Links to SDMX Registry Same syntax as eWF for Data Validation Less iterations for transmissions lowers workload Data Senders All transmission channels Support confidential datasets Validation transparent to data senders Full automatic transmission and level 1 validation workflow Madrid, 4-6 April 2011 15-Oct-10 Disseminating statistics: Internet and Publications course 11
Workflow eDAMIS Validation Engine SDMX Registry DSDs Web Service Browser SDMX Converter CSV Settings MS Database Eurostat Production Unit eDAMIS Server Validation SDMX eWP eWA Report Report Madrid, 4-6 April 2011 Disseminating statistics: Internet and Publications course