Ana Maqueda - Eurostat Unit G5 Luxembourg- 18 April 2012 MEDSTAT III Workshop External trade data dissemination & relations with users : Eurostat G5 practice Ana Maqueda - Eurostat Unit G5 Luxembourg- 18 April 2012
Today's presentation Main tasks Disseminated data Dissemination means User Support Challenges Eurostat - Unit G5
Dissemination and user support Main tasks: Disseminate detailed trade data and metadata through Comext to the EU Commission, EU institutions, National Administrations and general public Provide a continuous support to the users Organise co-operation activities related to data dissemination Eurostat - Unit G5
Disseminated data Public EU, EFTA, BALKAN, MEDSTAT data by (depending on domain): - CN (8 digits) and HS product classifications - SITC, CPA, BEC, … - By tariff regime - By mode of transport Other data (Indices, Prodcom…) Restricted to Commission only UN database (Comtrade) and IMF database Data from cooperating third countries (Japan, Canada, Hong-Kong, …) EU Trade data by TARIC10 codes Eurostat - Unit G5
Dissemination means - EASY COMEXT Public EASY COMEXT is an HTML based interface giving access to data and metadata (classifications and methodological notes) Database size: ~600 Gb Nb registered Users = ~14.000 Nb records loaded in 2011 = ~1 billion Nb records stored for 2011 (1 record containing 12 months of values, quantities, …) = ~115 millions Nb extractions in 2011 = ~750.000 http://epp.eurostat.ec.europa.eu/newxtweb/ Eurostat - Unit G5
Dissemination means - EASY COMEXT The main page gives access to: User Menu Registered user Non Registered user Available Datasets (hierarchic presentation) Available Nomenclatures Browse nomenclature Download Nomenclature Relation selection Open Relation Download Relation News section Eurostat - Unit G5
Dissemination means - EASY COMEXT 3 steps to extract the data Extraction definition (content) Extraction layout (presentation) Extraction output options Eurostat - Unit G5
Extraction definition EASY COMEXT – Step 1 Extraction definition Select dataset´s dimensions: Partner Product/s Flow (imp/exp) Period Indicator (value, volume etc..) Eurostat - Unit G5
EASY COMEXT – Step 1 : Extraction definition Eurostat - Unit G5
Extraction Layout EASY COMEXT – Step 2 User defines the structure of the table in which the data will be displayed. Display options for each dimension (Codes, Labels or Codes and Labels) Number of rows / Columns to be displayed per table Eliminate Zeros option (remove the unused coordinates) Eurostat - Unit G5
EASY COMEXT – Step 2 Eurostat - Unit G5
Launching the Extraction EASY COMEXT – Step 3 Launching the Extraction Non Registered users can bookmark the query definition for future use and launch the extraction (interactive mode) In addition, registered users can: Launch a Batch extraction and define several options: Generation of output file Saving of the extraction Request for receiving information when the selected dataset has been updated Define the query as “default” for the selected dataset Generate the output file without displaying the result table Eurostat - Unit G5
EASY COMEXT – Displaying the results Eurostat - Unit G5
Dissemination means: Comext on-line Restricted COMEXT ON-LINE is a Java based interface giving access to external trade database Database size = ~1.700 Gb Nb Users = ~800 Nb records loaded in 2011 = ~2,5 billions total, ~1,6 billions MS Nb records stored for 2011 (1 record containing 12 months of values, quantities, ...) = 80 millions Nb extractions in 2011 = ~60.000 About 40 redistributors of Comext data Eurostat - Unit G5
Dissemination means: Comext on-line Using the same “concept” than Easy Comext, the analytical version is providing advanced features: Multiple “Databases” access Reorganise function (management of the name, the properties and the number of dimensions) Reshape functions (Drop and Vector options) Management of User’s formulas to be computed during the extraction Additional output formats Services Advanced post computation options Eurostat - Unit G5
Comext On-Line : Output formats Print Printable table Dump Structured flat file Generate Table Text file pre formatted for Excel or Dbase Out Data Set of several ouput formats (XML, CSV, DAT, ..) Graph Set of several Graph options (Pie, Line, Bar, Area, Bubble, Scatter Map For dimension having an associated Map information Eurostat - Unit G5
Comext On-Line : Services Services enable user to predefine a full process, from extraction definition to output files. The extraction plan is defined, the date and time is scheduled and the outputs are defined. The results (extractions and output files) are stored in the user repository and can also be sent to the user by email Eurostat - Unit G5
Comext On-Line Eurostat - Unit G5
Dissemination Means – Others Eurostat Data Explorer interface http://epp.eurostat.ec.europa.eu/portal/page/portal/external_trade/data/database DVD –Bulk download Publications Eurostat - Unit G5
Eurostat Data Explorer interface Eurostat - Unit G5
Exemple of Eurostat Data Explorer Eurostat - Unit G5
Comext DVD DVD copies distributed each month Direct download 276 GB/year http://epp.eurostat.ec.europa.eu/NavTree_prod/everybody/BulkDownloadListing?dir=comext/MOST_RECENT_COMEXT_DVD Eurostat - Unit G5
Publications Monthly News Release Euro indicators News Releases for EU summits Statistics in focus (SIF) Yearbook Pocketbook Methodological publications: Quality report Geonomenclature etc. Eurostat - Unit G5
Statistics Explained (SE) Based on WIKI technology Editing restricted to ESTAT staff Information organised in statistical “articles” Will gradually replace PDF publications Targeted to non-expert users English + a subset translated in all EU languages Use of hyperlinks (internal or external) Is not intended to show the latest information website Eurostat - Unit G5
Example of a statistical article Eurostat - Unit G5
User support User support Email: comextsupport@ec.europa.eu Xnet Assist: http://epp.eurostat.ec.europa.eu/portal/page/portal/help/user_support Training 3 courses per month in Brussels or Luxembourg Eurostat - Unit G5
Communication with users (Assist) Eurostat - Unit G5
Communication with users (Assist) Eurostat - Unit G5
Challenges Harmonisation of IT tools: user needs vs. standardisation (Comext / Data Explorer) Code of Practice: Equal treatment vs. EU commercial interests (e.g.TARIC data dissemination) Simplification vs. Quality (e.g. net mass reporting) Strategy in cooperation with third countries (Eurotrace) and data exchange MEETS program - new business architecture for Eurostat / ESS Eurostat - Unit G5
Thank you for your attention! Any question? Eurostat - Unit G5