EU-US Open Data project

Slides:



Advertisements
Similar presentations
8-9 October 2009 The ESPON 2013 Programme: Prospects and Achievements Regional and Urban Statistics Working Group meeting.
Advertisements

Future Internet Research & Experimentation (FIRE+) Integrating experiments & facilities in FIRE+ H2020-ICT/FET National Contact Points Training 23 October.
Background Data validation, a critical issue for the E.S.S.
Data can tell us stories New approaches for an effective e-dissemination of statistics Enrico Giovannini* *ISTAT - Italian National Institute of Statistics.
ISCO-08 - Current Status and plans to support implementation David Hunter Department of Statistics International Labour Office United Nations Expert Group.
A new start for the Lisbon Strategy Executive summary Increase and improve investment in Research and Development Facilitate innovation,
Recent Developments of the OECD Business Tendency and Consumer Opinion Surveys Portal coi/coordination
1 The ESSnet project GEOSTAT 1A/B Vilni Verner Holst Bloch Coordinator of ESSnet project GEOSTAT 1A Statistics Norway Representing Census data in a European.
The Geographic Information System of the European Commission (GISCO) By Albrecht Wirthmann, GISCO, Eurostat ESPON.
Eurostat SDMX and Global Standardisation Marco Pellegrino Eurostat, Statistical Office of the European Union Bangkok,
Upcoming ESPON Tools ESPON Seminar November 2010.
2.An overview of SDMX (What is SDMX? Part I) 1 Edward Cook Eurostat Unit B5: “Central data and metadata services” SDMX Basics course, October 2015.
Semantic Web COMS 6135 Class Presentation Jian Pan Department of Computer Science Columbia University Web Enhanced Information Management.
Making the CDDA data model INSPIRE compliant Project information and status 2015 Eionet Biodiversity Ecosystems, Indicators and Assessments NRC Workshop.
1 Enhancing data quality by using harmonised structural metadata within the European Statistical System A. Götzfried Head of Unit B6 Eurostat.
Renovation of Eurostat dissemination chain
Darja Lihteneger, November 2015, Copenhagen, Denmark INSPIRE Data Modelling for Reporting Data Flows – CDDA conceptual data model and INSPIRE Eionet.
Eurostat Sharing data validation services Item 5.1 of the agenda.
Introduction to EU regulation for Information Society statistics Armenia Twinning 2011 Component F – Information Society, 2 – 6 May. Danmarks Statistik.
SDMX Basics course, March 2016 Eurostat SDMX Basics course, March Introducing the Roadmap Marco Pellegrino Eurostat Unit B5: “Data and.
IN THIS Slide show YOU WILL LEARN ABOUT ALL VERSIONS OF "MS OFFICE"
European Monitoring Platform for Mapping of QoS and QoE
CEOS OpenSearch Project II
The evolution of the SDMX infrastructure and services
Seminar on ESA 2010 Metadata
The future of the LMAs from the Commission's perspective
INSPIRE Geoportal Thematic Views Application
Applications of IFLA Namespaces
Eurostat Management Plan for Regional and Urban statistics
Eurostat activities update
Discussion group meeting
11. The future of SDMX Introducing the SDMX Roadmap 2020
Eurostat regional yearbook 2014
Recent evolution of the Eurostat Internet and cooperation with Member States Luxemburg May 2009.
Amendment to the NUTS Regulation Oliver Heiden Eurostat.E4
Disposable income in rural areas
MIWP Action ”Priority List of E-Reporting Datasets”
State of play of labour market and other domains of regional statistics Items 4.2 and 4.3 of the agenda Gorja Bartsch Eurostat Unit E4.
2. An overview of SDMX (What is SDMX? Part I)
Management of NUTS change in Poland
Eurostat regional yearbook 2007
Working Party on Regional Statistics 1-2 October 2012
Eurostat Management Plan 2015 for Regional and Urban statistics
The ESPON 2013 Programme: Regional and Urban Statistics
2. An overview of SDMX (What is SDMX? Part I)
Working Group "LAbour MArket Statistics" October 2013
Eurostat Flagship publication on cities
New mandate for the Working Group
Innovative sources and tools for living conditions surveys
Regional Labour Market
Eurostat Management Plan for Regional and Urban statistics
LUCAS Task Force The way forward.
Sharing data validation activities in the ESS.
New release of Statistics Illustrated
New release of Statistics Illustrated and other visualisations
Teodora Brandmuller Head of Section – Regional and urban statistics
EPAN – eGov WG EPAN Good Practice Information System
Regional Government Expenditure
Information Platform for Chemical Monitoring
Åsa Önnerfors, Eurostat
Local Administrative Units
- User support network activities –
Point 6.1 of the agenda Advisory group for land cover/use statistics
Regional Labour Market
What's new on energy efficiency at DG ENERGY in 2016
Joint meeting of the ESS.VIP.BUS ICT Project
The GISCO Progress Report Nov – Feb By Albrecht Wirthmann
Item 9.6 Mainstreaming geo-statistics
Validation Activities in the ESS What you will hear today…
Pilot use of Linked Open Data technologies for publishing official statistics: current status in the ESS and Eurostat April 17th, 2018 GISCO WG.
Presentation transcript:

EU-US Open Data project NTTS Conference March 14th 2017

Genesis of the project In July 2016, the US Department of Commerce contacted the European Commission (DG CONNECT and ESTAT) to propose a joint open data project Objective: creation of an R library giving common access to comparable Eurostat and BEA regional economic datasets (BEA = Bureau of Economic Analysis)

Timeline of the project August – September 2016: identification of comparable datasets. These include GDP, employment by industry, disposable income and population at various regional levels (NUTS 2/NUTS 3/Metropolitan regions) September – October 2016: development of the library November 2016: alpha release of library

Our Vision: users can pull cohesive economic datasets from the EU and the US using a single coding function What are we doing to achieve this: We identified a set of economic datasets with a sufficiently high degree of comparability. We chose to concentrate on economic data on regions and metropolitan areas, available from the BEA and Eurostat We will the express the relationship and integration logic between these datasets in an Linked Open Metadata Store Finally, we will develop an R library which will pull the data from our respective APIs and use the information in the metadata store to provide an integrated view of the data.

- The integration logic will be encoded as Linked Open Metadata - It will use well-known RDF ontologies for the description of datasets (e.g. the RDF Data Cube Vocabulary) and encode the ETL (Extract-Transform-Load) required to harmonise our data - The Metadata Store will be made available to the public. Users may choose to use it and extend it to cover other use cases or to encode different mappings between BEA and Eurostat datasets.

Library currently available on GitHub, eventually also on CRAN R library Library currently available on GitHub, eventually also on CRAN

Current status Alpha version of the R library was unveiled at Lisbon Web Summit on November 8th. It is available on GitHub: https://github.com/CommerceDataService/eu.us.opendata The GitHub page includes a short tutorial. A short video tutorial is also available here.

Benefits of the project Easing access to detailed and comparable data on EU and US economies Gained hands-on experience in using Linked Open Data to enhance the interoperability of our statistics Showed that EU and US can cooperate on fast-developing, innovative projects

Next steps? Possible avenues for further work: Collecting feedback from users of open data on how to further facilitate access to EU and US datasets Consolidation of the library routines and of the underlying infrastructure Extension of the approach to other datasets or to similar use cases

Thank you for your attention Any questions?