Experience with harvesting metadata to an Open Data Portal

Slides:

Advertisements

Similar presentations

GEOSS AIP Phase 2 Kickoff Workshop September, Boulder Colorado, USA AP ISO 1.0 Jürgen Walther Office of the Interministerial Committee for Geo Information.

Advertisements

European Forum for Geostatistics, The Hague Oktober 7, 2009 Michel Grothe, Geonovum Connecting the Netherlands to the European and Global SDI National.

Running Open Services – Challenges and Obstacles Jiří Poláček.

INSPIRE Service Architecture

INSPIRE and the Czech Cadastre of Real Estates Jiří Poláček Czech Office for Surveying, Mapping and Cadastre (COSMC)

OneGeology-Europe - the first step to the European Geological SDI INSPIRE Conference 2010, Session Thematic Communities: Geology Krakow, June 24 th 2010.

Crossing the Digital Divide

Information System of Cadastre of Real Estates of the Czech Republic as a tool supporting Real Estate Market Vít Suchánek Czech Office for Surveying, Mapping.

The Registry of Territorial Identification, Addresses and Real Estates Jaroslav Bačina.

13 th Jun 2013 PCC Conference, Dublin, Ireland 1 Established on 4 November 2006 under the provisions of the Registration of Deeds and Title Act 2006 The.

The various aspects of information concerning real estates in Poland Jarosław BYDŁOSZ, Paweł HANUS, Piotr PARZYCH, Poland Department of Geomatics Faculty.

Interoperability ERRA System.

Review on development of SDI as a basis of E-government in Croatia Ivan Landek, assistant director State Geodetic Administration of RoC International Workshop.

Serving society Stimulating innovation Supporting legislation Workshop on the INSPIRE registry and registers Pavel Vaniš & Czech Office.

Data on the Web Life Cycle Bernadette Farias Lóscio March, 2014.

Hanna Koivula FINNISH MUSEUM OF NATURAL HISTORY Deployment of INSPIRE (Annex III in Finland) Hanna Koivula.

Serving society Stimulating innovation Supporting legislation Workshop on the INSPIRE registry and registers Antonio Rotundo – Agenzia.

Mapping between SOS standard specifications and INSPIRE legislation. Relationship between SOS and D2.9 Matthes Rieke, Dr. Albert Remke (m.rieke,

Serving society Stimulating innovation Supporting legislation Workshop on the INSPIRE registry and registers Martin Tuchyňa, Tomáš.

INSPIRE drafting teams work versus practical INSPIRE implementations, theory and practice Marek Brylski, Intergraph Polska Enviro-i-Fórum – Zvolen – Slovakia.

Serving society Stimulating innovation Supporting legislation Fitness-for-purpose of INSPIRE data and services Michael Lutz 17 th.

1 Interoperability of Spatial Data Sets and Services Data quality and Metadata: what is needed, what is feasible, next steps Interoperability of Spatial.

1 The ESSnet project GEOSTAT 1A/B Vilni Verner Holst Bloch Coordinator of ESSnet project GEOSTAT 1A Statistics Norway Representing Census data in a European.

public access: Existing projects bringing eGovernment and INSPIRE together.

Implementing INSPIRE Geoportal in Turkey Gencay SERTER City and Regional Planner 1 Ministry of Environment And Forestry Department of IT.

XIth International Congress for Mathematical Geology - September 3-8, 2006 – Liège, Belgium Contribution of GeoScienceML to the INSPIRE data harmonisation.

HLANDATA PROJECT: FIRST RESULTS AND SYNERGIES Isabel Goñi, TRACASA.

Recent developments in database management and standardization in the GEOMIND project László Sőrés (ELGI, Hungary) Mikael Pedersen (GEUS, Danmark) Valdas.

Local content in a Europeana cloud Czech digital collections from the archeology and architecture domain in Europeana Irena Blažková Národní památkový.

Introduction to GIS GIS/CAD5.

The Digimap ShareGeo Facility Login to Digimap and select ShareGeo from the Collections page.

Find Research Data b2find.eudat.eu B2FIND User Training How to find data objects and collections using EUDAT’s B2FIND This work is licensed.

1 1 © JSC «RUSSIAN SPACE SYSTEMS» INTEGRATION OF ROSCOSMOS GEOPORTAL SERVICES AND CEOS WGISS INTEGRATED CATALOG (CWIC) Tamara Ganina Deputy Chief of Prospective.

What’s new at ArcGIS for INSPIRE Roberto Lucchi Guenther Pichler.

Bavarian Agency for Surveying and Geoinformation AAA - The contribution of the AdV in an increasing European Spatial Data Infrastructure - the German Way.

Online Information and Education Conference 2004, Bangkok Dr. Britta Woldering, German National Library Metadata development in The European Library.

Building SEIS – not for SEIS, but for ourselves. always ask: „What does it bring to us?“ Jarmila Cikánková CENIA.

Cascadoss - Evaluating Free and Open Source Software for Geospatial (FOSS4G) for Environmental Applications, Warsaw, June 2008 WOGIS Group activity.

statistiska_centralbyran_scbwww.linkedin.com/company/scb Panel Session A: Integrating Location in.

It’s time to refresh your data in Power BI!

Implementation of the INSPIRE Directive in the Czech Office for Surveying, Mapping and Cadastre (ČÚZK) Jiří Poláček.

Technology and procedures for correction of errors and discrepancies of data Workshop on Experiences with Data Management to Improve Land Administration.

Prepared by: Galya STATEVA, Chief expert

INSPIRE Network Services

Tomas Kliment Junior Researcher Italian National Research Council

Flanders Marine Institute (VLIZ)

18th Annual World Bank Conference 2017, Land and Poverty :

INSPIRE supporting activities for IED/ E-PRTR

MIG-T relevant activities in the ELISE ISA2 Action

INSPIRE harmonization of dataset, an example

Metadata Quality: Learning from Open Data Portalwatch

INSPIRE Geoportal Thematic Views Application

The Re3gistry software and the INSPIRE Registry

DANISH INSPIRE IMPLEMENTATION

5.c List of priority spatial data sets

Zuzana Podmanická Statistical Office of the SR

Geospatial Data Use and sharing Concepts

Status on eu actions from the kick-off meeting

Design central EMODnet portal Objectives and Technical description Initial draft prepared by the Flanders Marine Institute.

ArcGIS for INSPIRE – An Introduction

CDDA & INSPIRE work of EEA - preliminary lessons learnt

Fabio Crescenzi Territorial Databases and Gis

INSPIRE IMPLEMENTATION IN CYPRUS

The GISCO Progress Report Nov – Feb By Albrecht Wirthmann

APE EAD3 introduction - DARIAH - Brussels

INSPIRE MIG-T Meeting Paris, October

LEARNING & DEVELOPMENT STRATEGY: PROCESS OVERVIEW

Co-operation between the NSI and NMA in Poland

WISE and INSPIRE By Albrecht Wirthmann, GISCO, Eurostat

Presentation transcript:

Experience with harvesting metadata to an Open Data Portal Jiří Poláček Czech Office for Surveying, Mapping and Cadastre

Open Spatial Data in ČÚZK Dataset series Data format Number of datasets Cadastral Parcels INSPIRE harmonized (GML 3.2.1) 13091 Addresses 6259 Buildings Administrative Units 1 Geographical grid systems 2 Cadastral map VFK (national standard) 13185 VKM (national standard) 632 SHP DGN RÚIAN – complete dataset VFR (national standard) 12520 RÚIAN – change records 31 RÚIAN – selected records (addresses) CSV 12652 RÚIAN/ISÚI – complete dataset with history 6266 RÚIAN – special records (electoral district) Approved survey sketches Total 116526

Open Spatial Data in ČÚZK Data series Data format Number of datasets Cadastral Parcels INSPIRE harmonized (GML 3.2.1) 13091 Addresses 6259 Buildings Administrative Units 1 Geographical grid systems 2 Cadastral map VFK (national standard) 13185 VKM (national standard) 632 SHP DGN RÚIAN – complete dataset VFR (national standard) 12520 RÚIAN – change records 31 RÚIAN – selected records (addresses) CSV 12652 RÚIAN/ISÚI – complete dataset with history 6266 RÚIAN – special records (electoral district) Approved survey sketches Total 116526 INSPIRE harmonized 25512 National Standard 45821 Proprietary Format 45093

Terminological remark Collection of spatial data sets sharing the same product specification Dataset Serie Dataset Datasets Identifiable collection of spatial data Sections of a dataset

Terminological remark Cadastral Map Dataset Serie Dataset Datasets Sections of a dataset 13091 files (1 for each cadastral unit)

National Open Data Portal (MVČR) European INSPIRE Geoportal (JRC) CKAN Missing information on Datasets (file addresses) CSW National INSPIRE Geoportal (CENIA) CSW Branch Geoportal (ČÚZK)

Too complex task, lack of funding National Open Data Portal (MVČR) European INSPIRE Geoportal (JRC) CKAN CSW National INSPIRE Geoportal (CENIA) Too complex task, lack of funding CSW Branch Geoportal (ČÚZK)

National Open Data Portal (MVČR) European INSPIRE Geoportal (JRC) CKAN CSW National INSPIRE Geoportal (CENIA) CSW Publication Database (ČÚZK) Branch Geoportal (ČÚZK) CKAN API

Specification of open data in metadata URI – link to the detailed description of the licence

Implementation obstacles National Open Data Portal (MVČR) Publication Database (ČÚZK) CKAN CKAN API ATOM Map server Branch Geoportal (ČÚZK) Viewing Cadastre Application INSPIRE network services

Implementation obstacles National Open Data Portal (MVČR) Publication Database (ČÚZK) CKAN CKAN API ATOM insufficient HW Map server Branch Geoportal (ČÚZK) Viewing Cadastre Application INSPIRE network services

Implementation obstacles National Open Data Portal (MVČR) Publication Database (ČÚZK) CKAN CKAN API ATOM Map server Branch Geoportal (ČÚZK) Viewing Cadastre Application INSPIRE network services Database overload

Implementation obstacles National Open Data Portal (MVČR) Publication Database (ČÚZK) CKAN CKAN API ATOM Metadata file cash Map server Branch Geoportal (ČÚZK) Viewing Cadastre Application INSPIRE network services

Open Spatial Data in ČÚZK Data series Data format Number of datasets Cadastral Parcels INSPIRE harmonized (GML 3.2.1) 13091 Addresses 6259 Buildings Administrative Units 1 Geographical grid systems 2 Cadastral map VFK (national standard) 13185 VKM (national standard) 632 SHP DGN RÚIAN – complete dataset VFR (national standard) 12520 RÚIAN – change records 31 RÚIAN – selected records (addresses) CSV 12652 RÚIAN/ISÚI – complete dataset with history 6266 RÚIAN – special records (electoral district) Approved survey sketches Total 116526 Next day after any change Once a month Once a week Once a day

All the metadata has been harvested Conclusion All the metadata has been harvested It took about 5 hours Current status : 44399 datasets metadata are harvested to the National Open Data Portal once a week Operational run : Incremental harvesting for CKAN (and some optimization) is neccesary for future Future solution : Learn CKAN to use standard CSW and implement incremental harvesting Standardize specification of open data in metadata Clear up terminology

Thank you for your attention jiri.polacek@cuzk.cz 19.3.2014 ELF workshop Stránka 16