Metadata Catalogues in Denmark Heidi Vanparys & Johan Hartnack 30-05-2018

Agenda geodata-info.dk Metadata system in SDFE The Danish Digital Strategy 2016-2020 The Danish Governmental data set catalogue Johan: Atkins Heidi: Danish Agency for Data Supply and Efficiency (SDFE)

geodata-info in 2010 Replaced the common public metadata portal with an INSPIRE-compliant one Overall architecture, 2 main components: GeoNetwork 2.6.4 for editing metadata in-house developed searching functionality (.NET) “Nordic” version of GeoNetwork

geodata-info in 2017 Main requirement: INSPIRE compliance Therefore: GeoNetwork and not e.g. CKAN Development done by Atkins & GeoCat

Integration to INSPIRE-validator

Several administrative systems One Data Bank, Digital Map Supply, Data Distributor, Belt Conveyer

More containers in Data Bank, the ones relevant for metadata are shown.

Overview of metadata Notification, visually and via mail, when a certain number of days has passed without the metadata has been updated.

Editing of metadata

Dashboard Calculations are run every night

Metadataflow SDFE metadata system geodata-info Maintenance of metadata for datasets [container in Data Bank] metadata for datasets and services? geodata-info Portal for Danish datasets and services in the field of geographical information [software system] and services? metadata for datasets metadata for INSPIRE datasets and INSPIRE services national dataset catalogue Portal for Danish public sector datasets [external software system] INSPIRE-geoportal Portal for INSPIRE datasets and services [external software system]

Several administrative systems One Data Bank, Digital Map Supply, Data Distributor, Belt Conveyer

The digital Strategy 2016-2020

8.1 Gode data og effektiv datadeling – sound data and effective sharing Der skal udvikles en fællesoffentlig it- arkitektur, som skal sætte rammerne for deling af data mellem myndigheder. Arkitekturen skal understøtte offentlige myndigheders arbejde med at standardisere og forbedre data og bygge it-løsninger, der kan indgå i sammenhæng på tværs af den offentlige sektor. Derved forbedres mulighederne for at offentlige myndigheder kan dele data med eller bruge data fra andre myndigheder. A common IT architecture is to be developed which will frame the sharing of data among authorities. The architecture must support the work of public authorities in standardizing and improving data and building IT solutions that can be integrated across the public sector. Hereby improving the possibilities for public authorities to share data with or use data from other authorities.

Caretaker SNC-Lavalin Atkins chosen as supplier of the public data set catalog

Meta-data catalog Analogy to the libraries old indexing system – meta data – location go and look it up A dataset contains two things: Information or “metadata” about the data. For example, the title and publisher, date, what formats it is available in, what license it is released under, etc. A number of “resources”, which holds the link(s) to the data, the resource itself being elsewhere on the web. A dataset can contain any number of resources. For example, different resources might contain the data for different years, or they might contain the same data in different formats.

Usage and roles in the data set catalogue

Technology Comprehensive Knowledge Archive Network (CKAN) web-based open source management system storage and distribution of open data Internals Python - backend Javascript – webpages/configuration in GUI PostgreSQL - databases. Solr – search services Web APIs – for queriying CKAN is a tool for making open data websites. (Think of a content management system like WordPress - but for data, instead of pages and blog posts.) It helps you manage and publish collections of data. It is used by national and local governments, research institutions, and other organizations who collect a lot of data. Also used by OPENDATA.dk

Used by multiple national governments Data.gov.uk Data.overheid.nl Data.gov

Screenshot of portal start screen

July 2018

Conclusion Infrastructure in place - “build it and they will come!” Systems are of little value without data providers and data users

Heidi Vanparys E-mail: hevan@sdfe. dk Johan Hartnack E-mail: Johan Heidi Vanparys E-mail: hevan@sdfe.dk Johan Hartnack E-mail: Johan.hartnack@atkinsglobal.com