Prise en main de GeoNetwork: gestion et publication de métadonnées & harvesting et échange de métadonnées Andrea de Bono Certificat Géomatique
Introduction to GeoNetwork OpenSource 1 Explore software and data using FAO GeoNetwork Search, View, Download (data and services) 2 Create your Spatial Information Management System (SIMS) 2.1 Customize your GeoNetwork : Login, explore admin part, categories, groups, user… 2.2 populate your GeoNetwork 2.2.1) Insert existing metadata: Single file, batch import (sample files, ) Publish (roles, permissions) 2.2.3) Create your metadata: Add template, Create a template, ISO elements, fill fields, Publish 2.2.3) Add data from a remote node: Harvest data by using CSW, WMS, GeoNetwork node 2.3 Useful tips 2 Certificat Géomatique Contents
Much more than a simple metadata catalog….. 3 Certificat Géomatique Introduction to GeoNetwork OpenSource
GeoNetwork opensource is a standard based and decentralized spatial information management system, designed to enable access to geo-referenced databases and cartographic products from a variety of data providers through descriptive metadata, enhancing the spatial information exchange and sharing between organisations and their audience, using the capacities and the power of the Internet. 4 Certificat Géomatique Introduction to GeoNetwork OpenSource
5 Certificat Géomatique Introduction to GeoNetwork OpenSource
Main Features 1) Instant search on local and distributed geospatial catalogues 2) Uploading and downloading of data, documents, PDF’s and any other content 3) An interactive Web map viewer that combines Web Map Services from distributed servers around the world 4) Online map layout generation and export in PDF format 5) Online editing of metadata with a powerful template system 6) Scheduled harvesting and synchronization of metadata between distributed catalogues 7) Groups and users management 8) Fine grained access control 6 Certificat Géomatique Introduction to GeoNetwork OpenSource
7 Certificat Géomatique ) Explore software and data using FAO Geonetwork 1) Instant search on local and distributed geospatial catalogues
8 Certificat Géomatique ) Explore software and data using FAO Geonetwork 2) Uploading and downloading of data, documents, PDF’s and any other content Download data Export metadata Create documents
3) An interactive Web map viewer that combines Web Map Services from distributed servers around the world 4) Online map layout generation and export in PDF format 9 Certificat Géomatique ) Explore software and data using FAO Geonetwork
Main Features 5) Online editing of metadata with a powerful template system 6) Scheduled harvesting and synchronization of metadata between distributed catalogues 7) Groups and users management 8) Fine grained access control 10 Certificat Géomatique ) Explore software and data using FAO GeoNetwork
11 Certificat Géomatique Create your SIMS: Customize your GeoNetwork 1 2
Load a template (Administration tab) 12 Certificat Géomatique Login (admin admin) 2 Create your SIMS: Customize your GeoNetwork
Create group (Administration tab) 13 Certificat Géomatique Group name: Geom Create your SIMS: Customize your GeoNetwork
Create user (Administration tab) 14 Certificat Géomatique User name: vistor PWD: visitor 2 Create your SIMS: Customize your GeoNetwork 1. Administrator Profile: All 2. User Administrator Profile: All excepted system administration and configuration tasks 3. Content Reviewer Profile: Rights on reviewing metadata content within the own group and authorizing its publication 4. Editor Profile: Full rights on creating/editing/ deleting new/old data within the own group 5. Registered User Profile Right to download protected data Check your right an log you again as admin
Change categories (Administration tab) 15 Certificat Géomatique ) Delete existing categories 2) Add new categories Categories to add (from INSPIRE) Administrative_units Protected_sites Elevation Natural_risk_zones Land_cover Interactive_resources (used for store services) 2 Create your SIMS: Customize your GeoNetwork
Create alias “Localization” (Administration tab) 16 Certificat Géomatique Eliminate “_” NB save after each operation !! 2 Create your SIMS: Customize your GeoNetwork
Exercise 1): Insert existing metadata From … download the metadata_xls.zip and unzip on your local disk From the FAO GeoNetwork Download metadata for forest geospatial dataset (Global extent) and save the xml file in the metadata_xls folder Upload on (your) GeoNetwork: (see below) 17 Certificat Géomatique Copy/paste your path 2 Create your SIMS: populate your GeoNetwork
Exercise 1): Insert existing metadata Move to appropriate category (one by one…) 18 Certificat Géomatique Publish metadata (one by one) 2 Create your SIMS: populate your GeoNetwork
Logout and explore the results 19 Certificat Géomatique Create your SIMS: populate your GeoNetwork
Create your metadata following the ISO standard ….. 20 Certificat Géomatique Create your SIMS: populate your GeoNetwork
. 21 Certificat Géomatique Create your SIMS: populate your GeoNetwork Note that TC211/ISO:19115:2003 is not itself a format, but a standard for defining formats and profiles. To comply with the ISO:19115:2003 metadata standard a data format (or profile) must define a core set of metadata elements as shown below. This list contains metadata elements answering the following questions: 1.Does a dataset on a specific topic exist (‘what’)?, 2.For a specific place (‘where’)?, 3.For a specific date or period (‘when’)? 4.A point of contact to learn more about or order the dataset (‘who’)?
M andatory fields are often insufficient ….. 22 Certificat Géomatique … optional but critical fields : Keywords Spatial Representation Type Geographic Location Reference System Info Temporal Extent Data Quality Info Access and Use Constraints Point of Contact Distribution Info: Online Resources. 2 Create your SIMS: populate your GeoNetwork
Main metadata sections 23 Certificat Géomatique Create your SIMS: populate your GeoNetwork
Mandatory fields: 24 Certificat Géomatique * 2 Create your SIMS: populate your GeoNetwork Filled by GeoNetwork
25 Certificat Géomatique The ISO – Identification 1 Identification Point of contact
26 Certificat Géomatique The ISO – Identification 2 Thematic Geographic NB ISO topic cat. NEED to change!!
27 Certificat Géomatique The ISO – Identification 3 Thematic Geographic
28 Certificat Géomatique The ISO – Reference system NB you need a code Filled by Geonetwork (WGS 1984)
29 Certificat Géomatique The ISO Lineage Information about data processing
30 Certificat Géomatique The ISO – Distribution Information The address used for download the resource The address used for information about the resource The address used for visualize/download the resource (OGC web services)
31 Certificat Géomatique The ISO – Spatial representation Number of rows X Number of Columns Y Thematic dimension Z RASTER Data
32 Certificat Géomatique The ISO – Metadata Filled by Geonetwork Unique identifier Mandatory
Exercise: Create your own metadata (ISO 19115) Data source: Dataset: ETOPO1 Ice Surface Download link (copy from): grid-registered, georeferenced tiff Interactive map link: 33 Certificat Géomatique On Geonetwork: New metadata (Administration tab) 2 Create your SIMS: populate your GeoNetwork
Publish your data 34 Certificat Géomatique Intro- Introduction - Blabla
How exchange metadata in a shared environment? Distributed search and harvesting Distributed search: perform a search over all the nodes at the same time. Harvesting is the process of collecting remote metadata and storing them locally for a faster access. This is a periodic process to do, for example, once a week. Harvesting is not a simple import: local and remote metadata are kept aligned. Using some magic, one GeoNetwork node is capable of discovering metadata that have been added, removed or updated in the remote node. 35 Certificat Géomatique populate your GeoNetwork - Add data from a remote node
The harvesting mechanism is based on the concept of a universally unique identifier (UUID). This is a special id because it is not only unique locally to the node that generated it but it is unique across all the world. It is a combination of the network interface’s MAC address, the current date/time and a random number. Every time you create a new metadata in GeoNetwork, a new UUID is generated and assigned to it. Another important concept behind the harvesting is the last change date. Every time you change a metadata, its last change date is updated. 36 Certificat Géomatique populate your GeoNetwork - Add data from a remote node
These two concepts allow GeoNetwork to fetch a remote metadata, check if it has been updated and remove it locally if it has been removed remotely. Furthermore, thanks to UUIDs, a hierarchy of harvesting nodes can be built where B harvests from C and A harvests from B. Even loops can be created because harvested metadata cannot be modified The harvesting process goes on until one of the following situations arises: - An administrator stops (deactivates) the node. - An exception arises. In this case the node is automatically stopped. When a harvesting node is removed, all harvest metadata are removed too. 1. The harvesting engine does not store harvesting results. This implies that if the server is restarted the last results are lost. 2. Changes to the harvesting parameters (for example privileges and categories) are taken into account in the next harvesting run. 37 Certificat Géomatique populate your GeoNetwork - Add data from a remote node
Unique UUID (only one copy will be stored!!) 38 Certificat Géomatique A a B a C a D a Nodes: A, B, C, D Metadata: a harvesting 2.2 populate your GeoNetwork - Add data from a remote node
39 Certificat Géomatique populate your GeoNetwork - Add data from a remote node
40 Certificat Géomatique populate your GeoNetwork - Add data from a remote node WMS WMS
This is the original (not harvested) source 41 Certificat Géomatique Reduce the number of entries 2.2 populate your GeoNetwork - Add data from a remote node - GeoNetwork GeoNetwork node
42 Certificat Géomatique &acceptFormats=application/xml 2.2 populate your GeoNetwork - Add data from a remote node - CSW CSW
Create your template Child/Parent OGC CSW (your) Server configuration 43 Certificat Géomatique Extras- Introduction - Blabla