OBIS Web Services Mike Flavell OBIS Data Manager ODIN Africa Training Course on Marine Biodiversity Management, Oostende, Belgium, 17 March 2014.

Slides:



Advertisements
Similar presentations
A Roadmap of Open Source components for GI Web Services and Clients A Paul R Cooper MAGIC.
Advertisements

EURO4M Project Kick-Off, April 2010 OGC Web Services Data visualization using OGC web services Maarten Plieger Wim Som de Cerff Royal Netherlands Meteorological.
The Next Generation Network Enabled Weather (NNEW) SWIM Application Asia/Pacific AMHS/SWIM Workshop Chaing Mai, Thailand March 5-7, 2012 Tom McParland,
Proposed update of Technical Guidance for INSPIRE Download services based on SOS Matthes Rieke, Dr. Albert Remke (m.rieke, 52°North.
EndNote. What is EndNote:  EndNote is referencing software that enables you to create a database of references from your readings. Your database of references.
1 OGC Web Services Kai Lin San Diego Supercomputer Center
TileMill Quickly and Easily Design Maps for the Web Shaky Sherpa Matt Berg Modi Research Group The Earth Institute. Columbia University.
Atlas III Improvements Expands on Atlas II capabilities – Faceted Navigation – counts are displayed next to selectable attribute – Lunar Map interface.
Flood Map Library MD. M. HAQUE DWR-HYDROLOGY. Building a Flood Map Library Indexing existing flood maps and geospatial data for search and retrieval Separate.
Spatial Indexing, Search, and Mapping for Species level databases Tony Rees, CSIRO Marine and Atmospheric Research (CMAR), Hobart, Tasmania, Australia.
Europe’s Information Society eContentplus OrléansWP6 1st Coordination and progress meeting Technical information OGC WMS – WFS – CSW.
For Mapping Biodiversity Data Data Management Options.
Planned Title: Review of Evaluation of Geospatial Search Allan Doyle.
Welcome to EDINA Digimap Digimap is an EDINA service offering online access to a range of spatial data. It is authenticated using Athens and is available.
Exploring large marine datasets using an interactive website and Google Earth Jon Blower, Dan Bretherton, Keith Haines, Chunlei Liu, Adit Santokhee Reading.
19 th Advanced Summer School in Regional Science An introduction to GIS using ArcGIS.
Digimap Carto is an advanced version of classic but with many more options. You need to return to the Digimap home page and this time select the “Digimap.
1 Introduction to OBIEE: Learning to Access, Navigate, and Find Data in the SWIFT Data Warehouse Lesson 8: Printing and Exporting an OBIEE Analysis This.
Marine GIS Applications using ArcGIS Global Classroom training course Marine GIS Applications using ArcGIS Global Classroom training course By T.Hemasundar.
Tutorial 11: Connecting to External Data
ESRM 250 & CFR 520: Introduction to GIS © Phil Hurvitz, KEEP THIS TEXT BOX this slide includes some ESRI fonts. when you save this presentation,
GIS on the Web. World Wide Web Internet Clients Servers FTP Opportunity in Web- based Mapping Disaster relief and Emergency management Global and.
Web Feature Service and Web Map Service WATER FOR A HEALTHY COUNTRY FLAGSHIP SISS Workshop v2.3 Pavel Golodoniuc, Josh Vote 8 May 2013.
Add a File with X, Y coordinates to MapWindow
1 Introduction to web mapping Dissemination of results, maps and figures ESTP course on Geographic Information Systems (GIS): Use of GIS for making statistics.
GIS technologies and Web Mapping Services
Lecture 3: Geospatial Web Services From Web sites to Web services Geospatial Web service functions Web service types Interoperability and geospatial service.
Introducing Dreamweaver MX 2004
Tutorial 1 Getting Started with Adobe Dreamweaver CS3
AIRNow Web Services Data to Go! Prepared by Steven A. Ludewig, Timothy S. Dye Sonoma Technology, Inc. Petaluma, CA John E. White U.S. Environmental Protection.
1 Welcome to the GrameneMart Tutorial A tool for batch data sequence retrieval 1.Select a Gramene dataset to search against. 2.Add filters to the dataset.
David Blasby The Open Planning Project New York. Goals Explain what a WFS and WMS are, and when to use them Be able to create simple spatial web applications.
OBIS Portal Architecture Concepts plus potential for utilization as a basis for Regional OBIS Nodes Tony Rees, CSIRO Marine Research, Hobart (and OBIS.
An Introduction To Building An Open Standard Web Map Application Joe Daigneau Pennsylvania State University.
Data Scrounging 101 Steve Signell, Instructor Robert Poirier, TA School of Science Rensselaer Polytechnic Institute Monday,
12.3 Using Open GIS web services to serve environmental data 21rst IIPS: Session 12 GIS Applications 12.3 Using Open GIS web services to serve environmental.
Department of Advanced Computing SAR related activities at Christian Michelsen Research Kjell Røang.
Introduction to the World Countries Atlas This document outlines the contents of the World Countries Atlas and gives some ideas for using it with Dynamic.
Campus Tour COMP 523 Midterm Presentation Justin, Paul, Florian.
Development of Dynamic SLD and Understanding WCS Using Geo-server Supervisor Prof N.L Sarda Dept. of Computer Science & Engg. IIT-Bombay Bharti M.Tech.
OceanBrowser viewing service, overview and upgrades Alexander Barth (1), Charles Troupin (2), Aida Alvera Azcárate (1), Jean-Marie Beckers (1) (1) University.
A GeoSpatial Mapping Architecture
EndNote. What is EndNote? EndNote is referencing software that enables you to create a database of references from your readings.
Using and modifying plan constraints in Constable Jim Blythe and Yolanda Gil Temple project USC Information Sciences Institute
LBR & WS LAB 1: INTRODUCTION TO GIS.
Web Design and Development. World Wide Web  World Wide Web (WWW or W3), collection of globally distributed text and multimedia documents and files 
Module: Software Engineering of Web Applications Chapter 2: Technologies 1.
The New GBIF Data Portal Web Services and Tools Donald Hobern GBIF Deputy Director for Informatics October 2006.
©2010 AIR WORLDWIDE 1 Using ArcGIS Server Web Map Services in Web Map Mash-Ups Benjamin Spaulding, Ph.D. AIR Worldwide Esri Boston Dev Meet-Up 12/8/2010.
ORNL DAAC SPATIAL DATA ACCESS TOOL Open Geospatial Consortium (OGC) Services Bruce E. Wilson Suresh K. Santhana Vannan Yaxing Wei Tammy W. Beaty National.
What is GIS? “A powerful set of tools for collecting, storing, retrieving, transforming and displaying spatial data”
ESIP Air Quality Jan Air Quality Cluster Air Quality Cluster Technology Track Earth Science Information Partners Partners NASA NOAA EPA (?) USGS.
Oracle Business Intelligence Foundation – Testing and Deploying OBI Repository.
Welcome to the GrameneMart Tutorial A tool for batch data sequence retrieval 1.Select a Gramene dataset to search against. 2.Add filters to the dataset.
GBIF Governing Board 20 Module 6B: New GBIF Tools II 2013 Portal and NPT Startup Daniel Amariles IT Leader, National Biodiversity Information System of.
GeoSpatial Analysis UNICEF Security Advisors Workshop 20 October 2010.
Uploading Data Matthew Hanson  GeoNode made up of several components  Web Framework – Django  OGC Server – GeoServer  Database – PostGIS.
GeoServer Prof. Wenwen Li School of Geographical Sciences and Urban Planning 5644 Coor Hall
SSE WebMapViewer Recent Developments Steven Smolders SSE Workshop ESA - ESRIN, Frascati, Rome.
Creating and Sharing Geospatial Data January 28, 2010 presentation to the Bedford Institute of Oceanography Geographic Information Systems Special Interest.
® Sponsored by Improving Access to Point Cloud Data 98th OGC Technical Committee Washington DC, USA 8 March 2016 Keith Ryden Esri Software Development.
Flood Map Library MD. M. HAQUE DWR-HYDROLOGY. Building a Flood Map Library Indexing existing flood maps and geospatial data for search and retrieval Separate.
CYBER-GIS FOR SCIENTIFIC DISCOVERIES. Global Forest Change Hansen, M. C. et al (2013). High-Resolution Global Maps of 21st-Century Forest Cover Change.
The Next Generation Network Enabled Weather (NNEW) SWIM Application
Introduction to OBIEE:
Flanders Marine Institute (VLIZ)
Managing Rosters Screener Training Module Module 5
CSc4730/6730 Scientific Visualization
Tutorial 7 – Integrating Access With the Web and With Other Programs
A review of online data resources
Presentation transcript:

OBIS Web Services Mike Flavell OBIS Data Manager ODIN Africa Training Course on Marine Biodiversity Management, Oostende, Belgium, 17 March 2014

What are Web Services? A Web service is a method of communication between two electronic devices over the world wide web Delivery of data via the internet. OBIS web services can be accessed manually by people or programatically within software applications We will deal with accessing them manually

In What Formats Can I Get OBIS Data? Observations / Gridded Data (XML and CSV) –CSV (comma separated values) –GML (Geography Markup Language v2.0, 3.1, 3.2) XML –Shape File Maps –Image Formats: GIF, JPEG, PNG, SVG, TIFF –KML (plain and compressed) XML for Google Earth browsers OpenLayers (Web Application)

GeoServer and OBIS Web Services Open Geospatial Consortium (OGC) Web Services Accessed via URLs (HTTP Requests) with different parameters and values

Geoserver Layer Preview

Layers OBIS Data Layers Other Information Layers Base Map Layers

OBIS Base Map Layers LAYER NAMELAYER DESCRIPTION OBIS:GEBCO_relief General Bathymetric Chart of the Oceans (with slight colour Adjustment) OBIS:GEBCOGeneral Bathymetric Chart of the Oceans OBIS:countryWorld Countries

OBIS Data Layers LAYER NAMELAYER DESCRIPTION OBIS:drs_with_woa Individual Observations (points)(Condensed Data) linked with World Ocean Atlas Variables OBIS:points_exIndividual Observations (points) (Expanded Data) OBIS:dist_spGridded Species Distributions OBIS:summaries Gridded Biodiversity (Simpson, Shannon, ES50) Number of Observations Number of Taxa per C-square Cell (Varying Resolutions)

OBIS Other Information Layers LAYER NAMELAYER DESCRIPTION OBIS:mwhsUNESCO Marine World Heritage Sites OBIS:ihoInternational Hydrographic Organisation Sea Areas OBIS:lmeLarge Marine Ecosystems of the World OBIS:eezsExclusive Economic Zones (OBIS Edit) OBIS:meowMarine Ecoregions of the World, MEOW (Spalding et al., 2007) OBIS:Longhurst_v4_ColorLonghurst Biogeographical Provinces (Colour Coded) OBIS:Longhurst_world_v4_2010Longhurst Biogeographical Provinces (2010 Version, Not Colour Coded) OBIS:WMBWorld Maritime Boundaries (v )

URL’s and Query Strings OBIS Web services are accessed via URLs (HTTP Requests) For instance to get a jpeg image showing a map of the countries of the world you can use a URL like… est=GetMap&layers=OBIS:country &styles=country&bbox=-180.0,-90.0,180.0,90.0&width=660&height=330 &srs=EPSG:4326&format=image/jpeg

URL’s and Query Strings URLs contain different “querystring” parameters & values depending on what you want est=GetMap&layers=OBIS:country &styles=country&bbox=-180.0,-90.0,180.0,90.0&width=660&height=330 &srs=EPSG:4326&format=image/jpeg ? = start of query string & = separator between parameters parameters: name=value service = WMS version = request = GetMap layers = OBIS:country styles = country bbox = ,-90.0,180.0,90.0 width = 660 height = 330 srs = EPSG:4326 format = image/jpeg

GEOSERVER OGC WEB SERVICES

WMS – Web Map Service (Map Images) WMS is a protocol to obtain geo-referenced map images over the Internet, that are generated by a map server, using data from a GIS database. Web Map Services GetCapabilities (information on what data is available) GetMap (get map images/kml) GetLegendGraphic (get map data legends) GetFeatureInfo (get more information about a feature on a map)

WMS - GetCapabilities Returns an XML document that contains a description (MetaData) of the Web Map Service, such as… – Map image format – WMS version compatibility – Supported Map Projections – Available layers Map bounding box Coordinate reference system URI of the data Whether the layer is mostly opaque or not You often need to supply this URL to third party software if you wish to use the OBIS web services in that software

WMS – Get Map Returns a map image. Parameters include: width and height of the map, coordinate reference system, layers required, rendering style, image format and size Most Simple URLs – use WMS Reflector (intelligent guess parameters that are not present). ntry&width=600 More Complicated URLs Map&layers=OBIS:country&styles=country&bbox=-180.0,- 90.0,180.0,90.0&width=660&height=330&srs=EPSG:4326&format=image/jpeg Map&layers=OBIS:country&styles=polygon&bbox=-20,- 40.0,60.0,40.0&width=640&height=640&srs=EPSG:4326&format=image/jpeg

WMS GetLegendGraphic Returns an image of the map's legend image, giving a visual guide to map elements ayer=OBIS:summaries &style=summaries_n_rainbow&width=20&height=20&format=image/png Layer and Style parameters are very important!!!

WMS GetFeatureInfo If a layer is marked as 'queryable' then you can request data about any point/polygon (i.e. Feature) displayed on the map image , , &SERVICE=WMS&VERSION=1.1.1&X=117&Y=330&INFO_FORMAT =text/html&QUERY_LAYERS=OBIS:GEBCO_relief,OBIS:dist_sp,OBIS:country&FEATURE_CO UNT=50&Layers=OBIS:GEBCO_relief,OBIS:dist_sp,OBIS:country&Styles=&WIDTH=660&HEIG HT=660&format=image/png&srs=EPSG:4326 The server must create the image first! X and Y refer to the pixels of the image!

WFS – Web Feature Service Returns data in the specified output format =OBIS:dist_sp &outputFormat=csv &VIEWPARAMS=where:scientific='Calanus finmarchicus';table:dist_sp_5deg;count_column:nincl &MAXFEATURES=20 Understanding the specifics of the OBIS implementation / Database is essential !!!

Be aware of URL encoding %3D= %3A: %3B; %20space %26& %2C, %2F/ See for morehttp:// From &STYLES=&FORMAT=image%2Fpng &VIEWPARAMS=where%3Ascientific%3D%27Calanus%20finmarchicus%27%3Btable%3Adist_sp_5deg%3Bcount_column%3Anincl &TILED=false&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&SRS=EPSG%3A4326 &BBOX=-180,-90,180,90&WIDTH=640&HEIGHT=480 To &STYLES=&FORMAT=image/png &VIEWPARAMS=where:scientific='Calanus finmarchicus';table:dist_sp_5deg;count_column:nincl &TILED=false&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&SRS=EPSG:4326 &BBOX=-180,-90,180,90&WIDTH=640&HEIGHT=480 Handy URL Decoder/Encoder Tool

Standard GeoServer Parameters BBOX: Defines the geographical Bounding Box as 2 x,y (longitude, latitude) coordinate pairs (bottom left and top right) EPSG: Coordinate Projection System – for the web is usually EPSG 4326, but others can be used, especially for polar projections. Geoserver can re-project data from the original projection of a layer to others (See WMS GetCapabilities for supported projections). STYLE: The style set up in Geoserver to apply to the layer, uses pre-configured default styling when not specified. NOTE: It is important to consult the guidance notes to apply the correct styling to layers.

BBOX (Bounding Box) WestEast South North -30,-30 40,45

Map Projections

Image Heights and Widths (Aspect Ratio) 1.33 : 1

OBIS IMPLEMENTATION SPECIFCS

Species Distribution (Gridded) - Maps EXAMPLE Web Map Service URL: age/png &VIEWPARAMS=where:scientific='Calanus finmarchicus';table:dist_sp_5deg;count_column:nincl &SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&SRS=EPSG:4326 &BBOX=-180,-90,180,90&WIDTH=480&HEIGHT=320 Calanus finmarchicus 5 x 5 degree grid

Species Distribution (Gridded) - Maps EXAMPLE Web Map Service URL: mage/png &VIEWPARAMS:where:scientific='Calanus finmarchicus';table:dist_sp_5deg; &SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&SRS=EPSG:4326 &BBOX=-180,-90,180,90&WIDTH=480&HEIGHT=320 The VIEWPARAMS is very important! where parameter provides OBIS specific functionality: –scientific = valid (current) name of the Species – check WoRMS –table = required resolution of grid polygons (possible values are:- dist_sp_5deg, dist_sp_1deg, dist_sp_05deg, dist_sp_01deg) Note: more than 1 layer is specified in the URL here (species distribution and country) the order of these is important. Note: If we do not add a parameter for style the default style (configured in GeoGerver) is used.

Species Distribution (Gridded) – Map Legends EXAMPLE Web Map Service GetMap URL: T=image/png &VIEWPARAMS=where:scientific='Calanus finmarchicus';table:dist_sp_5deg; &TILED=false&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&SRS=EPSG4326 &BBOX=-180,-90,180,90&WIDTH=480&HEIGHT=320 EXAMPLE Web Map Service GetLegendGraphic URL: bow&width=20&height=20&format=image/png Calanus finmarchicus 5 x 5 degree grid

Species Distribution (Gridded) - Data Example WMS Get Feature Request &BBOX= , ,168.75,112.5&SERVICE=WMS&VERSION=1.1.1&X=366&Y=193&INFO_FORMAT=text/html&QUERY_LAYER S=OBIS:dist_sp,OBIS:country&FEATURE_COUNT=50&Viewparams=where:scientific='Calanus finmarchicus';table:dist_sp_5deg;&Layers=OBIS:dist_sp,OBIS:country&Styles=&WIDTH=480&HEIGHT=320&format=im age/png&srs=EPSG:4326 Useful when building applications but not so easy to do this manually But you can use an Open Layers Application and click on a map and see the data for any features. X=X coordinate in pixels of feature measured from upper left corner of the map. Y=Y coordinate in pixels of feature measured from upper left corner of the map. INFO_FORMAT= Return format of feature information, other options include text/xml and text/plain.

Species Distribution (Gridded) - Data Example WFS Data Request &typeName=OBIS:dist_sp&outputFormat=csv &VIEWPARAMS=where:scientific='Calanus finmarchicus';table:dist_sp_5deg;&MAXFEATURES=20 For a shapefile we can change the outputFormat=shape-zip For all Geoserver WFS output formats see (JSON / JSONP / EXCEL are not enabled in OBIS)

Observation Data - Maps Map shows Point by Point - the positions where observations have been made a&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&STYLES=&FORMAT=image/png& SRS=EPSG:4326&VIEWPARAMS=where:tname='Carcharodon carcharias'; &BBOX=-180,- 90,180,90&WIDTH=480&HEIGHT=256 Global Map of Point Observations Great White Shark Carcharodon carcharias

Observation Data - Points Download the OBIS occurrence data using the Web Feature Service (WFS) to get OBIS observation data… Use layers OBIS:drs_with_woa or OBIS:points_ex For a specific taxon you can specify the taxon name in either of these layers using the VIEWPARAMS=where:tname='Taxonomic name' Note that the OBIS:points_ex layer also supports specifying taxa using a WoRMS aphia_id e.g VIEWPARAMS=where:valid_aphia_id=105838

Observation Data - Points Example: to retrieve all records from OBIS as a CSV file for the species Kogia breviceps (pygmy sperm whale) WoRMS Aphia ID = You would construct a URL as either of the following:- me=OBIS:points_ex &outputFormat=csv&VIEWPARAMS=where:valid_aphia_id= me=OBIS:points_ex &outputFormat=csv&VIEWPARAMS=where:tname='Kogia breviceps' The value that you place in the VIEWPARAMS=where: parameter in the query string is your key to constructing a filter on the layer You can use any of the available fields in the layers dataset (note the more complex the filter the longer it may take to execute). THE where: value i.e. where:tname='Kogia breviceps' is actually a postgresql query where clause.

Biodiversity Summary - Maps Use layer OBIS:summaries e.g. &LAYERS=OBIS:summaries,OBIS:country&styles=summaries_n_rainbow,country &VIEWPARAMS=table:map05deg_with_geom&bbox=-20,-40,60,40 &width=660&height=660&srs=EPSG:4326&Format=image/png Parameters to play with are Styles and VIEWPARAMS (table) ParameterResolution Number of Records styles=summaries_n_rainbow5 x 5 degreetable:map5deg_with_geom Number of Species styles=summaries_s_rainbow1 x 1 degreetable:map1deg_with_geom Shannon Diversity styles=summaries_shannon_rainbow0.5 x 0.5 degreetable:map05deg_with_geom Simpson Diversity styles=summaries_simpson_rainbow0.1 x 0.1 degreetable:map01deg_with_geom ES50Styles=summaries_es50_rainbow

Biodiversity Summary - Maps Number of Species Recorded around Africa at 0.5 Degree Resolution: &LAYERS=OBIS:summaries,OBIS:country&styles=summaries_n_rainbow,country &VIEWPARAMS=table:map05deg_with_geom&bbox=-20,-40,60,40 &width=660&height=660&srs=EPSG:4326&Format=image/png Note as you need to specify the style for summaries layer, if you wish to include more layers, you must specify the styles for them in the same order as the LAYERS are specified Simpson Biodiversity in Mozambique EEZ at 1 Degree Resolution: &LAYERS=OBIS:summaries,OBIS:country,OBIS:eezs &styles=summaries_simpson_rainbow,country,eez_color &VIEWPARAMS=table:map1deg_with_geom&bbox=30,-30,45,-9 &width=660&height=660&srs=EPSG:4326&Format=image/jpeg

Biodiversity Summary - Data Use the Web Feature Service (WFS) All columns within the underlying data table / view are returned (so no need to worry about the style parameter) Biodiversity Summary data around Africa at 0.5 Degree Resolution as a shapefile: peName=OBIS:summaries&VIEWPARAMS=table:map05deg_with_geom&bbox=-20,- 40,60,40 &srs=EPSG:4326&outputFormat=SHAPE-ZIP Biodiversity in area around Mozambique at 0.1 Degree Resolution as a CSV file: peName=OBIS:summaries&VIEWPARAMS=table%3Amap1deg_with_geom&bbox=30,- 30,45,-9 &srs=EPSG:4326&outputFormat=csv

Appendix

C-squares Gridded data available from OBIS uses the c-squares global grid notation. When obtaining gridded Data you will see a column named “cscode” See nested-global-grid for more informationhttp:// nested-global-grid

C-squares

C-squares aims to provide a hierarchical, globally applicable system of geocodes representing discrete areas on the ground at a range of scales useful for –Spatial indexing and data aggregation –Representation of complex areas (e.g. strings of relevant c-squares) –Simple/rapid web mapping For more information on the c-squares notation see csquares-nested-global-grid

Further Information Sources Geoserver Manual > Section on WFS – Geoserver Manual > Section on WMS – Geoserver Manual > WMS Reflector –

Finding the OBIS valid_id for a taxon Use the iOBIS Web Portal to get the “OBIS Taxon ID” From the top menu of the web portal select either: Maps > Distribution by Taxon or Search Data > “Click to search & browse taxa”