Biodiversity Information Serving Our Nation (BISON) Derek Masaki USGS SCGIS April 21 2016

Files – Presentation and Demo https://www.dropbox.com/s/xw3i0pe4th2uvc1/SCGISapr2016.zip?dl=0 SCGISapr2016.zip everglades_bison_leaflet_mammals.html sesc_bisc_herpetofauna_2002_2003.csv sescbisc.csv BISON - SCGIS Presentation - Apr21 2016.pptx sesc_biscayne_map.r rbison_demo.r create_everglades_leaflet_map.r sesc_biscayne_plot.png

BISON Overview http://bison.usgs.ornl.gov

BISON Overview National Clearinghouse for biodiversity occurrences 261+ million records & growing. Nearly all U.S. species represented 55 environmental layers Who, what, when, where for every record. 1568 data sets from 380 global providers across Federal, State, and local Gov’ts, NGOs and Academia. Built on open source platforms (Apache, SOLR, OpenLayers, PostGIS) System APIs built first; Web application relies on open data APIs 819,426 unique collectors

BISON Description 4

BISON Description

Data Aggregation – Many Sources Datasets from Federal agencies: BLM - Landscape Monitoring Framework - Plants - 2011-2013 (44,626) BLM - National Invasive Species Information Management System - Plants - 2010-2014 (62,317) EPA - National Lakes Assessment - Zooplankton - 2007 (17,539) NPS - Inventory and Monitoring Program - NPSpecies Park Species Lists (256,073) USDA - PLANTS Database (2,390,439) USFS - Forest Inventory and Analysis - Tree Species (18,170,706) USFS - New York City Tree Census - 1995 (516989) USFWS - Big Rivers Network Native Bee Survey Project (FWS No. F11AC00869) - 2013 (6,071) USFWS - Mourning Dove Call-Count Survey - 2001-2013 (9,270) USFWS - Ruby Lake NWR - Vegetation Mapping Survey - 2012-2013 (577) Numerous sets from USGS Science Centers: Alaska, FORT, Leetown, NWHC, PIERC, PWRC, SESC & WERC. Highlighting PWRC... USGS PWRC - Bird Banding Lab - (61,605,303) USGS PWRC - Bird Phenology Program (585,541) USGS PWRC - Colonial Waterbirds - US (109,596) USGS PWRC - Native Bee Inventory and Monitoring Lab - US-CA-MX - Bees (260,950) USGS PWRC - North American Breeding Bird Atlas Explorer (2,726,852) USGS PWRC - North American Breeding Bird Survey - 1966-2013 (2,288,254)

Data Standardization- Processing Develop Metadata – FGDC and EML https://www.fgdc.gov/metadata http://www.dcc.ac.uk/resources/metadata-standards/eml-ecological-metadata-language Align Data w/ Darwin Core http://rs.tdwg.org/dwc/ Process Data in Compliance w/ BISON Standards e.g. ISO Date; ITIS Valid Name; US FIPS; Validate Taxonomy Validate Geography Populate PostGreSQL/PostGIS Populate SOLR Index

Data Aggregation – Metadata | Statistics

BISON Open Data Principles Discoverability Provide adequate metadata for every dataset Sharing through open data catalogs Accessibility Developing multiple points of access through open data services Usability Connecting data to tools, maps, models, etc. Creating advanced APIs that return data functionality

BISON Open Data Principles SOLR API – JSON CSV Response RESTful API URL Query http://bisonapi.usgs.ornl.gov/solr/occurrences/select?q=*:* http://bisonapi.usgs.ornl.gov/solr/occurrences/select?q=scientificName:”Bison bison” http://bisonapi.usgs.ornl.gov/solr/occurrences/select?q=resourceID%3A+%22440%2C100017%22&wt=csv&start=0&rows=380 SOLR Spatial http://bisonapi.usgs.ornl.gov/solr/occurrences/select/?q=decimalLatitude:[41.72%20TO%2045.80]%20AND%20decimalLongitude:[-113.89%20TO%20-108.46]&facet=true&facet.field=scientificName&facet.field=year&wt=csv&rows=250 WMS http://bison.usgs.ornl.gov/api/wms?LAYERS=species&species=Pica%20pica&type=scientific_name&TRANSPARENT=true...%20&FORMAT=image%2Fpng&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&STYLES=&SRS=EPSG%3A3857&BBOX=-20037508.34,-1.862645149231e-9,-5009377.085,15028131.255&WIDTH=512&HEIGHT=512

Data Discoverability http://www.data.gov/ecosystems/

Data Discoverability http://viewer.geoplatform.gov

Data Interoperability

Data Interoperability Using External Data : USDA Soil Service Web Map Service

Data Interoperability Severe weather NEXRAD radar from NOAA with known occurrences of rare amphibians from USGS BISON

Web API – HTML Mashups The web services of BISON allow users to easily implement a variety of applications on their desktops or their own web sites. Examples and templates are given on the BISON web site. Output Formats (Direct Solr & API) JSON, JSONP, XML, SHP, CSV + WMS services Dynamic HTML driven using JavaScript in combination with JSON delivered through BISON APIs. http://stingersplace.com/js

Mobile Geolocation– Augmented Reality Augmented reality viewer [Android app] prototype. Mobile geolocation driven data applications.

Modeled Ranges – 48,000 Species All species with appropriate data under current and future climate conditions. http://lifemapper.org/

Modeled Ranges Taenionema atlanticum (Winter Stonefly) as its habitat suitability shifts using the A2 scenario for three future timesteps. The A2 storyline and scenario family: a very heterogeneous world with continuously increasing global population and regionally oriented economic growth that is more fragmented and slower than in other storylines. Layers are CURRENT & A2 scenario, 2039, 2069, and 2099.

Spatio-Temporal Exploratory Models http://ec2-50-17-240-81.compute-1.amazonaws.com/stemy.html Distribution of Barn Swallow (Hirundo rustica) Probability by ordinal day of the year for the 1920’s

Bird Banding Lab - Viewer http://www.pwrc.usgs.gov/BBL/bnd_maps/index.cfm D3 Visualization – 62 Million Records – SQLite – Python API Harvester

Demos BISON http://bison.usgs.ornl.gov Metadata http://bison.ornl.gov/ipt/ JSON WMS APIs http://bison.usgs.ornl.gov/#api Geoplatform Interoperability http://viewer.geoplatform.gov RBison https://cran.rstudio.com/web/packages/rbison/rbison.pdf R Geospatial https://journal.r-project.org/archive/2013-1/kahle-wickham.pdf R Leaflet http://www.r-bloggers.com/the-leaflet-package-for-online-mapping-in-r/

Thank You! Derek Masaki dmasaki@usgs.gov USGS Core Science Systems BISON Product Owner/Data Manager http://bison.usgs.ornl.gov 23