A review of online data resources

Slides:



Advertisements
Similar presentations
IDigBio Train the Trainers 2 Georeferencing Workshop Gainesville, FL 12-16, Aug 2013 FishNet Workflow for Large Scale Collaborative Georeferencing Nelson.
Advertisements

Program Management Portal: Overview for the Client
HydroServer A Platform for Publishing Space- Time Hydrologic Datasets Support EAR CUAHSI HIS Sharing hydrologic data Jeffery.
Integrating Biodiversity Data
Web-based Specimen Databasing: Lessons from the Plant Bug Planetary Biodiversity Inventory Project presented by Randall T. Schuh Curator and Chair Division.
ESRI Geoportal Extension 10 November 2010 Out-of-the-box capabilities and additional options.
Security Cooperation Information Portal (SCIP) Enhanced Freight Tracking System (EFTS) DSN
User Responsibility A “How To” Guide for SecurityCenter.
FishNet 2 Collaborative Georeferencing Workshop Lawrence, KS 10-11, Jan 2013.
April 6, 2009 Ted Lesher - NexPrise, Inc..  Introduction/NexPrise Background  What is Software as a Service and how can it benefit my school?  Data.
ArcGIS Workflow Manager An Introduction
Software & services for georeferencing of natural history collections data automated georeferencing verification & correction batch processing geographic.
II Course on GBIF Node Management Arusha, Tanzania 31 st October and 1 st November 2008 Tim ROBERTSON Systems Architect GBIF Secretariat Data Publishing.
Global Science and Technology Watch Portal The home page of the GSTW provides access to creating Technology Information Papers (TIPs), searching TIPs Online,
AQS Web Quick Reference Guide Changing Raw Data Values Using Maintenance 1. From Main Menu, click Maintenance, Sample Values, Raw Data 2. Enter monitor.
Data API. AO database List builder Export API User data Transactional data Hybrid data CSV or XLS Automated ftp/sftp https GET request CSV or XML Options.
Training course on biodiversity data publishing and fitness-for-use in the GBIF Network, 2011 edition How Darwin Core Archives have changed the landscape.
Python and REST Kevin Hibma. What is REST? Why REST? REST stands for Representational State Transfer. (It is sometimes spelled "ReST".) It relies on a.
Copyright OpenHelix. No use or reproduction without express written consent1.
Standards and tools for publishing biodiversity data Yu-Huang Wang June 25, 2012.
Software & services for georeferencing of natural history collections data automated georeferencing verification & correction batch processing geographic.
Synopsis of current BIEN and Enquist projects managed by Martha iPlant 2014.
ArcGIS Data Reviewer: An Introduction
CLARIN for Linguists Portal & Searching for Resources Jan Odijk LOT Summerschool Nijmegen,
Research Design for Collaborative Computational Approaches and Scientific Workflows Deana Pennington January 8, 2007.
Ben Scott Lead Architect data.nhm.ac.uk. Central entry point Free & open access DataCite DOIs Funding.
Definition of an Observation In general, an observation represents the measurement of some attribute, of some thing, at a particular time and place. Observations.
ESIP & Geospatial One-Stop (GOS) Registering ESIP Products and Services with Geospatial One-Stop.
Reports and Learning Resources Module 5 1. SLMS Primary Administrator Training Module 5: Reports and Learning Resources 2.
GSA’s Vendor and Customer Self Service (VCSS).  View and Print Statements  View and print statements for your accounts.  Statement Search by Agreement.
Google Refine for Data Quality / Integrity. Context BioVeL Data Refinement Workflow Synonym Expansion / Occurrence Retrieval Data Selection Data Quality.
Fixed Assets Campus Operations Portal SAISD Data Warehouse What is the Fixed Assets portal? The purpose of the Fixed Assets portal is to give campus and.
GBIF Data Access and Database Interoperability 2003 Work Programme Overview Donald Hobern, GBIF Programme Officer for Data Access and Database Interoperability.
An introduction to data exchange protocols in TDWG Renato De Giovanni TDWG 2008.
Coastal Data Management System Update Alfred Wanger May 15,
Information Management Jornada Basin LTER. Jornada Information management system Six major components: a)Data management implementation/process b)Management.
II Course on GBIF Node Management Arusha, Tanzania 31 st October and 1 st November 2008 Tim ROBERTSON Systems Architect GBIF Secretariat The GBIF Data.
Hellenic Centre for Marine Research (HCMR) MedOBIS - Ocean Biogeographic Information System for the Eastern Mediterranean and Black Sea.
Campus Operations Portal SAISD Data Warehouse Fixed Assets Fixed Assets Office The purpose of the Fixed Assets portal is to give campus and department.
What is FIRES? Web Based Crash Database for Florida Crash Data Member
The Protein Identifier Cross-Reference (PICR) service.
Find Research Data b2find.eudat.eu B2FIND User Training How to find data objects and collections using EUDAT’s B2FIND This work is licensed.
3 Copyright © 2010, Oracle. All rights reserved. Product Data Hub: PIM Functional Training Program Setup Workbench Fundamentals.
The New GBIF Data Portal Web Services and Tools Donald Hobern GBIF Deputy Director for Informatics October 2006.
IDigBio Train the Trainers Georeferencing Workshop Gainesville, FL 8-12, Oct 2012.
GBIF Governing Board 20 Module 6B: New GBIF Tools II 2013 Portal and NPT Startup Daniel Amariles IT Leader, National Biodiversity Information System of.
IPT + Darwin Core OBIS XML Schema OBIS Database Schema Explained Mike Flavell OBIS Data Manager OBIS Nodes Training Course, Oostende, Belgium, 6 May 2014.
COINAtlantic Expanding OBIS Canada partnerships and Visualizing OBIS Canada IPT Resources SG-OBIS-V May 25 – 27, 2016 UNESCO/IOC Project Office for IODE.
The new FFDB – an outlook
GML in CDI and CSR ISO using Ends&Bends
Software Application Overview
Michael Morahan CEOS WGISS-43 Meeting
CARA 3.10 Major New Features
Overview – SOE PatchTT December 2013.
Flanders Marine Institute (VLIZ)
Netherlands Biodiversity API and Naturalis Bioportal
Training course on biodiversity data publishing and fitness-for-use in the GBIF Network, 2011 edition How Darwin Core Archives have changed the landscape.
Accessing Spatial Information from MaineDOT
Presenter: Karoline Lapko
Supply Chain Visibility Solution powered by
Integrating Survey data into a geographic information system
Intermountain West Data Warehouse
Overview EMODnet Biology Portal Standards used Web services available
Overview of Oracle Site Hub
Python and REST Kevin Hibma.
ArcGIS Online – The Road Ahead
1. Azure Data Explorer Azure Data Explorer enables rich data exploration over raw, structured, and semi-structured data delivering fast time to insight.
automated georeferencing
Presentation transcript:

A review of online data resources Getting Data A review of online data resources

localized search portals

Secondary Providers Secondary Providers GBIF Search Results for Lagochila lacera

Select data provider(s) Define search criteria Define result options Execute

History 1999: Creation of original FishNet Network Z39.50 protocol for sharing data Search via Species Analyst (distributed query model) 2005: FishNet 2 created Transition to DiGIR Protocol Search via DiGIR Portal (distributed query model) 2010: FishNet 2 (centralized query model) Harvesting of DiGIR, DwCA, Static Spreadsheets Search via FishNet 2 Portal (centralized query model)

Enabling Spatial Queries

Search Results Provider Summary Occurrence Records Geographic Summary Taxon Summary

Downloading & Visualizing Results

Scripted Data Access Using the FishNet 2 et al. Search API Characteristics “REST” like style Output in CSV or Tab API Key to track usage Services Taxon Provider Occurrence Occurrence Counts Allows integration with research workflows

Documentation http://www.fishnet2.net/api/v1/

http://www.fishnet2.net/api/v1/ taxa/? providers/? occurrence/? API Key api= Taxon t= Location l= Catalog No/Inst. Code c= Date Range d= Full Search q= Polygon p= Response Format fmt= Response Attachment att= Select Columns cols= Number of Records num= Start Record set= Return Column Headers hdr= taxa/? providers/? occurrence/? occurrencecount/? Example: www.fishnet2.net/api/v1/occurrence/?api=MyAPIKey&q=percidae

Sample Use Case: Workflow for Integrated Monitoring of Pearl Darter Occurrences from Natural History Collections Data http://www.fishnet2.net /search.aspx? t=percina aurora via Web Browser Percina aurora via Script via Script http://www.fishnet2.net /api/v1/occurrence/? api=myapikey& t=percina aurora Automated post processing, notification, mapping, GIS, analysis, etc. http://www.fishnet2.net /api/v1/occurrencecount/? api=myapikey& t=percina aurora