SpeciesLink A System for integrating distributed primary biodiversity data Vanderlei Perez Canhos Centro de Referência em Informação Ambiental, CrIA.

Slides:



Advertisements
Similar presentations
Codata Workshop1 V iNCES – Weblabs on ecosystem services Pedro Luiz Pizzigatti Corrêa Universidade de São Paulo - Brazil Agricultural Automation Laboratory.
Advertisements

Infra-estrutura de Informação sobre a Biodiversidade Amazônica Conferência Científica Internacional Amazônia em Perspectiva Manaus, 18 Novembro de 2008.
National Institute of Statistics, Geography and Informatics (INEGI) Implementation of SDMX in Mexico.
The Biosafety Clearing-House of the Cartagena Protocol on Biosafety Tutorial – BCH Resources.
12 October 2011 Andrew Brown IMu Technology EMu Global Users Group 12 October 2011 IMu Technology.
National Database Templates for the Biosafety Clearing-House Application (NDT-nBCH) Overview of the US nBCH Applications.
BioNet: Improving the web based data discovery and mapping experience Paul Flemons Centre for Biodiversity and Conservation Research Australian Museum.
SpeciesLink The Brazilian experience on setting up a network Renato De Giovanni Centro de Referência em Informação Ambiental, CrIA.
How can the ALA help BIGnet? Citizen Science at work Piers Higgs Citizen Science Team Lead Sydney, 3 rd April, 2011 The Atlas.
DiGIR1 Distributed Databases and Applications John Wieczorek Museum of Vertebrate Zoology, UC Berkeley.
DiGIR1 Distributed Databases and Applications John Wieczorek Museum of Vertebrate Zoology, UC Berkeley.
The DNA Bank Network Gabriele Droege Botanic Garden and Botanical Museum Berlin-Dahlem Freie Universität Berlin.
Integrating Biodiversity Data
Connect. Communicate. Collaborate Click to edit Master title style MODULE 1: perfSONAR TECHNICAL OVERVIEW.
FAPESP. As established by its constitution, the State of São Paulo, Brazil, allocates 1% of its total tax revenue to FAPESP for the funding of scientific.
WebBee A Brazilian information network on bees. Antonio Mauro Saraiva Universidade de São Paulo CODATA Workshop – 8-10 May 2007 Atibaia - Brazil.
WebBee A platform for a Brazilian information network on bees. Inter-American Workshop on Environmental Data Access 3-6 March 2004 – Campinas - Brazil.
CIA 2003 th International Workshop on Cooperative Information Agents CIA th International Workshop on Cooperative Information Agents DIA: Data Integration.
II Course on GBIF Node Management Arusha, Tanzania 31 st October and 1 st November 2008 Tim ROBERTSON Systems Architect GBIF Secretariat Data Publishing.
EbXML Overview Dick Raman CEO - TIE Holding NV Chairman CEN/ISSS eBES Vice Chair EEMA and HoD in UN/CEFACT Former ebXML Steering Group.
Beispielbild SYNTHESYS II: Updating the BioCASe Technology Suite Jörg Holetschek Botanic Garden & Botanical Museum Berlin-Dahlem Dept. of Biodiversity.
Resource Identification for a Biological Collection Information Service in Europe An introduction to the BioCISE project Walter G. Berendsohn Botanical.
Simple Database.
Training course on biodiversity data publishing and fitness-for-use in the GBIF Network, 2011 edition How Darwin Core Archives have changed the landscape.
INCOFISH WP3 - Campinas, April 2006 WEB Tools and Data Cleaning Alexandre Marino Centro de Referência em Informação Ambiental, CrIA.
OBIS Portal Architecture Concepts plus potential for utilization as a basis for Regional OBIS Nodes Tony Rees, CSIRO Marine Research, Hobart (and OBIS.
GLOBAL BIODIVERSITY INFORMATION FACILITY David Remsen ECAT Program Officer October DarwinCore Archives – Simplified Format for publishing.
1 DanBIF Danish Biodiversity Information Facility Arbejdsseminar om GBIF i Norge Norges Forskningsråd, Oslo 25. September 2003 Isabel Calabuig.
1 Technologies for distributed systems Andrew Jones School of Computer Science Cardiff University.
Open access to biodiversity data: the speciesLink experience Dora Ann Lange Canhos
Web services at TRFIC TRFIC has developed the Access Technologies to achieve its goals of interoperability and provide access to data and information on.
Aspects for Improving the ABBI Patricia Escalante Instituto de Biología UNAM AOU-Collections Committee member.
Centro de Referência em Informação Ambiental, CRIA Dora Ann Lange Canhos March, 2007 mapcria web service openModeller Incofish & CRIA.
Information for decision making Migrating from fragmented visions to solve punctual problems (reacting to crisis) to Systemic and integrated approaches.
Experts Workshop on the IPT, v. 2, Copenhagen, Denmark The Pathway to the Integrated Publishing Toolkit version 2 Tim Robertson Systems Architect Global.
Metadata harvesting in regional digital libraries in PIONIER Network Cezary Mazurek, Maciej Stroiński, Marcin Werla, Jan Węglarz.
TAPIR 1.0 Renato De Giovanni, Markus Döring, Javier de la Torre October 2006.
OpenModeller framework for ecological niche modelling CRIA, INPE, Poli-USP.
Toward integrating three large and disparate networks and databases of Amazon tree biodiversity Oliver Phillips (Rainfor, UK) & Vanderlei Canhos (CRIA,
Flora brasiliensis on-line basic activities  Scanning  Define/develop a system to treat images  High resolution  medium and low resolution  Image.
1 Makes Mobile WiMAX Simple Netspan Overview Andy Hobbs Director, Product Management 5 th October 2007.
Distributed Biodiversity Information Databases A. Townsend Peterson.
GBIF Data Access and Database Interoperability 2003 Work Programme Overview Donald Hobern, GBIF Programme Officer for Data Access and Database Interoperability.
An introduction to data exchange protocols in TDWG Renato De Giovanni TDWG 2008.
Results of a Needs Assessment Survey of the Global Invasive Species Information Network Biodiversity Information Standards- Taxonomic Databases Working.
Mercury – A Service Oriented Web-based system for finding and retrieving Biogeochemical, Ecological and other land- based data National Aeronautics and.
1 The National Biological Information Infrastructure and Biodiversity Collections Annette Olson BCI meeting, Washington DC, January 28-29th, 2008.
Beispielbild BioCASe, ABCD and its extensions Jörg Holetschek Botanic Garden & Botanical Museum Berlin-Dahlem Dept. of Biodiversity Informatics and Laboratories.
OpenModeller A framework for biological/environmental modelling Inter-American Workshop on Environmental Data Access Campinas - SP, Brazil March 2004.
Distributed Data Analysis & Dissemination System (D-DADS ) Special Interest Group on Data Integration June 2000.
Networking Biodiversity Data – Online Access to Distributed Data Sources in GBIF-D Andrea Hahn, A. Kirchhoff & W.G. Berendsohn Botanic Garden and Botanical.
1 openModeller Presentation Plan: Overview of openModeller OMWS: an open standard for distributed ecological niche modelling openModeller in relation to.
The New GBIF Data Portal Web Services and Tools Donald Hobern GBIF Deputy Director for Informatics October 2006.
AUSTRALIA’S VIRTUAL HERBARIUM A national collaborative model for integrated access to distributed biological information Australian National Herbarium.
Amazon Basin Biodiversity Information Facility – ABBIF.
Steven Perry Dave Vieglais. W a s a b i Web Applications for the Semantic Architecture of Biodiversity Informatics Overview WASABI is a framework for.
IABIN Species and Specimens Thematic Network (SSTN) IABIN Executive Committee/Coordinating Institution Meeting. Tierras Enamoradas, Costa Rica. February.
The EDIT Partnership Network of 25 taxonomic institutions with the aim to integrate research and improve the production of knowledge Initiated by the.
Global Climate Change Consequences for Cerrado Tree Species Marinez Ferreira de Siqueira Centro de Referência em Informação Ambiental - CRIA.
Inter-American Workshop on Environmental Data Access geoLoc and spOutlier: on-line tools for geocoding and validating biological data geoLoc and spOutlier.
TapirLink: Enabling the transition to TAPIR Renato De Giovanni TDWG 2007.
IDigBio Train the Trainers Georeferencing Workshop Gainesville, FL 8-12, Oct 2012.
GBIF Governing Board 20 Module 6B: New GBIF Tools II 2013 Portal and NPT Startup Daniel Amariles IT Leader, National Biodiversity Information System of.
IPT + Darwin Core OBIS XML Schema OBIS Database Schema Explained Mike Flavell OBIS Data Manager OBIS Nodes Training Course, Oostende, Belgium, 6 May 2014.
National Biological Information Infrastructure Tom Lahr USGS Biological Resources Division, Office of Biological Informatics and Outreach Information Technology.
NOS DataExplorer Enterprise GIS Efforts within NOAA's Ocean Service Jason Marshall (PSGS) NOAA Coastal Services Center.
Unit – 5 JAVA Web Services
Flanders Marine Institute (VLIZ)
Fast and stable connectivity registry http/xml speciesLink site Presentation Layer http/xml Registered Providers lib DiGIR UDDI Portal Fast.
Overview EMODnet Biology Portal Standards used Web services available
Presentation transcript:

speciesLink A System for integrating distributed primary biodiversity data Vanderlei Perez Canhos Centro de Referência em Informação Ambiental, CrIA

Overview CRIA SinBiota and The Species Analyst speciesLink Type of collections involved Number of records Technical features Future plans

CrIA Reference Center on Environmental Information Focus on Biodiversity Informatics Open source software Standards and protocols Systems interoperability Partnerships

mainly United States Location of participant collections: mainly United States several taxa Taxonomic groups: several taxa Z39.50 (migration to DiGIR on process) Protocol: Z39.50 (migration to DiGIR on process) ~ Number of records: ~

Importance of data sharing Paris KU – Natural History Museum British Museum Field Museum

The main goal of speciesLink was to build a distributed system integrating several biological collections and making their primary data available on the Internet. speciesLink Distributed Information System for Biological Collections

fish: 3 herbaria: 4 microorganisms: 3 mites: 2 inventories: SinBiota Geographic distribution of the participant collections – phase I São Paulo State Collections

Number of Records availableexisting Herbaria72,000of740,000 Microorganisms1,000of2,700 Mites18,000of22,000 Fish70,000of123,000 Inventories (species) 38,000of38,000 ~200,000of~1,000,000

Microbial Collections CBMAI IBSBF9292,000 Observational Data SinBiota38,109 Botanical Collections ESA73080,000 SP11,280350,000 IAC25,24545,000 SPF21,828133,500 UEC12,860130,000 Zoological Collections ACARISJRP5,3827,000 ACARIESALQ12,39215,000 DSZSJRP (fish) 5,71423,000 LIRP (fish) 4,31430,000 MZUSP (fish) 60,000110,000 Collection Management Software

Support to collections Providing basic equipment and network infrastructure Helping to choose a management system, when needed Helping to train and to import data, when needed

Protocol and Content Schema DiGIR protocol (Distributed Generic Information Retrieval) Potential to be globally accepted DiGIR software (Java Portal & PHP Provider) Collaborative development DarwinCore v.2 Covers the basic content elements (taxonomic identification, location and date of collecting event)

Simple Search Interface

speciesLink site Presentation Layer speciesLink site Presentation Layer DiGIR Portal (Java) DiGIR Portal (Java) Perl Slow or unstable connectivity Fast and stable connectivity Data SOAP client Collection Management System SQL Collection C Data Repository Data SOAP client Collection Management System SQL Collection B Data Repository Postgres PHP Provider SOAP Server SQL Regional Server Data PHP Provider Collection Management System SQL Collection A System’s Architecture

Regional Server Network Design

speciesLink site Presentation Layer speciesLink site Presentation Layer DiGIR Portal (Java) DiGIR Portal (Java) Perl Slow or unstable connectivity Fast and stable connectivity Data SOAP client Collection Management System SQL Collection C Data Repository Data SOAP client Collection Management System SQL Collection B Data Repository Postgres PHP Provider SOAP Server SQL Regional Server Data PHP Provider Collection Management System SQL Collection A System’s Architecture

Data Migration Client Platform independent (java) Connects to any database accessible via JDBC (simple text files are also supported) Complete control over data Low traffic Possibility to filter sensitive data using a regular expression

speciesLink site Presentation Layer speciesLink site Presentation Layer DiGIR Portal (Java) DiGIR Portal (Java) Perl Slow or unstable connectivity Fast and stable connectivity Data SOAP client Collection Management System SQL Collection C Data Repository Data SOAP client Collection Management System SQL Collection B Data Repository Postgres PHP Provider SOAP Server SQL Regional Server Data PHP Provider Collection Management System SQL Collection A System’s Architecture

Regional server Features perl / PostgreSQL combination Can hold data from several collections Interpretation rules can be applied to specific data Postgres Provider PHP SOAP Server (perl) SQL

Query Result (brief)

speciesLink – phase II

>35 collections available

Future plans Mapping tools

Future plans Mapping tools Data cleaning tools

Future plans Mapping tools Data cleaning tools Modelling framework

DiGIR Portal DiGIR Portal Precipitation Vegetation Temperature Environmental layers ACME Bioclim Neural Net GARP specimens BioCASE Portal BioCASE Portal Modelling algoritms Infrastructure for Species Distribution Modelling

Instituto de BotânicaUniversidade Estadual de Campinas Universidade de São Paulo Instituto Agronômico de Campinas Instituto Biológico Universidade Estadual Paulista Acknowledgements (phase I) Escola Superior de Agricultura “Luiz de Queiroz”

Fellowships Visiting researchers –Andrew Townsend Peterson (3 months) –Arthur Chapman (1 year) Pos-doctor –Ingrid Koch Technical training (6 TT fellowships)

Summing up Achieved proof of concept Data is already available Low cost for connecting new collections Triggered off a movement within the collections to improve the quality of data and to increase the amount of available information Adoption of standards and protocols International partnerships: DiGIR, modelling framework Interoperability with similar initiatives

Thank you!