OBIS
Current situation Working on new IT platform Present technology 8 years old Data ingestion going fine Including data quality Position, time Taxonomy Web site well visited
Number of records (M)
Number of datasets
Average size dataset (K)
Web statistics
Data statistics
Analysis of content First preliminary analyses Has to take into account huge bias Geography Mostly coastal Mostly northern hemisphere Taxonomy Presence-only ‘Safety in numbers’
Number of records For known species most important to your project, what major discoveries have been made about their range or distribution? What is least known with regards to their distribution that you would like to know?
Number of species
Hurlbert’s index (es(50))
Large marine ecosystems
‘Age’ of record – trends study
Latitudinal gradient ES(50)
Marine fish to be discovered Mora et al (2007). The completeness of taxonomic inventories for describing the global diversity and distribution of marine fishes. Proc. R. Soc. B, published on line Percentage completeness 1 100
How good is the data? Data are from many sources Inconsistent become apparent Differences in names used Mistakes in transformations Decimalising lat/lon Needs quality control Data collection driven by priorities Sampling bias; resolution
Quality control Check formal record structure Check date/time Check position In the ocean? In dataset bounding box? Check taxonomy Problem: no reference list
New species are discovered Data from
Problems with taxonomic names Misspellings Misspellings Mixed with other information Mixed with other information Gadus sp.; Gadus sp. A; Gadus sp. a… Gadus sp.; Gadus sp. A; Gadus sp. a… Gadus morhua?; Gadus cfr morhua; Gadus aff. morhua… Gadus morhua?; Gadus cfr morhua; Gadus aff. morhua… Gadus morhua juv.; Gadus morhua juvenile; Gadus morhua juveniles… Gadus morhua juv.; Gadus morhua juvenile; Gadus morhua juveniles… Mixed with ecological/sampling information Mixed with ecological/sampling information Also variation in classification and author string Also variation in classification and author string
Examples of variation Callorhinchus callorynchus Callorhinchus callorynchus Cirrhinus or Cirrhina Cirrhinus or Cirrhina Cirrhinus cirrhosa or C. cirrhosus Cirrhinus cirrhosa or C. cirrhosus Cirrhina cirrhosa or C. cirrhosus Cirrhina cirrhosa or C. cirrhosus Microsoft helping a bit: Microsoft helping a bit: Calinectes ornatus Ordway, 1863 Calinectes ornatus Ordway, 1864 … Calinectes ornatus Ordway, 1891 Calinectes ornatus Ordway, 1863 Calinectes ornatus Ordway, 1864 … Calinectes ornatus Ordway, 1891
Number of ‘species’ in OBIS 147K unique ‘scientific names’ 147K unique ‘scientific names’ 132K ‘clean names’ 132K ‘clean names’ Approx 10% reduced (from 147K) Approx 10% reduced (from 147K) 80K match with WoRMS 80K match with WoRMS 11K known synonyms or misspellings 11K known synonyms or misspellings Non-matches assumed valid Non-matches assumed valid 121K ‘valid names’ 121K ‘valid names’ Approx 20% reduced Approx 20% reduced
Reduction of es(50) per 5d square
Same for fish
General patterns indistinguishable All Fish DirtyClean
Completeness
How to get OBIS data? Web site Web site DiGIR provider DiGIR provider OGC-compliant web services OGC-compliant web services Exist on experimental basis Exist on experimental basis Google base Google base Ask us! Ask us! Custom data extraction Custom data extraction
Data from field projects Not always easy to ‘trace’ Not always easy to ‘trace’ Not well documented what is CoML data, aand which field project it belongs to Not well documented what is CoML data, aand which field project it belongs to Needs mechanism to better document Needs mechanism to better document Part of the metadata? Part of the metadata? Exercise was done at iOBIS Exercise was done at iOBIS Spreadsheet will be made available Spreadsheet will be made available Please check Please check In general, good agreement with our understanding and information from annual reports In general, good agreement with our understanding and information from annual reports
Field projects Acronym # datasets as per group # records as per group # datasets in OBIS # records in OBIS CeDaAMar CAML ArcOD CoMargE POST1? CReefs ICoMM Mar-ECO1?12744 NaGISA GoMA CenSeam TOPP0000 ChEss CMarZ11141 HMAP10319, FMAP
How to get data in OBIS? Dialogue ongoing with all major providers Dialogue ongoing with all major providers All field projects All field projects Regional OBIS Nodes (RONs) Regional OBIS Nodes (RONs) FishBase, OBIS SEAMAP… FishBase, OBIS SEAMAP… iOBIS needs time to ingest data iOBIS needs time to ingest data Quality control… Quality control… Data cycle Data cycle Lag in data availability ~3 months Lag in data availability ~3 months Depending on quality of the data Depending on quality of the data