CSIRO Marine Research Data Centre linked databases - CAAB, MarLIN and Divisional Data Warehouse.

Slides:



Advertisements
Similar presentations
Introductory to database handling Endre Sebestyén.
Advertisements

CSIRO Marine Research Divisional Data Centre Current and Future Activities Tony Rees, Data Centre Manager April 2004.
C-squares - a new simple, XML friendly, display/ query/ exchange format for representing spatial data extents at the metadata level System concept and.
Geospatial One-Stop A Federal Gateway to Federal, State & Local Geographic Data
An Operational Metadata Framework For Searching, Indexing, and Retrieving Distributed GIServices on the Internet By Ming-Hsiang.
The Australian SDI Clearinghouse Presentation by Peter Holland, General Manager, National Mapping Division, Geoscience Australia,
A Semantic Modelling Approach to Biological Parameter Interoperability Roy Lowry & Laura Bird British Oceanographic Data Centre Pieter Haaring RIKZ, Rijkswaterstaat,
Evolving concepts in the architecture of OBIS, the Ocean Biogeographic Information System Tony Rees CSIRO Marine Research 29 November 2004 Phoebe Zhang.
Library Online Catalog Tutorial Pentagon Library Last Updated March 2008.
Integrated Taxonomic Information System Janet Gomon, Deputy Director, ITIS Smithsonian Institution Museum of Natural History The.
OBIS Australia – Regional Node for the Ocean Biogeographic Information System (OBIS) OBIS Australia is an operational component of the Census of Marine.
1 ISO – Metadata Next Generation International consensus being built on structured metadata within a broader Geomatics Standard under ISO Technical.
Using Social Care Online: an overview Version 1.0 April 2015.
Attribute databases. GIS Definition Diagram Output Query Results.
1 CS 502: Computing Methods for Digital Libraries Lecture 4 Identifiers and Reference Links.
Seminar #1 – Refreshing databases concepts and SQL CM036: Advanced Databases1 Seminar 1: Revisiting Databases and SQL Purpose To refresh basic concepts.
Implementation of ISO in Australia Craig Macauley ANZLIC, Australia
Databases & Data Warehouses Chapter 3 Database Processing.
Considerations for the Construction of Lichen Databases Data Management.
SeaDataNet Ontology Use Case Roy Lowry British Oceanographic Data Centre Coastal Atlas Interoperability Workshop, Corvallis, July (+ Lessons.
MarLIN - CSIRO Marine Laboratories Information Network CAAB - Codes for Australian Aquatic Biota plus other systems of interest... Tony Rees Divisional.
CM [A] R’s “MarLIN” Metadata System - or, how do we discover what data we’ve got?? Tony Rees Manager, Divisional Data Centre 3 June 2005 CSIRO.
U.S. Department of the Interior U.S. Geological Survey NWIS, STORET, and XML National Water Quality Monitoring Council August 20, 2003.
Geospatial One Stop Modules Two and Three. Module 2 Inventory/Document existing Federal agency framework datasets and publish metadata to clearinghouse.
Metadata and Data Management activities at CSIRO Marine Research, Australia Kim Finney & Tony Rees Divisional Data Centre CSIRO Marine Research, Hobart.
VOCABULARIES A data management presentation. Data management best practices Inventory of resources/datasets – Database level or series of datasets/collections.
Gene Expression Omnibus (GEO)
Introduction to OBIS-USA Biological Data, Applications, & Relationships March 14, 2011.
OBIS Portal Architecture Concepts plus potential for utilization as a basis for Regional OBIS Nodes Tony Rees, CSIRO Marine Research, Hobart (and OBIS.
F. Toussaint (WDCC, Hamburg) / / 1 CERA : Data Structure and User Interface Frank Toussaint Michael Lautenschlager World Data Center for Climate.
Metadata and Geographical Information Systems Adrian Moss KINDS project, Manchester Metropolitan University, UK
Water Quality Data, Maps, and Graphs Over the Web · Chemical concentrations in water, sediment, and aquatic organism tissues.
U.S. Department of the Interior U.S. Geological Survey NWIS, STORET, and XML Advisory Committee on Water Information September 10, 2003 Kenneth J. Lanfear,
Zope/Plone/Python for Research Ben Best OBISSEAMAP mapping marine megavertebrates
On-line biological data concepts at CSIRO Marine Research, Australia Tony Rees & Kim Finney Divisional Data Centre CSIRO Marine Research, Hobart, Australia.
OBIS and species distributions Tony Rees discussion presentation, March 2003 Some fundamental intentions for OBIS... –Choose any species and discover its.
Tony Rees Divisional Data Centre CSIRO Marine Research, Australia Metadata concepts, issues and experiences – lessons from 8 years.
MarLIN CSIRO Marine Laboratories Information Network update April 1999 Tony Rees Divisional Data Centre CSIRO Marine Research, Hobart acknowledgements:
ESIP & Geospatial One-Stop (GOS) Registering ESIP Products and Services with Geospatial One-Stop.
The CSA/NBII Biocomplexity Thesaurus: Current Initiatives, Future Directions CENDI Terminologies Workshop Washington, DC 16 September 2004 Lisa Zolly NBII.
Field Based Data Validation: a very real experience in wrangling data, taxonomic names, and photos Moorea Biocode Project, supported by the Gordon and.
Data resource management
Managed by UT-Battelle for the Department of Energy Mercury – Distributed Metadata Tool for Finding and Retrieving CDIAC Data CDIAC UWG Meeting September.
Alternative Architecture for Information in Digital Libraries Onno W. Purbo
NDD (National Oceans Office Data Directory) development overview as at 1 July 2002 Tony Rees/Miroslaw Ryba CSIRO Marine Research, Hobart.
Gene Expression Omnibus (GEO)
GBIF Data Access and Database Interoperability 2003 Work Programme Overview Donald Hobern, GBIF Programme Officer for Data Access and Database Interoperability.
From the Advanced Search page of the Cochrane Library, we have clicked on the Cochrane Reviews: By Topic hyperlink. This has displayed the Topics for Cochrane.
Mercury – A Service Oriented Web-based system for finding and retrieving Biogeochemical, Ecological and other land- based data National Aeronautics and.
BiodiversityWorld GRID Workshop NeSC, Edinburgh – 30 June and 1 July 2005 Taxonomic verification: Species 2000 and the Catalogue of Life Frank Bisby.
1 Overview Finding and importing data sets –Searching for data –Importing data_.
D. Heynderickx DH Consultancy, Leuven, Belgium 22 April 2010EuroPlanet, London, UK.
U.S. Department of the Interior U.S. Geological Survey The Biological Data Profile Extending the FGDC Metadata Standard Kirsten Larsen.
MarLIN - CSIRO Marine Laboratories Information Network.
Fábio Lang da Silveira – This talk on behalf of OBIS International Committee and OBIS North & South America Nodes USP – Zoology.
Hellenic Centre for Marine Research (HCMR) MedOBIS - Ocean Biogeographic Information System for the Eastern Mediterranean and Black Sea.
ADL Alexandria digital Library – Davidson Library, UCSB Alexandria Digital Library (ADL) Brief intro to ADL Item vs Collection Level Metadata Collection.
CAAB and taxon management at CSIRO Marine Research Tony Rees Divisional Data Centre CSIRO Marine Research, Hobart
MarLIN: a research data metadatabase for CSIRO Marine Research Tony Rees Divisional Data Centre CSIRO Marine Research, Hobart contact:
CAAB - Codes for Australian Aquatic Biota Tony Rees Divisional Data Centre CSIRO Marine Research, Hobart
The New GBIF Data Portal Web Services and Tools Donald Hobern GBIF Deputy Director for Informatics October 2006.
Riccardi: DIALOGUE Workshop August 1, 2005 Supported by NSF BDI 1 Representing and Using Phylogenetic Characters in Morphbank Greg Riccardi, David Gaitros,
The Proliferation of Metadata Standards and the Evolution of NASA’s Global Change Master Directory (GCMD) Standard for Uses in Earth Science Data Discovery.
System concept and development by: Tony Rees Divisional Data Centre CSIRO Marine Research, Australia c-squares - a new method for representing, querying,
System concept and development by: Tony Rees Divisional Data Centre CSIRO Marine Research, Australia c-squares - a new method for representing, querying,
Definition, purposes/functions, elements of IR systems Lesson 1.
Using Social Care Online: an overview
Flanders Marine Institute (VLIZ)
WHAT DOES THE FUTURE HOLD? Ann Ellis Dec. 18, 2000
Overview EMODnet Biology Portal Standards used Web services available
Presentation transcript:

CSIRO Marine Research Data Centre linked databases - CAAB, MarLIN and Divisional Data Warehouse

CAAB - Codes for Australian Aquatic Biota Holds names and codes for Aquatic organisms of interest to our Division, plus selected other agencies, for use in data storage Adopted by a variety of other agencies as “de facto” standard for coding fisheries data in the Australian region Recently (1999) upgraded to hold codes for many other types of organisms Can hold cross-references to ITIS numbers and other codes Allows maintenance of the names to be decoupled from maintenance of the data Searchable via web interface by scientific name, common name or taxon code (or parts thereof) Can function as a live look-up table for other CMR databases which use codes as internal taxon idendifiers

example CAAB search result (search for “tuna”)

CAAB “meaningful” codes hierarchy (and “telephone” analogy) CAAB has 2-digit “major categories” - e.g. 10=Porifera, 37=Pisces, 63=Angiosperms … (country code) Has up to 999 family codes in each category, in a recognised systematic sequence (e.g to are all sharks) … (area code) Holds up to 999 taxa in each family, assigned as next available number (allows for generic or species reassignment without needing to change the code) … (user number) “Split” families catered for without changing the code; “lumped” families or taxon transfers may require re-coding Allows for rapid automated filtering or sorting of data by codes alone

MarLIN - Marine Laboratories Information Network Divisional metadatabase - holds descriptions of datasets Uses regional standard (“ANZLIC”) metadata elements, plus agency-level extensions e.g. projects, surveys, vessels, taxonomic groups and CAAB species Searchable via www (intranet and internet) Includes structured result sets, sorted by keyword, etc. (similar to GCMD) All externally accessible records also retrievable via ASDD (Australian gateway for distributed searching) Records contain on-line links to further resources and actual data wherever appropriate

MarLIN “user-defined search” interface

Using “species” option to search MarLIN...

Example MarLIN search results Lists of titles Dataset “thumbnail + links” pages

example full metadata record

ASDD metadata gateway - distributed searching

New Divisional Data Warehouse (under development) Builds on a prototype (“SQuID”) developed in Designed to hold variety of data types - biological, physical and chemical oceanographic data; photographic data; ships’ tracks; etc. etc. Uses CAAB taxon codes for internal biological data handling Will be hyperlinked to “MarLIN” for access to relevant metadata record/s All records geo- and time- referenced using Oracle spatial options and date fields, interface will use MapInfo tools to display and query the data Concept is for one DB at present, upgradeable to multiple databases if needed in future

SQuID Data Model (under ongoing development)

Example SQuID search result - data types and locations

sample SQuID “atomic” level data

Summary - our system overview CMR Web-based search and display of metadata (via MarLIN) Dispersed resources Taxonomic database Web-based search and display of Australia-wide metadata (via ASDD gateway) Other Organisations’ metadatabases MarLIN- ASDD connection

future options & plans... Build “live” links to data in our data warehouse from MarLIN metadata records Possibly link multiple DBs / agencies’ data under a single search/display application Link “MarLIN” to international metadata clearinghouses e.g. FGDC (USA) Possibly link our agency’s data into a global OBIS Adopt emerging global standards for taxonomic IDs, keyword thesauri, etc. Additional population of metadata, data, and taxon definitions into our systems, as source material and resources are available

CSIRO Marine Research Data Centre linked databases - CAAB, MarLIN and Divisional Data Warehouse Data Centre website: MarLIN: CAAB: