TagBase and FishTracker – informatics tools for tag data management, analysis and visualization Second International Symposium on Tagging and Tracking.

Slides:



Advertisements
Similar presentations
Remote Visualisation System (RVS) By: Anil Chandra.
Advertisements

Applications and Limitations of Positioning with Light Chi Hin Lam (Tim) 林子軒 Benjamin Galuardi Integrating movement information from tagging data into.
Test Case Management and Results Tracking System October 2008 D E L I V E R I N G Q U A L I T Y (Short Version)
System Science Applications, Inc. EASy: An Environmental System for Mapping and Modeling Aquatic Systems.
Tracking of Marine Vertebrates: Overview & Fishtracker Algorithm by Dale Kiefer 1 F. J. O’Brien 1 M. Domeier 2 1 System Science Applications Pacific Palisades,
The Gulf of Maine Biogeographical Information System (GMBIS) Project COD Conference Brussels, 25-27/11/2002 Vardis M. Tsontos Dale A. Kiefer University.
D A Kiefer, D P Harrison, M G Hinton, S Kohin, E M Armstrong, S Snyder, F J O’Brien Pelagic Habitat Analysis Module (PHAM) for GIS Based Fisheries Decision.
D A Kiefer, D P Harrison, M G Hinton, S Kohin, E M Armstrong, F J O’Brien “NASA Biodiversity & Ecological Forecastin Team Meeting ” April 2012 in.
Why you need McIDAS-V Steve Ackerman Tom Achtor. Introduction What is McIDAS-V? Why I want it? Why you will want it!
Caro-COOPS Data Management: Metadata. Cast-Net addresses the need for improved connectivity among coastal observing systems by creating a regional framework.
A pilot application 12/9/2008Microsoft eScience Workshop 2008 Robert Bukowski and Jarek Pillardy Computational Biology Service Unit Cornell University.
Development of a Community Hydrologic Information System Jeffery S. Horsburgh Utah State University David G. Tarboton Utah State University.
Integrating Historical and Realtime Monitoring Data into an Internet Based Watershed Information System for the Bear River Basin Jeff Horsburgh David Stevens,
2008/7/3 NanoMon: An Adaptable Sensor Network Monitoring Software Misun Yu, Haeyong Kim, and Pyeongsoo Mah Embedded S/W Research Division Electronics and.
Center for Environmental Studies Arizona State University Digital Research Records at Center for Environmental Studies Peter McCartney.
Version 4 for Windows NEX T. Welcome to SphinxSurvey Version 4,4, the integrated solution for all your survey needs... Question list Questionnaire Design.
November 2011 At A Glance GREAT is a flexible & highly portable set of mission operations analysis tools that increases the operational value of ground.
Data Management Needs and Challenges for Telemetry Scientists Josh M London Wildlife Biologist, Polar Ecosystems Program National Marine Mammal Laboratory.
Habitat Analysis in ArcGIS Use of Spatial Analysis to characterize used resources Thomas Bonnot
Synthesis of Incomplete and Qualified Data using the GCE Data Toolbox Wade Sheldon Georgia Coastal Ecosystems LTER University of Georgia.
1 CADE Finance and HR Reports Administrative Staff Leadership Conference Presenter: Mary Jo Kuffner, Assistant Director Administration.
AIRNow-International The future of the United States real-time air quality reporting and forecasting program and GEOSS participation John E. White U.S.
Tagbase Quick Guide to Import Excel template (TagBaseBatchJob.xls) This is a very streamlined file that only contains the most necessary tag information.
Information Systems Chapter 5 Building the database Part 1. Unsing Access.
Oceanographic Patterns in ECCO & Satellite Imagery with Applications to Fisheries Li Luo and Dale Kiefer 11/01/2012.
Updates from EOSDIS -- as they relate to LANCE Kevin Murphy LANCE UWG, 23rd September
Unidata TDS Workshop TDS Overview – Part I XX-XX October 2014.
material assembled from the web pages at
Validation and TestEm series Michel Maire for the Standard EM group LAPP (Annecy) July 2006.
Views The architecture was specifically changed to accommodate multiple views. The used of the QStackedWidget makes it easy to switch between the different.
GCE Data Toolbox -- metadata-based tools for automated data processing and analysis Wade Sheldon University of Georgia GCE-LTER.
For the CoML Modeling and Visualization Workshop Jason Roberts and Ben Best 3-Feb-2009, Long Beach, CA.
Fisheries Oceanography Collaboration Software Donald Denbo NOAA/PMEL-UW/JISAO Presented by Nancy Soreide NOAA/PMEL AMS 2002/IIPS 10.3.
Touchstone Automation’s DART ™ (Data Analysis and Reporting Tool)
Where to find LiDAR: Online Data Resources.
_______________________________________________________________CMAQ Libraries and Utilities ___________________________________________________Community.
Ecoinformatics Workshop Summary SEEK, LTER Network Main Office University of New Mexico Aluquerque, NM.
Sara E. Richardson Calit2 Summer Undergraduate Research Scholarship Program Advisor: Jurgen Schulze Ivl.calit2.net/wiki CAMERA is.
NQuery: A Network-enabled Data-based Query Tool for Multi-disciplinary Earth-science Datasets John R. Osborne.
Recent Experience using PDAs as Field Data Recorders Peter Gould and Connie Harrington Pacific Northwest Research Station.
BOĞAZİÇİ UNIVERSITY DEPARTMENT OF MANAGEMENT INFORMATION SYSTEMS MATLAB AS A DATA MINING ENVIRONMENT.
Cyberinfrastructure to promote Model - Data Integration Robert Cook, Yaxing Wei, and Suresh S. Vannan Oak Ridge National Laboratory Presented at the Model-Data.
Mercury – A Service Oriented Web-based system for finding and retrieving Biogeochemical, Ecological and other land- based data National Aeronautics and.
Marine Geospatial Ecology Tools
Distributed Data Analysis & Dissemination System (D-DADS ) Special Interest Group on Data Integration June 2000.
1 The EDIT System, Overview European Commission – Eurostat.
1 THETIS:A DATA MANAGEMENT AND DATA VISUALIZATION SYSTEM FOR SUPPORTING COASTAL ZONE MANAGEMENT OF THE MEDITERRANEAN SEA (F0069: Telematics on Research)
ADPS Science Software Development Bryan Franz NASA Ocean Biology Processing Group Aquarius Data Processing Workshop, NASA/GSFC, March 2007.
CoRD Meeting 12 March 2003 STIPES (Lot 4) STIPES = Statistical Inquiries from Popular European Software.
March 2004 At A Glance ITPS is a flexible and complete trending and plotting solution which provides user access to an entire mission full-resolution spacecraft.
VIEWS b.ppt-1 Managing Intelligent Decision Support Networks in Biosurveillance PHIN 2008, Session G1, August 27, 2008 Mohammad Hashemian, MS, Zaruhi.
MAKING BUSINESS INTELLIGENT Brought to you by your local PASS Community! Self Service ETL with Power Query Welcome.
D A Kiefer, E M Armstrong, D P Harrison, M G Hinton, S Kohin, S Snyder, F J O’Brien Overview of fisheries habitat prediction using the Pelagic Habitat.
Acoustic Telemetry Tagging Hillary Sinnott SCM 330 March 12, 2008 Hillary Sinnott SCM 330 March 12, 2008.
Proposal of Satellite Data Center India Meteorological Department A.K.Sharma (Chairman), Virendera Singh (Member), R.K.Giri (Member) and N.Puviarasan (Member.
UNIVERSITY OF UTAH GREEN INFRASTRUCTURE MONITORING DATABASE CVEEN 7970 Hydroinformatics Semester Project Zachary Magdol, Jai Kanth Panthail, Pratibha Sapkota,
NcBrowse: OPeNDAP Server Access and 3-D Graphics Presented by Nancy N. Soreide NOAA/PMEL Donald W. Denbo UW/JISAO-NOAA/PMEL.
Sea Surface Temperature Distribution from the Physical Oceanography DAAC Ed Armstrong JPL PO.DAAC MODIS Science Team Meeting.
Data Browsing/Mining/Metadata
Data Virtualization Tutorial: Introduction to SQL Script
MERRA Data Access and Services
Integration of the UC Davis Biological Collections Data via a Web Portal [A Pilot Project] Project Goals To develop a Web Portal allowing better & more.
Flanders Marine Institute (VLIZ)
Tutorial 8 Objectives Continue presenting methods to import data into Access, export data from Access, link applications with data stored in Access, and.
What’s New in Colectica 5.3 Part 1
Chapter 12: Automated data collection methods
Data Discovery Tools and Services Part B
JMP 11 added new features and improvements to CCB and MSA.
Palestinian Central Bureau of Statistics
Presentation transcript:

TagBase and FishTracker – informatics tools for tag data management, analysis and visualization Second International Symposium on Tagging and Tracking Marine Fish with Electronic Devices October 8, 2007 Chi Lam (Tim), Vardis Tsontos and Dale Kiefer University of Southern California

Statement of the problem Data storage tags (pop-up archival and archival) allow us to collect large volumes of environmental and physiological data of marine species, but these rich datasets present us with challenges in efficiently managing and visualizing our data Photo: PIER/ MCSI/ M. Domeier Photo © Andy Murch

Tag data origami As a tagging researcher, you may start out… As you before more and more successful (yeah!!) … - Different manufacturer formats - Different tag types Tag#, Date, Depth, Temp … 777, 10/8/2007, 10, 25.4 … 777, 10/9/2007, 85, … Record # Open your file Multiple tags, with lots of recovered data What a mess!

Information pathway Individual Tags Raw data files Manufacturer processed files Integrated Systems Hartog et al. (CISRO, U Canterbury next talk) Electronic Tagging Data Repository Sibert and Ancheta (PFRP) TagBase, our database (this talk) 1.Flexibility to perform your own quality control 2.Freedom to explore, manipulate, analysis data 3.Customized output formats for export to higher systems 4.Manage analysis parameters & results Protocol & specifications e.g. Ecological Metadata Language (EML) or XML (Royer and Lutcavage, this conference) Your own analysis - Model parameters - Results

TagBase as a local tag database A starter kit to manage different manufacturer output files Centralize data within a unified relational model Integrate metadata and auxiliary data Query data efficiently (subset, regroup, summarize) Visualize data rapidly (e.g. forms with MS-Graph) Integrate with other tools as a backend database and manage result outputs –e.g. Matlab, –R with ODBC package –EASy-FishTracker

Objectives of this talk 1.Show how TagBase is implemented in Microsoft Access & what you can get out of it 2.Demonstrate its integration with Easy- FishTracker, a visualization and analysis tool

Objective # 1: TagBase implementation in MS- Access How to get things in? And out?

Data assimilation into Tag Database “TagBase” Tag Database Final Tag Data Tables & Relational Model Source Tag Data Files (Manufacturer Formats) Wildlife Computers PAT Bin Depth-Freq Bin Temp-Freq PDT Estimated Locations Light data points ARGOS positions Microwave Telemetry PAT Press Data Temperature Data Estimated Locations ARGOS positions ARCHIVAL Lotek and Wildlife Computers File 1 Depth, Light, Temp File2 Estimated Locations SPOT Wildlife Computers ARGOS Lat/ Lon Reception Codes Temporary Data Import Tables Metadata Input & Tag Data Processing/Import Forms Query sequence Macros Automated Import in Batch or Individually ISSUES: Data Quality Control Complete Lat/Lon metadata (TagInfo table)

Just to give you an idea…

TagBase Relational Model * Metadata * WC * MT * Spot * Archival * EASy-FishTracker Output

What to get data in

Integrated Plot Forms Plot forms for all tag & data types XY/Time Series, Histogram, Bubble Plots Single/aggregate datasets Raw Data / Aggregate statistics

What you can get data out from TagBase Export data formatted for KFSST (or UKFSST) and TrackIt Endless possibilities with your own queries Goodies queries & code –Moving average (in days) for archival data –Day/ Night data subset for Wildlife Computers tags –Daily summary of sea surface temperature (SST)

Objective # 2: Integration with EASy-FishTracker What about analysis?

TagBase EASy-FishTracker Integration TagBase as backend data repository EASy-FishTracker as front-end visualization/ analysis tool EASy (Environmental Analysis System): –custom oceanographic GIS software in Windows OS –extensive imagery handling & data connectivity capabilities –extensible: model/module integration via COM-based API End-User EASy GIS FishTracker Module - FishTracker Geolocation Algorithm - Bulk processing - Imagery assimilation tool - Track and Tag data visualization - Kernel Home Range Analysis EASy GUI WC MT LT Arc SPOT Source Tag Data Files (Manufacturer Formats/XLS) ODBC (WC: Wildlife Computers; MT: Microwave Telemetry LT: Lotek; Arc: Archival; SPOT:ARGOS/GPS) Internet FTP & Local Satellite SST Imagery Archives - NASA PoDAAC, Coastwatch - Thermal Imagery (AVHRR or MODIS) ODBC TagBase as backend tag database - Universal tag relational model - Forms with standard plots

Geolocation improvement Just one implementation of the many good models and algorithms available in the research community Domeier et al., Fishery Bulletin 103(2): Future Goal: allow flexibility and connectivity to use other models/ algorithms (e.g. KFSST) Comparison of FishTracker track solution (red) to manufacturer light-based positional estimates (blue)

Visualization of data Exposes the full range of tag data in backend database Switching views between multiple tags Interactive Filtering of data Multiple XY-diagnostic plots Time Series, XY, Vertical False Color New plots through underlying query configuration in TagBase WC PDT false-color profile plots and Depth/Temperature frequency histograms for tag data

Analysis tool and GIS integration Home Range analysis tool –Kernel method (Worton, 1989) –fixed H /single H / adaptive H estimation (least square cross- validation) –returns smoothed Utilization Distribution surface GIS integration –supports multiple imagery formats –bathymetry Habitat utilization distribution for striped marlin based on 20 individuals tagged between off of New Zealand (n = 373, Kernel H = ) SAR imagery SEAWIFS Ocean Color

Limitations of TagBase Dependent on consistent manufacturer formats –Import code is a reactive development, rather than proactive –Nevertheless, TagBase’s relational model should hold unless major changes occur May not fit perfectly your data needs –Require some expertise in adding new tables, or setting up queries –Need high-end database management systems if you have many tags

Conclusions 1.TagBase provides a relational model to handle multiple data types from tags 2.Integrated plots and flexible queries allow efficient data mining and export for other analysis 3.We are enthusiastic about collaborating with manufacturers, Hartog et al. and tag users 4.If you want to know more/ try to use with the TagBase Look for me during the next few days, so that I can give you a quick jump-start tutorial session Or invite me for a talk at your institute and I can tell you whatever I know!

Questions? “Vacaciones!!”