‘Big Data’ Unites Oceanographers And Animal Trackers On A Global Scale Grahamstown, South Africa, July 14-19, 2013 H. Moustahfid 1 *, R. M. Branton 2,

Slides:



Advertisements
Similar presentations
WGISS Liaison Position: Climate and Meteorology David Clark (for Howard Diamond) WGISS – 18 Beijing, China September 6, 2004.
Advertisements

: An Acoustic Tracking Array for Studying Ocean Survival and Movements of Columbia River Salmon (POST) David Welch.
Visualizing Fitness for Purpose Bob Groman and Dicky Allison Biological and Chemical Oceanography Data Management Office Woods Hole Oceanographic Institution.
Graphic courtesy NOAA / PMEL / Center for Tsunami Research Pacific Northwest Waters Gateway to Our Future Delivering Observations in the Northwest Region.
U.S. IOOS ® National Glider Network Zdenka Willis Director, US IOOS Program Office Presented to the GROOM General Assembly – 5 June
West Coast IOOS Partner Updates SCCOOS Darren Wright (DMAC), Jen McWhorter (Government Relations) CeNCOOS Jennifer Patterson (DMAC), Shane StClair (DMAC)
A database-driven tool to create items, variables and questionnaires NEPS Metadata Editor.
SEA-COOS The Southeast Atlantic Coastal Ocean Observing System National IOOS Regional observing systems.
Sustainability of Ocean Observing Systems – An Interdisciplinary Data Management Case Study Robert M. Branton 1, Tsafrir Gazit 1, Andrew Sherin 2 1 Dalhousie.
Our Planet is Changing U.S. Integrated Ocean Observing System (IOOS) We need advanced tools to understand and monitor our oceans, coasts and Great Lakes.
Esri UC2013. Technical Workshop. Technical Workshop 2013 Esri International User Conference July 8–12, 2013 | San Diego, California Configuring ArcGIS.
CRL Global Resources Network News Preservation & Access July 13, 2011 James Simon Director, Global Resources Network.
Ocean Tracking Network Bob Branton, Lenore Bajona, Susan Dufault, Brian Jones, Marta Mihoff Dalhousie University, Halifax Canada Global.OceanTrack.org.
Esri UC2013. Technical Workshop. Technical Workshop 2013 Esri International User Conference July 8–12, 2013 | San Diego, California ArcGIS for Local Government.
ISO-2 and more NGDC Geoportal January 4 th, 2012.
IOOS DMAC 2015 Jon “OTN is a biological observing system of the UN’s Global Ocean Observing System.” Following on from the Census.
Metadata Guides for Smarties Marine Metadata Initiative URL:
Research Data at NCAR 1 August, 2002 Steven Worley Scientific Computing Division Data Support Section.
The Marine Metadata Interoperability Project A Model for Community Collaboration September 23, 2010 Nan Galbraith WHOI.
The Multipurpose Marine Cadastre A Tool for Planning & Decision Making in the Marine Environment Christine Taylor Minerals Management Service (MMS) David.
IOOS Data Management Integration Standards Plans in the Northeast Eric Bridger (GMRI) Sep
Planning for Arctic GIS and Geographic Information Infrastructure Sponsored by the Arctic Research Support and Logistics Program 30 October 2003 Seattle,
EPE Release 2 IOC Review August 7, 2012 Ocean Observatories Initiative OOI EPE Release 2 Initial Operating Capability Review System Development Overview.
Esri UC2013. Technical Workshop. Technical Workshop 2013 Esri International User Conference July 8–12, 2013 | San Diego, California Migrating your Data.
Basic Satellite Data Products Dave Foley CoastWatch Coordinator Joint Institute for Marine and Atmospheric Research University of Hawaii And NOAA Southwest.
Ankle bracelets for fish.. knowing who is coming and going… Developing an acoustic fish “gate” for the Chester River. Hassan Moustahfid, PhD. U.S. IOOS.
Animal Telemetry Photo: PNNL. Building a Marine Life Observing System: Tracking Animals Should be A Part of IOOS TAGGING OF PACIFIC PELAGICS Leveraging.
U.S. Integrated Ocean Observing System (IOOS ® ) IOOS ® Biological Observations Data Project A Multi-Agency Effort to Enable Access to Biological Observations.
UAF/OSMC Presenters: Kevin O’Brien and Eugene Burger Abstract: Kevin O’Brien and Eugene Burger are from NOAA’s Pacific Marine Environmental Laboratory.
Creating Good Documentation NOAA National Geophysical Data Center
U.S. GLOBEC Georges Bank 2007 Phase 4B SI Meeting April 23, 2007 GoMODP, Data Interoperability and the MapServer Interface to U.S. GLOBEC Data Presented.
West Coast IOOS Partner Updates SCCOOS Darren Wright (DMAC), Jen McWorter (Institutional Liaisons) CeNCOOS Jennifer Patterson (DMAC), Shane StClair (DMAC)
The Integrated Ocean Observing System (IOOS) is envisioned as a coordinated national and international network of observations, data management and analyses.
Environmental Research Division Southwest Fisheries Science Center Combinations of Technologies for Serving Data to Scientists for Serving Data to Scientistsalso.
MARACOOS Stakeholder Input Session MARACOOS as the Backbone of Ocean Observing in the MidAtlantic: recent developments around support of marine fisheries.
IOOS Regional Data Management Workshop April 27 & 28, 2011 Silver Spring, MD COLLABORATION TO DATE Charles Alexander 1, Jeff de La Beaujardière 1, Arthur.
OOI-CYBERINFRASTRUCTURE OOI Cyberinfrastructure Education and Public Awareness Plan Cyberinfrastructure Design Workshop October 17-19, 2007 University.
The Giovanni-NEO Oceanographic Education Cookbook Instructional James G. Acker David Herring Gregory Leptoukh Suhung Shen Steven Kempler NASA Goddard Earth.
Marine Metadata Interoperability Acknowledgements Ongoing funding for this project is provided by the National Science Foundation.
Esri UC2013. Technical Workshop. Technical Workshop 2013 Esri International User Conference July 8–12, 2013 | San Diego, California ArcGIS for Law Enforcement:
Fire Emissions Network Sept. 4, 2002 A white paper for the development of a NSF Digital Government Program proposal Stefan Falke Washington University.
DOC / NOAA / NMFS / SWFSC / ERD
Hood Canal Steelhead Acoustic Telemetry Studies Barry Berejikian and Skip Tezak NOAA Fisheries Northwest Fisheries Science Center Manchester Research Station.
Improving Access to Biological Observations data Dr. Hassan Moustahfid NOAA US IOOS Program Office Silver Spring, MD NMFS FMAC F2F Brief
Access to IOOS Data Relevant to OOI Kathleen Bailey NOAA/NOS/IOOS January 6, 2016.
Maracoos DMAC and Asset Map June Maracoos DMAC Principles Data is served and integrated using open, interoperable data standards recommended by.
Future needs and plans for ocean observing in the Arctic AOOS Arctic Town Hall Futur Zdenka Willis Integrated Ocean Observing System National Program Office.
1 2.5 DISTRIBUTED DATA INTEGRATION WTF-CEOP (WGISS Test Facility for CEOP) May 2007 Yonsook Enloe (NASA/SGT) Chris Lynnes (NASA)
NOAA EDMC Ocean Observatories Initiative Cyberinfrastructure Karen Stocks OOI CI Data Curator University of California, San Diego Ocean Observatories.
1 OTN HALIFAX LINE Robert Branton Dalhousie University, Halifax Canada 20 th Annual Fisherman and Scientists.
U.S. Integrated Ocean Observing System (IOOS ® ) National Glider Data Assembly Center.
Data Centre Overview OTN Data Portal: March 2015: OTN accepted.
Components of the OTN Data Centre Document-oriented web-based data repository Data and metadata in secure folders per user.
SG-OBIS-V, May 2016 Lenore Bajona, Director of Data Management OTN Data Centre OTN Data Portal:
Cooperation and Interoperability Lenore Bajona, Robert M. Branton Ocean Tracking Network
Ocean Tracking Network I have since 2008, been data management director for the Ocean Tracking Network (OTN) at Dalhousie University.
OTN Canada Symposium Data Management Workshop Robert Branton, Susan Dufault, Marta Mihoff, Lenore Bajona, Brian Jones Faculty.
Center of Excellence for Oceans and Human Health at the Hollings Marine Laboratory Metadata Development in Support of the Oceans and Human Health Tidal.
Improving Access to Animal Acoustic Telemetry Observations Project Demo Workshop Seattle Washington, Thursday June 13, 2013 Bob Branton, Lenore Bajona,
Global Earth Observation System of Systems (GEOSS) Architecture Implementation Pilot (AIP) Air Quality and Health Working Group Stefan Falke, Rudy Husar,
How to Submit Collection Metadata
Flanders Marine Institute (VLIZ)
OTN Data Warehouse Overview: Data Workflow
US IOOS®, NDBC, CO-OPS Partnership Discussion
Monitoring and Adapting to Change on the Coast
Robert Branton Dalhousie University Global.OceanTrack.org
CHALLENGES IN PROVIDING MARINE DATA IN FORMATS DESIGNED FOR LAND-BASED DATA Karen Douglas|
Ocean Biogeographic Information System (OBIS)
Environmental Research Division's Data Access Program (ERDDAP) – An example of data and metadata brokering infrastructure Tobias Spears.
Conclusion Bob Branton Director of Data Management, Ocean Tracking Network, Dalhousie University, 1355 Oxford Street, PO BOX 15000, Halifax, NS, Canada 
Presentation transcript:

‘Big Data’ Unites Oceanographers And Animal Trackers On A Global Scale Grahamstown, South Africa, July 14-19, 2013 H. Moustahfid 1 *, R. M. Branton 2, J. Payne 3, E. Mayorga 4, B. Simons 5, L. Bajona 2, M. Mihoff 2, K. Morton 2 1 US Integrated Ocean Observing System (US IOOS), 2 Ocean Tacking Network (OTN), 3 University of Washington, 4 Northwest Association of Networked Ocean Observing Systems (NANOOS), 5 Southwest Fisheries Science Center( SWFSC) 2 nd International Conference on Fish Telemetry ;

The Integrated Ocean Observing System (IOOS) and the Ocean Tracking Network (OTN) both collect, manage and use highly complex information assets, that is ‘Big data’ on a global scale … Background

Objectives Animal acoustic telemetry data and associated products implemented using a content standard so they can be shared between projects nationally and internationally. Based on input from POST, OTN, GLATOS, Hydra, and AATAMS, with feedback from individual researchers and operators including TOPP and Kintama Research. Using and combining existing technical IOOS and OTN technical infrastructures.

North East Pacific Ocean Here we describe efforts currently focused on the North East Pacific Ocean whereby data scientists from these two communities are currently attempting to develop and demonstrate data services that could eventually enable animal acoustic telemetry detections to be routinely integrated with environmental data observations and models. Use Emilio’s map here? Data Contributors: Receiver Deployments Tag Releases Data Contributors: Receiver Deployments: JDF, QCS – Scott Hinch (OTN), WILL – David Welch (KTM) Tag Releases: PSS2 – Scott Hinch (UBC), Steve Cooke (UW); LIND – Steve Lindley (NOAA- SWFSC); MOSER – Mary Moser (NOAA-NWFSC); VOGL – Dave Vogel (NRS)

Outline Parallel ERDDAP and GeoServer Web Services Metadata convention for animal acoustic telemetry data exchange Sample data extracted from the OTN data warehouse using the proposed convention Example visualizations of the sample data using the NOAA - Environmental Research Division's Data Access Program (ERDDAP) Linking this data service to ocean models and applications.

Parallel ERDDAP and GeoServer Web Services

Metadata convention for animal acoustic telemetry data exchange 1.datacenter_attributes 2.project_attributes 3.manmade_platforms 4.receivers 5.recover_offloads 6.tag_releases 7.animals 8.detections 9.tracks

Sample data extracted from the OTN data warehouse using the proposed convention

ERDDAP – list of data sets Use Bob Simon’s graphics on next 3 slides ?

ERDDAP > tabledap > SubsetMake A Graph

ERDDAP > tabledap > data get the data you want, in the format you want, including: csv, netCDF, kml web accessible (WAF) ISO and FDGC.xml metadata files

R Studio - # of tags by year and station

python - len/wgt density of tagged fish

ESRI Data Connector Uses Kelly’s graphs here ….

Closing Remarks Backwards …. Defining the specifications was hardest part. Creating and refining a specific data feed (i.e. OTN) was relatively easy. The demonstration services have been implemented and appear useful. Forwards … Develop work plan for further OTN and IOOS collaboration to fully operationalize the system. Expand user base … – Provide OTN data to AATAMS, Hydra, ACT and TOPP – AATAMS, Hydra, ACT and TOPP provide data to OTN Start blog for R & python development

Receiver Deployments … JDF - Hinch, S., Ocean Tracking Network Strait of Juan de Fuca Line Metadata and Data Set (POST: Welch, D., 2004). QCS - Hinch, S., Ocean Tracking Network Queen Charlotte Strait Line Metadata and Data Set (POST: Welch, D., 2004) WILL - Welch, D., 2006 In: Bolger, James, J. Payne Pacific Ocean Shelf Tracking (POST) Program. Tag Releases … HINCH – Hinch, Scott 2006 In: Bolger, James, J. Payne Pacific Ocean Shelf Tracking (POST) Program. LIND - Lindley, Steve In: Bolger, James, J. Payne Pacific Ocean Shelf Tracking (POST) Program. MOSER - Moser, Mary In: Bolger, James, J. Payne Pacific Ocean Shelf Tracking (POST) Program. VOGEL - Vogel, Dave In: Bolger, James, J. Payne Pacific Ocean Shelf Tracking (POST) Program. In Ocean Region NEP - Barnes, C., Grimes, C Ocean Tracking Network Northeast Pacific Metadata and Data Series. In Global Atlas Global - Ocean Tracking Network Global Metadata and Data Atlas Data Citations

The End