Near Real-Time Ocean Observations Online Data Management within the Southeast Atlantic Coastal Ocean Observation System (SEACOOS) Charlton Purvis, University.

Slides:



Advertisements
Similar presentations
EURO4M Project Kick-Off, April 2010 OGC Web Services Data visualization using OGC web services Maarten Plieger Wim Som de Cerff Royal Netherlands Meteorological.
Advertisements

NERACOOS: Unlocking the power of data Riley Young Morse | Gulf of Maine Research Institute.
Xenia Package ain/XeniaPackage ain/XeniaPackage.
Client 1 Client n Provide model output as WMS images Encode into your product ADCIRC Model outputs (surge, wind, depth, wave peak etc.) Google Maps Build.
McIDAS-V McIDAS-V The 5 th Generation of McIDAS by Tom Whittaker Space Science and Engineering Center University of Wisconsin-Madison USA with contributions.
Near Real-Time Ocean Observations Online Data Management within the Southeast Atlantic Coastal Ocean Observation System (SEACOOS) Charlton Purvis, University.
Near Real Time Ocean Observations Online the Escape of SEACOOS (Southeastern Atlantic Coastal Ocean Observing System) Data Management and Visualization.
Integration through Data Management The “SEACOOS experience” Accomplishments and Obstacles SEACOOS approach to data integration Accomplishments and contributions.
Dynamic Quick View, interoperability and the future Jon Blower, Keith Haines, Chunlei Liu, Alastair Gemmell Environmental Systems Science Centre University.
1 Southeast Atlantic Coastal Ocean Observing Regional Association (SECOORA) Gulf of Mexico Coastal Ocean Observing System (GCOOS) and Regional Association.
Carolinas Coast: A One-Stop Shop for Marine Observations in the Carolinas Funded by the National Oceanic And Atmospheric Administration A partnership among:
SEA-COOS The Southeast Atlantic Coastal Ocean Observing System National IOOS Regional observing systems.
SEACOOS Spring Workshop, May 2004 Information Management Workgroup Yr 3 Priorities: 1. Continue to develop integrated, map-based products based on (a)
Where We’ve Been. Past Contributions to CIMT Moored PO and met data QC (M0, M1, and M2); and visualization via ICON web site Conceived and implemented,
SEA-COOS The Southeast Atlantic Coastal Ocean Observing System National IOOS Regional observing systems.
Near Real Time Ocean Observations Online the Detailed Escape of SEACOOS (Southeastern Atlantic Coastal Ocean Observing System) Data Management and Visualization.
Near Real-Time Ocean Data Management An Implementation of Open Source Technologies and OGC Protocols Charlton Purvis, University of South Carolina, a SEACOOS.
SEA-COOS The Southeast Atlantic Coastal Ocean Observing System A regional observing system for NC, SC, GA and FL H. Seim, E. Kearns, R. Weisberg, J. Nelson,
Progress Towards a Regional Coastal Ocean Observing System for the Southeast (SEACOOS) Harvey Seim / University of North Carolina at Chapel Hill University.
SURA Coastal Ocean Observing and Prediction (SCOOP) Program Philip Bogden CEO, GoMOOS Director, SCOOP Program at SURA Southeastern Universities Research.
Open Earth Team, Deltares Data sharing Sharing data, tools and thoughts A brief overview of possibilities recently conducted by Deltares.
1 The NOAA Weather and Climate Toolkit Steve Ansari, Stephen Del Greco (NOAA / NCDC) Mark Phillips (UNC-Asheville / NEMAC) Bill Hankins (STG Inc.)
The use of standard OGC web services in integrating distributed model, satellite and in-situ datasets Alastair Gemmell Jon Blower Keith Haines Environmental.
Tools for accessing distributed in-situ data collections Donald W. Denbo, NOAA/PMEL-JISAO Jason E. Fabritz, NOAA/PMEL-JISAO Bernard J. Kilonsky, Sea Level.
1 Progress of SEACOOS as a prototype U.S. Regional Coastal Ocean Observing System H. Seim and F. Werner / Marine Sciences / UNC-CH J. Nelson / Skidaway.
MapServer-OGR-OPeNDAP: An Integrated System for Uniform Access to Land and Oceanographic Datasets Frank Warmerdam Consultant Thomas E. Burk University.
Using PostGIS and MapServer in the Census Interaction Data Service Presentation to AGI Technical SIG 'Open-Source in GIS' British Antarctic Survey, Cambridge,
Transitioning SEACOOS Extension and Education Web Site to SECOORA.
STOQS: The Spatial Temporal Oceanographic Query System Mike McCann Abstract Monterey Bay Aquarium Research Institute Architecture Postgres.
IOOS Data Management Integration Standards Plans in the Northeast Eric Bridger (GMRI) Sep
Integration/Dissemination of MERHAB Autonomous Research Vessel In-situ sampler (MARVIN) data.
Water mass tracking from the region of Hurricane Katrina by R.H. Weisberg, A. Alvera-Azcarate and the entire CMS-USF Ocean Circulation Group College of.
Discovery and Web Services in Support of SST Datasets at the PO.DAAC Edward Armstrong, Jorge Vazquez Toshio M. Chin, Charles Thompson Jet Propulsion Laboratory/California.
NcBrowse A Graphical netCDF/OPeNDAP Browser Donald Denbo 1 & John Osborne 2 1 UW/JISAO-NOAA/PMEL, 2 OceanAtlas Software
AMS 2003: IIPS, GIS APPLICATIONS 6.4 Iowa Environmental Mesonethttp://mesonet.agron.iastate.edu Using GIS for Environmental Data in Iowa Dr Dennis Todey.
1 NOAA IOOS Program Data Integration Framework (DIF) Project Overview Adapted from a brief to the NOAA Data Management Committee August 6, 2008 by Jeff.
Carolinas Coast: A One-Stop Shop for Marine Observations in the Carolinas Funded by the National Oceanic And Atmospheric Administration Southeast Atlantic.
Building a Web-based GIS Portal For the Great Lakes Observing System (GLOS) Pete Giencke Program Specialist Data and Information Management.
National Weather Service(NWS) Marine Weather Portal(MWP) Marine Weather Portal(MWP)
1 GOES-R Air Quality Proving Ground Leads: UAH UMBC NESDIS/STAR.
Data Management within SEACOOS Southeastern Atlantic Coastal Ocean Observing System Near Real Time Ocean Observations Online Near Real Time Ocean Observations.
Using Open Source GIS Technology overview Presented by Aaron Racicot – GIS Programmer January 25, 2006 A Citizen of Salmon Nation.
ORNL DAAC MODIS Subsetting and Visualization tools Tools and services to access subsets of MODIS data Suresh K. Santhana Vannan National Aeronautics and.
A GeoSpatial Mapping Architecture
Direct Broadcast at the Institute for Marine Remote Sensing The Institute for Marine Remote Sensing (IMaRS), located at the University of South Florida.
IODE Ocean Data Portal - ODP  The objective of the IODE Ocean Data Portal (ODP) is to facilitate and promote the exchange and dissemination of marine.
22 Oct 2003: IGIC Quarterly IEM Access & Free GIS Daryl Herzmann Department of Agronomy Iowa State University.
SECOORA Geo Tools Presentation Dan Ramage, University of South Carolina
Tools for Monitoring in Coastal Alaska and the Arctic Darcy Dugan Alaska Ocean Observing System.
U.S. INTEGRATED OCEAN OBSERVING SYSTEM DATA ACCESS SERVICES Coastal Geotools: Advances in Federal Data Access Services Hassan Moustahfid, Chris Duncombe.
20 April 2005: Iowa-NASA Data Integration Workshop Using Open GIS web services to serve environmental data Daryl Herzmann Raymond Arritt Iowa Environmental.
IOOS Sea Surface Temperatures: Realizing Truly Distributed Data with Open Standards Presenter Kyle Draganov.
15 Jan 2004: AMS IIPS GIS Serving NEXRAD imagery with Open-Source GIS Daryl Herzmann Dr Raymond Arritt Iowa Environmental.
Southeast Atlantic Coastal Ocean Observing System Program Evaluation Jan 17-19, 2005 Information Management Workgroup 1 Information Management How SEACOOS.
NOAA IOOS SOS Implementations in 2008 Jeff de La Beaujardière, PhD NOAA IOOS Program DIF Sr Systems Architect.
NcBrowse: A Graphical netCDF File Browser Donald Denbo NOAA-PMEL/UW-JISAO
OceanWatch Central Pacific Satellite Oceanography Products & Applications PIFSC Melanie Abecassis, PhD Ecosystems and Oceanography Program Ecosystems Sciences.
NcBrowse: OPeNDAP Server Access and 3-D Graphics Presented by Nancy N. Soreide NOAA/PMEL Donald W. Denbo UW/JISAO-NOAA/PMEL.
CYBER-GIS FOR SCIENTIFIC DISCOVERIES. Global Forest Change Hansen, M. C. et al (2013). High-Resolution Global Maps of 21st-Century Forest Cover Change.
Serving Iowa Mesonet data with U of Minnesota’s MapServer Daryl Herzmann Iowa Environmental Mesonet 31 Jul 2002.
Center for Satellite Applications and Research (STAR) Review 09 – 11 March 2010 Image: MODIS Land Group, NASA GSFC March 2000 STAR Enterprise Synthesis.
Transitioning SEACOOS Extension and Education Web Site to SECOORA
Carolinas Coast: A One-Stop Shop for Marine Observations in the Carolinas Supported by NOAA, SECOORA, SEACOOS NC SeaGrant & SC SeaGrant A partnership among:
Intermountain West Data Warehouse - Western Air Quality Study
Data Browsing/Mining/Metadata
Zhong Liu George Mason University and NASA GES DISC
Caro-COOPS Data Online
HYCOM CONSORTIUM Data and Product Servers
Recovery Observatory WGISS-39 Meeting Tsukuba Japan May 12, 2015
Marine Managed Area Mapping
Presentation transcript:

Near Real-Time Ocean Observations Online Data Management within the Southeast Atlantic Coastal Ocean Observation System (SEACOOS) Charlton Purvis, University of South Carolina, a SEACOOS partner

SEACOOS was initiated in 2002 with ONR funding to develop a coastal ocean information system for FL, GA, SC and NC. SEACOOS Over-Arching Goal: To significantly increase the quantity and quality of environmental information from the coastal ocean of the SE U.S. and facilitate its use in a wide range of societal, scientific, and educational applications.

Observational platforms contributed by SEACOOS partners Observational platforms contributed by SEACOOS partners

SEACOOS modeling Coordinating model simulations for the entire region

The (tiny) data management big picture

Laundry list of core technologies Base environment Base environment Linux Linux Apache Apache Perl & PHP Perl & PHP Mapping & imaging Mapping & imaging University of Minnesota’s MapServer University of Minnesota’s MapServer ImageMagick ImageMagick AniS & Gifsicle AniS & Gifsicle Gnuplot Gnuplot Data storage PostgreSQL PostGIS Filesystem

Data aggregation & storage Aggregation format flavors Aggregation format flavors netCDF (in situ and remotely-sensed data) SEACOOS CDL netCDF (in situ and remotely-sensed data) SEACOOS CDLCDL PNG (RS imagery) PNG (RS imagery) Storage Storage Relational database (in situ, model output, some RS) Relational database (in situ, model output, some RS) Files (RS imagery) Files (RS imagery) Technology Technology Perl Perl PostgreSQL & PostGIS PostgreSQL & PostGIS

Normalization Reporting time varies Reporting time varies In-situ data In-situ data E.g. daily, hourly, half- hourly, every 10 minutes E.g. daily, hourly, half- hourly, every 10 minutes Remotely-sensed data Remotely-sensed data E.g. twice daily E.g. twice daily Technology Technology PostgreSQL & PostGIS PostgreSQL & PostGIS

Visualization : interactive mapping Production site Production site Production site Production site Development site Development site Development site Development site Technology Technology MapServer MapServer ImageMagick ImageMagick Perl & PHP Perl & PHP

In-situ sea surface temperature and winds Mouse overs Observation time series Point queries

Radar surface currents & modeled depth-avg. currents Ad-hoc animations

Remotely sensed QuikSCAT & in-situ winds

Remotely sensed Chl-A & true color composite

In-situ sea surface temperature (again) Sparse perhaps?

In-situ & modeled OI sea surface temperature Models fill the gaps

In-situ & modeled OI sea surface temperature Ever-growing domains

Visualization : graphs & animations Ad-hoc time-series graphs Ad-hoc time-series graphs Ad-hoc animations Ad-hoc animations Ad-hoc animations Ad-hoc animations Technology : MapServer | ImageMagick Gnuplot | Gifsicle |AniS Technology : MapServer | ImageMagick Gnuplot | Gifsicle |AniS

Dissemination (it is the technology) OPeNDAP (DODS) data access OPeNDAP (DODS) data access OGC-friendly: WMS, WFS OGC-friendly: WMS, WFS pick a layer, any layer pick a layer, any layer pick a layer, any layer pick a layer, any layer

Dissemination : example 1 Integrated Ocean Observing System hurricane demo Integrated Ocean Observing System hurricane demo Integrated Ocean Observing System hurricane demo Integrated Ocean Observing System hurricane demo SEACOOS Remotely-Sensed Layers WMS-Enabled for Hurricane Charley (see OpenIOOS web site -- * modis_ergb_low (USF) * modis_rgb_low (USF) * modis_rgb_hi_chesapeake_bay (USF) * modis_rgb_hi_florida_bay (USF) * modis_rgb_hi_miss_plume (USF) * modis_rgb_hi_suwannee_river (USF) * modis_rgb_hi_tampa_bay (USF) * oi_sst (USF) * modis_sst (USF) * avhrr_sst (USF) * modis_chl (USF) * quikscat_wind (JPL) * met_wind (UNC) * met_air_pressure_contour (UNC) * tamu_level_III (TAMU Mesonet)

Dissemination : example 2 NC OneMap Viewer website/NC_OneMap/ viewer.asp NC OneMap Viewer website/NC_OneMap/ viewer.asp NC OneMap Viewer NC OneMap Viewer

Open source : obstacles & sustenance Obstacles Obstacles Documentation & packaging Documentation & packaging Stereotypes in a proprietary world Stereotypes in a proprietary world Sustenance Sustenance Communication Communication Listservs and twikis and bulletin boards Listservs and twikis and bulletin boards Listservsbulletin boards Listservsbulletin boards Information sharing protocol standards Information sharing protocol standards OGC OGC

OGC sustenance? Prove it! Log layer usage Log layer usage Log layer usage Log layer usage Example layer : MODIS RGB composite Example layer : MODIS RGB composite Available via SEACOOS interactive maps and WMS Available via SEACOOS interactive maps and WMS

Layer usage logging MODIS RGB composite total hits = 652 MODIS RGB composite total hits = 652 Interactive map hits = 105 Interactive map hits = 105 WMS hits = 547 WMS hits = 547

An open source attitude SEACOOS data management SEACOOS data management Direct result of combined effort from academia, government, and the private sector Direct result of combined effort from academia, government, and the private sector Providing a foundation for other ocean observing systems to possibly adapt and build upon Providing a foundation for other ocean observing systems to possibly adapt and build upon Plenty of miles to go with more room to grow! Plenty of miles to go with more room to grow! Who am I? Who am I? Charlton Purvis, University of South Carolina, SEACOOS Charlton Purvis, University of South Carolina, SEACOOS Happy to help and share. Happy to help and share.