Unidata and Oceanography Through the Ages Rich Signell USGS Coastal and Marine Science Center Woods Hole, MA & NOAA Integrated Ocean Observing System (IOOS)

Slides:

Advertisements

Similar presentations

CEOS WGISS-22, Annapolis, MD September, GEO Integrated Data Environment NOAA Plan for Integration GEO-IDE Atmospheric Observations Land Surface.

Advertisements

1 NASA CEOP Status & Demo CEOS WGISS-25 Sanya, China February 27, 2008 Yonsook Enloe.

The Model Output Interoperability Experiment in the Gulf of Maine: A Success Story Made Possible By CF, NcML, NetCDF-Java and THREDDS Rich Signell (USGS,

Integrating NOAA’s Unified Access Framework in GEOSS: Making Earth Observation data easier to access and use Matt Austin NOAA Technology Planning and Integration.

Dynamic Quick View, interoperability and the future Jon Blower, Keith Haines, Chunlei Liu, Alastair Gemmell Environmental Systems Science Centre University.

Collaboration Tools and Techniques for ROMS Rich Signell,USGS Woods Hole, MA.

Integrated Ocean Observing System Data Management and Communications March 2004 The US Integrated Ocean Observing System (IOOS) Plan for Data Management.

A Distributed Approach to Ocean, Atmosphere & Climate Model Data Interoperability Rich Signell USGS Woods Hole, MA COAWST Training Workshop Woods Hole,

Creating a GIS from NOAA Electronic Navigational Charts

The GEON Integrated Data Viewer (IDV) and IRIS DMC Services: CyberInfrastructure Support for Seismic Data Visualization and Interpretation Charles Meertens.

Unidata TDS Workshop THREDDS Data Server Overview October 2014.

Introduction Downloading and sifting through large volumes of data stored in differing formats can be a time-consuming and sometimes frustrating process.

A Super-Regional Modeling Testbed for Improving Forecasts of Environmental Processes for the U.S. Atlantic and Gulf of Mexico Coasts Cyberinfrastructure.

Ocean Observatories Initiative OOI Cyberinfrastructure Life Cycle Objectives Review January 8-9, 2013 Analysis and Synthesis (AS): Modeling 1 Designer:

© University of Reading 2008www.reading.ac.uk Reading e-Science Centre September 10, 2015 Integrating a Web Map Service into the THREDDS Data Server Jon.

Quick Unidata Overview NetCDF Workshop 25 October 2012 Russ Rew.

Coast Survey Development Laboratory National Ocean Service, NOAA Mary Erickson March 2011.

A Super-Regional Modeling Testbed for Improving Forecasts of Environmental Processes for the U.S. Atlantic and Gulf of Mexico Coasts Don Wright, SURA Principal.

Gridded Data Interoperability for the Integrated Ocean Observing System Rich Signell USGS Woods Hole/NOAA Silver Spring USA USGS CDI Web Meeting: Oct 22,

Implementation of Model Data Interoperability for IOOS: Successes and Lessons Learned Rich Signell USGS Woods Hole, MA / NOAA Silver Spring USA Model Data.

Bringing it All Together: NODC’s Geoportal Server as an Integration Tool for Interoperable Data Services Kenneth S. Casey, Ph.D. YuanJie Li NOAA National.

Unidata’s TDS Workshop TDS Overview – Part II October 2012.

1 The IODE Ocean Data Portal - current status and future Nikolai Mikhailov, Chair of IODE/JCOMM ETDMP National Oceanographic Data Centre, Russia Four Session.

Testing the US Integrated Ocean Observing System Data Discovery and Distribution Infrastructure with Real-World Problems Derrick Snowden 1, Rich Signell.

2 3 ROMS/COAWST NcML file 4 5 Exploiting IOOS: A Distributed, Standards-Based Framework and Software Stack for Searching, Accessing, Analyzing and.

Unidata TDS Workshop TDS Overview – Part I XX-XX October 2014.

U.S. Geological Survey Woods Hole Field Center Background, Data & Visualization Background, Data & Visualization Matthew Arsenault USGS Woods Hole Science.

U.S. Department of the Interior U.S. Geological Survey Management of Oceanographic time-series data at the Woods Hole Coastal and Marine Science Center.

Product Overview Copyright © 2005 Towson University Center for Geographic Information Sciences Center for Geographic Information Sciences © Matt Felton.

Gulf of Maine / Scituate Harbor - Extratropical Domain Shelf Hypoxia ChesROMS Long & Hood UMCES Estuarine Hypoxia Inundation Cyber Infrastructure IOOS.

Super-Regional Modeling Testbed to Improve Forecasts of Environmental Processes for the U.S. Atlantic and Gulf of Mexico Coasts Super-Regional Modeling.

Scientific Investigations; Support from Research Data Archives for Joint Office for Science Support 26 February, 2002 Steven Worley SCD/DSS.

A Super-Regional Modeling Testbed for Improving Forecasts of Environmental Processes for the U.S. Atlantic and Gulf of Mexico Coasts Don Wright, SURA Principal.

Super-Regional Modeling Testbed to Improve Forecasts of Environmental Processes for the U.S. Atlantic and Gulf of Mexico Coasts Wright, L.D.; Signell,

Enhancements to a Community Toolset for Ocean Model Data Interoperability: Unstructured grids, NCTOOLBOX, and Distributed Search Rich Signell (USGS), Woods.

Accomplishments and Remaining Challenges: THREDDS Data Server and Common Data Model Ethan Davis Unidata Policy Committee Meeting May 2011.

Discovery and Web Services in Support of SST Datasets at the PO.DAAC Edward Armstrong, Jorge Vazquez Toshio M. Chin, Charles Thompson Jet Propulsion Laboratory/California.

DMAC: Infrastructure to enable delivery of IOOS ® information Presentation to the IOOS Advisory Committee Derrick Snowden, System Architect, U.S. IOOS.

IOOS Model Data Interoperability Design ROMS POM WW3 WRF ECOM NcML Common Data Model OPeNDAP+CF WCS NetCDF Subset THREDDS Data Server Standardized (CF)

Integrated Model Data Management S.Hankin ESMF July ‘04 Integrated data management in the ESMF (ESME) Steve Hankin (NOAA/PMEL & IOOS/DMAC) ESMF Team meeting.

OOI CI LCA REVIEW August 2010 Ocean Observatories Initiative External Observatory Integration Christopher Mueller, Matt Arrott, John Graybeal Life Cycle.

Information, data servers and data products for the Pacific regional association J. Potemra briefing to Z. Willis, UH Manoa, July 2009.

Opendap dev - meeting, Boulder, Feb 2007 OPeNDAP infrastructure in European Operational Oceanography T Loubrieu (IFREMER) T Jolibois (CLS)

IOOS Modeling Testbed Cyberinfrastructure Rich Signell, USGS, Woods Hole, MA IOOS-RA-Briefing, Feb 14, 2012.

EarthCube Building Block for Integrating Discrete and Continuous Data (DisConBB) David Maidment, University of Texas at Austin (Lead PI) Alva Couch, Tufts.

1 HYCOM Data Service HYCOM Data Service An overview Ashwanth Srinivasan, (FSU) Steve Hankin (NOAA/PMEL)

IOOS Coastal Ocean Modeling Testbed (COMT) Cyberinfrastructure Oceans 12 Becky Baltes, IOOS Liz Smith, SURA Rich Signell, USGS Eoin Howlett, Kyle Wilcox,

Unidata TDS Workshop THREDDS Data Server Overview

U.S. Integrated Ocean Observing System (IOOS ® ) IOOS ® Biological Observations Data Project A Multi-Agency Effort to Enable Access to Biological Observations.

IOOS Data Services with the THREDDS Data Server Rich Signell USGS, Woods Hole IOOS DMAC Workshop Silver Spring Sep 10, 2013 Rich Signell USGS, Woods Hole.

GEON2 and OpenEarth Framework (OEF) Bradley Wallet School of Geology and Geophysics, University of Oklahoma

-101 MACOORA Annual Meeting October 22-23, 2008 Dartmouth, Massachusetts Presenters: Scott Glenn & Josh Kohut.

November 16, 2009 Page 1 of 28 Data and Data Management: Introduction to the BCO-DMO Presented to Professor Keiichi Uchida November 16, 2009 Robert C.

Ed Armstrong – PI Luca Cinquini Chris Mattmann NASA Jet Propulsion Laboratory Frank O’Brien Zach Siegrist System Science Applications, Inc. 18 July 2012.

IOOS Regional Data Management Workshop April 27 & 28, 2011 Silver Spring, MD COLLABORATION TO DATE Charles Alexander 1, Jeff de La Beaujardière 1, Arthur.

Unstructured Mesh Conventions for CF

CUAHSI HIS: Science Challenges Linking small integrated research sites (

U.S. INTEGRATED OCEAN OBSERVING SYSTEM DATA ACCESS SERVICES Coastal Geotools: Advances in Federal Data Access Services Hassan Moustahfid, Chris Duncombe.

OOI Cyberinfrastructure and Semantics OOI CI Architecture & Design Team UCSD/Calit2 Ocean Observing Systems Semantic Interoperability Workshop, November.

Data Stewardship at the NOAA Data Centers Sub Topic - Value Added Products ESIP Federation Meeting, Washington, DC January 6-8, 2009.

IOOS Sea Surface Temperatures: Realizing Truly Distributed Data with Open Standards Presenter Kyle Draganov.

Catalog-driven workflows using CSW Rich Signell, USGS, Woods Hole, MA, USA Filipe Fernandes, SECOORA, Brazil Kyle Wilcox, Axiom Data Science, Wickford,

Ocean Observatories Initiative Serving Ocean Model Data on the Cloud M. Meisinger, C. Farcas, E. Farcas, C. Alexander, M. Arrott, J. de La Beaujardière,

Access to IOOS Data Relevant to OOI Kathleen Bailey NOAA/NOS/IOOS January 6, 2016.

Rich Signell Roland Viger Curtis Price USGS Community for Data Integration Feb 15, 2012.

The NOAA Operational Model Archive and Distribution System NOMADS CEOS-Grid Application Status Report Glenn K. Rutledge NOAA NCDC CEOS WGISS-19 Cordoba,

Interoperability Day Introduction Standards-based Web Services Interfaces to Existing Atmospheric/Oceanographic Data Systems Ben Domenico Unidata Program.

NOAA EDMC Ocean Observatories Initiative Cyberinfrastructure Karen Stocks OOI CI Data Curator University of California, San Diego Ocean Observatories.

Michael Crowley1 S. Glenn1, S. Lichtenwalner1,

TGDATA 13/2, WGDIKE 14/2 Good afternoon everyone and thanks for the opportunity of presenting at this meeting the progress.

Presentation transcript:

Unidata and Oceanography Through the Ages Rich Signell USGS Coastal and Marine Science Center Woods Hole, MA & NOAA Integrated Ocean Observing System (IOOS) Program Office Silver Spring, MD Unidata 25 th Anniversary Oct 16, 2009

Typical Ocean Model Grid (curvilinear structured grid) Stretched surface and terrain following vertical coordinates Curvilinear orthogonal horizontal coordinates

In the beginning (25 years ago)… …there was darkness

US Integrated Ocean Observing System (IOOS ® ) IOOS ® Plan defines: IOOS ® Plan defines: Global Component Global Component Coastal Component Coastal Component  17 Federal Agencies  11 Regional Associations

Problem: Each institution had a custom web page display of model forecasts. How to compare to data and to each other? University of Maine University of Massachusetts - Boston

Data Interoperability System Design

THREDDS/NcWMS Web Mapping Service for Quick Browsing

IDV for more sophisticated visualization IDV for more sophisticated visualization

NetCDF-Java Toolbox for Matlab for scientific analysis Model 1: UMASS- ECOM Model 2: UMAINE- POM Data: SST 2008-Sep-08 07:32

Summary What did we get through the use of Unidata technology? What did we get through the use of Unidata technology? Standards-based delivery of aggregated model data with minimal burden on the data provider Standards-based delivery of aggregated model data with minimal burden on the data provider Single point of access for regional model results Single point of access for regional model results Model data interoperability via standard software Model data interoperability via standard software Multiple modes of access for users Multiple modes of access for users More eyes on the model results More eyes on the model results More usage of model results More usage of model results Faster feedback to modelers Faster feedback to modelers Improved models! Improved models! We now have an IOOS THREDDS Catalog that points to 17 THREDDS servers running in all 11 IOOS Regions We now have an IOOS THREDDS Catalog that points to 17 THREDDS servers running in all 11 IOOS Regions So are we done? Well…. So are we done? Well….

Ocean Model Native Grid Type #2 (triangular unstructured grid)

Unidata and Oceanography in the Future Develop support for unstructured grids: Need a new Scientific Feature type in the CDM, new class and methods in NetCDF-Java, delivery via WMS in TDS, and visualization in IDV. Develop support for unstructured grids: Need a new Scientific Feature type in the CDM, new class and methods in NetCDF-Java, delivery via WMS in TDS, and visualization in IDV. Develop protocols and back end software in the TDS to allow server side functions such as subsetting and averaging functions. Develop protocols and back end software in the TDS to allow server side functions such as subsetting and averaging functions. Strengthen ties between Unidata, the Integrated Ocean Observing System (IOOS), and the NSF-sponsored Ocean Observing Initiative CyberInfrastructure (OOI- CI) project. I hope to play a role here… Strengthen ties between Unidata, the Integrated Ocean Observing System (IOOS), and the NSF-sponsored Ocean Observing Initiative CyberInfrastructure (OOI- CI) project. I hope to play a role here…

Thank You Unidata!

Extra Slides

Matthew Arrott speaking at the Ocean Observing Initiative CyberInfrastructure kick-off meeting one month ago. This is a 40 million dollar, 5 year project, and there were approximately 100 people in the room): Matthew Arrott speaking at the Ocean Observing Initiative CyberInfrastructure kick-off meeting one month ago. This is a 40 million dollar, 5 year project, and there were approximately 100 people in the room): "Let me explain why Unidata is here. Everytime I go out in the field and look at the tools that scientists are using, they are using Unidata's tools. It is our view that how you get to the CI will be through Unidata's tools. This is why you see us speak more about infrastructure than about application. We are not developing applications that in conflict with the existing practices of scientists. We are there to accelerate their practices, to expand their practices. The best way to do that is to deploy into the existing operational context and Unidata represents one of the strongest institutions in the country in terms of supplying applications to the end users." "Let me explain why Unidata is here. Everytime I go out in the field and look at the tools that scientists are using, they are using Unidata's tools. It is our view that how you get to the CI will be through Unidata's tools. This is why you see us speak more about infrastructure than about application. We are not developing applications that in conflict with the existing practices of scientists. We are there to accelerate their practices, to expand their practices. The best way to do that is to deploy into the existing operational context and Unidata represents one of the strongest institutions in the country in terms of supplying applications to the end users."

Temperature at 1 m depth

Vertical transects along path