IOOS Model Data Interoperability Design ROMS POM WW3 WRF ECOM NcML Common Data Model OPeNDAP+CF WCS NetCDF Subset THREDDS Data Server Standardized (CF)

Slides:

Advertisements

Similar presentations

1 NASA CEOP Status & Demo CEOS WGISS-25 Sanya, China February 27, 2008 Yonsook Enloe.

Advertisements

Recent Work in Progress

The Model Output Interoperability Experiment in the Gulf of Maine: A Success Story Made Possible By CF, NcML, NetCDF-Java and THREDDS Rich Signell (USGS,

DMAC ST and the Activities of the IOOS PO Derrick Snowden DMAC Steering Team

Integrating NOAA’s Unified Access Framework in GEOSS: Making Earth Observation data easier to access and use Matt Austin NOAA Technology Planning and Integration.

MS698: Implementing an Ocean Model Benchmark tests. Dealing with big data files. – (specifically big NetCDF files). Signell paper. Activity: – nctoolbox.

Kevin O’Brien University of Washington/JISAO NOAA/PMEL Interoperable Access to Near Real Time Ocean Observations with the Observing System Monitoring Center.

Connecting HDF And ISO Metadata Ted Habermann, NASA/ESDIS Hook Hua, Barry Weiss, NASA/Jet Propulsion Lab Mike Folk, Gerd Heber, Elena Pourmal, The HDF.

Crossing the Digital Divide

A Distributed Approach to Ocean, Atmosphere & Climate Model Data Interoperability Rich Signell USGS Woods Hole, MA COAWST Training Workshop Woods Hole,

Data Discovery 1.Data discovery systems 2.TDS and metadata 3.NcISO services.

Steve Rutz NOAA/NESDIS National Oceanographic Data Center NODC Observing Systems Team Leader June 21, 2011.

Unidata TDS Workshop THREDDS Data Server Overview October 2014.

Introduction Downloading and sifting through large volumes of data stored in differing formats can be a time-consuming and sometimes frustrating process.

The use of standard OGC web services in integrating distributed model, satellite and in-situ datasets Alastair Gemmell Jon Blower Keith Haines Environmental.

A Super-Regional Modeling Testbed for Improving Forecasts of Environmental Processes for the U.S. Atlantic and Gulf of Mexico Coasts Cyberinfrastructure.

A Super-Regional Modeling Testbed for Improving Forecasts of Environmental Processes for the U.S. Atlantic and Gulf of Mexico Coasts Cyberinfrastructure.

VrRBO with THREDDS data store. Paths & URLs THREDDS server THREDDS data directory.

Crossing the Digital Divide Presented by: Fernando R. Salas David Maidment, Enrico Boldrini, Stefano Nativi, Ben Domenico OGC Technical Meeting – Met/Occean.

AdcircLite-NC Rapid computation of storm surge and waves for NC coastal waters Jesse Bikman 1, Brian Blanton 2, Alexander Taflandis 3, Andrew Kennedy 3.

Gridded Data Interoperability for the Integrated Ocean Observing System Rich Signell USGS Woods Hole/NOAA Silver Spring USA USGS CDI Web Meeting: Oct 22,

Implementation of Model Data Interoperability for IOOS: Successes and Lessons Learned Rich Signell USGS Woods Hole, MA / NOAA Silver Spring USA Model Data.

Observing System Monitoring Center Integrating data and information across observing system networks.

Unidata’s TDS Workshop TDS Overview – Part II October 2012.

General Assembly Meeting – SA Session | Crete Oct SA 13.1 NEMO-SN1 – WESTERN IONIAN SEA GEOPHYSICS, OCEANOGRAPHY, AND DERIVED PRODUCTS SA starting.

2 3 ROMS/COAWST NcML file 4 5 Exploiting IOOS: A Distributed, Standards-Based Framework and Software Stack for Searching, Accessing, Analyzing and.

Unidata TDS Workshop TDS Overview – Part I XX-XX October 2014.

Unidata’s Common Data Model John Caron Unidata/UCAR Nov 2006.

IOOS Data Management Integration Standards Plans in the Northeast Eric Bridger (GMRI) Sep

THREDDS Data Server Ethan Davis GEOSS Climate Workshop 23 September 2011.

NetCDF-Java Overview John Caron Oct 29, Contents Data Models / Shared Dimensions Coordinate Systems Feature Types NetCDF Markup Language (NcML)

U.S. Department of the Interior U.S. Geological Survey Management of Oceanographic time-series data at the Woods Hole Coastal and Marine Science Center.

Unidata’s TDS Workshop TDS Overview – Part II Unidata July 2011.

Mid-Course Review: NetCDF in the Current Proposal Period Russ Rew

Enhancements to a Community Toolset for Ocean Model Data Interoperability: Unstructured grids, NCTOOLBOX, and Distributed Search Rich Signell (USGS), Woods.

Tools in Support of a National DMAC Derrick Snowden NERACOOS/ODP Annual Meeting 26 Sep 2012.

Accomplishments and Remaining Challenges: THREDDS Data Server and Common Data Model Ethan Davis Unidata Policy Committee Meeting May 2011.

DMAC: Infrastructure to enable delivery of IOOS ® information Presentation to the IOOS Advisory Committee Derrick Snowden, System Architect, U.S. IOOS.

Unidata and Oceanography Through the Ages Rich Signell USGS Coastal and Marine Science Center Woods Hole, MA & NOAA Integrated Ocean Observing System (IOOS)

OOI CI LCA REVIEW August 2010 Ocean Observatories Initiative External Observatory Integration Christopher Mueller, Matt Arrott, John Graybeal Life Cycle.

IOOS Modeling Testbed Cyberinfrastructure Rich Signell, USGS, Woods Hole, MA IOOS-RA-Briefing, Feb 14, 2012.

1 HYCOM Data Service HYCOM Data Service An overview Ashwanth Srinivasan, (FSU) Steve Hankin (NOAA/PMEL)

IOOS Coastal Ocean Modeling Testbed (COMT) Cyberinfrastructure Oceans 12 Becky Baltes, IOOS Liz Smith, SURA Rich Signell, USGS Eoin Howlett, Kyle Wilcox,

Unidata TDS Workshop THREDDS Data Server Overview

1 NASA CEOP Status & Demo CEOS WGISS-24 Oberpfaffenhofen, Germany October 15, 2007 Yonsook Enloe.

Unidata’s Common Data Model and the THREDDS Data Server John Caron Unidata/UCAR, Boulder CO Jan 6, 2006 ESIP Winter 2006.

U.S. Integrated Ocean Observing System (IOOS ® ) IOOS ® Biological Observations Data Project A Multi-Agency Effort to Enable Access to Biological Observations.

IOOS Data Services with the THREDDS Data Server Rich Signell USGS, Woods Hole IOOS DMAC Workshop Silver Spring Sep 10, 2013 Rich Signell USGS, Woods Hole.

Unidata’s TDS Workshop TDS Overview – Part I July 2011.

IOOS National Glider Data Assembly Center

The Unified Access Framework (UAF) Building NOAA’s Global Earth Observation Integrated Data Environment (GEO-IDE) one step at a time Steve Hankin (PMEL),

1 NASA CEOP Final Summary CEOS WGISS-26 Boulder, Colorado September 23, 2008 Yonsook Enloe

Improving Data Catalogs with Free and Open Source Software Kevin O’Brien University of Washington Joint Institute for the Study of the Atmosphere and Ocean.

The Unified Access Framework for Gridded Data … the 1 st year focus of NOAA’s Global Earth Observation Integrated Data Environment (GEO-IDE) Steve Hankin,

Unidata’s Common Data Model and NetCDF Java Library API Overview John Caron Unidata/UCAR Nov 2008.

Unidata's Involvement in Developing and Supporting Climate Science Infrastructure Russ Rew UCAR Unidata April 2010.

Eoin Howlett, Kelly Knee ASA Roy Mendelssohn, Cara Wilson NOAA/NMFS

U.S. INTEGRATED OCEAN OBSERVING SYSTEM DATA ACCESS SERVICES Coastal Geotools: Advances in Federal Data Access Services Hassan Moustahfid, Chris Duncombe.

DOC / NOAA / NMFS / SWFSC / ERD

Data Stewardship at the NOAA Data Centers Sub Topic - Value Added Products ESIP Federation Meeting, Washington, DC January 6-8, 2009.

Catalog-driven workflows using CSW Rich Signell, USGS, Woods Hole, MA, USA Filipe Fernandes, SECOORA, Brazil Kyle Wilcox, Axiom Data Science, Wickford,

Access to IOOS Data Relevant to OOI Kathleen Bailey NOAA/NOS/IOOS January 6, 2016.

Rich Signell Roland Viger Curtis Price USGS Community for Data Integration Feb 15, 2012.

1 2.5 DISTRIBUTED DATA INTEGRATION WTF-CEOP (WGISS Test Facility for CEOP) May 2007 Yonsook Enloe (NASA/SGT) Chris Lynnes (NASA)

NetCDF: Data Model, Programming Interfaces, Conventions and Format Adapted from Presentations by Russ Rew Unidata Program Center University Corporation.

Interoperability Day Introduction Standards-based Web Services Interfaces to Existing Atmospheric/Oceanographic Data Systems Ben Domenico Unidata Program.

Update on Unidata Technologies for Data Access Russ Rew

TSDS (HPDE DAP). Objectives (1) develop a standard API for time series-like data, (2) develop a software package, TSDS (Time Series Data Server), that.

Unidata Infrastructure for Data Services Russ Rew GO-ESSP Workshop, LLNL

HDF-EOS Workshop XXI / The 2018 ESIP Summer Meeting

Presentation transcript:

IOOS Model Data Interoperability Design ROMS POM WW3 WRF ECOM NcML Common Data Model OPeNDAP+CF WCS NetCDF Subset THREDDS Data Server Standardized (CF) Virtual Datasets Nonstandard Model Output Files (distributed) Web Services Matlab Panoply IDV ERDDAP Clients NetCDF -Java Library or Service NcML, NetCDF-Java, Common Data Model and THREDDS Data Server built and supported by Unidata under NSF-support WMS ncISO ArcGIS NetCDF4 -Python FVCOM Iris EDC ERDDAP NetCDF-Java SOS GeoPortal Server GeoNetwork GI-CAT timeseries, point, profile, trajectory, swath CKAN IP[y]

NCTOOLBOX for Matlab links = opensearch(q) nc = ncugrid(links.dap{1}) z = nc.data(‘zeta’,…) grid = nc.grid(‘zeta’,…) z = 26441x1 single grid = lat: [26441x1 single] lon: [26441x1 single] time: (matlab datenum) connectivity: [52025x3 int32]

test_cf_ugrid3.m

Glider Comparison with nc_genslice.m

NCEP Global RTOFS & NCTOOLBOX

Standards-based access in Python

A Success Story: Assessing a 30 year ocean hindcast in the Gulf of Maine 30 TB dataset from 4D ocean model served via the THREDDS data server at UMASS/SMAST 6000 time series datasets from 3 different THREDDS catalogs (USGS, NOAA/NMFS, WHOI) 30 TB dataset from 4D ocean model served via the THREDDS data server at UMASS/SMAST 6000 time series datasets from 3 different THREDDS catalogs (USGS, NOAA/NMFS, WHOI)