DMAC ST and the Activities of the IOOS PO Derrick Snowden DMAC Steering Team 2013-02-28.

Slides:



Advertisements
Similar presentations
1 NASA CEOP Status & Demo CEOS WGISS-25 Sanya, China February 27, 2008 Yonsook Enloe.
Advertisements

1 GEOSS Architecture Implementation Pilot (AIP) Phase 2 Air Quality and Health Working Group Stefan Falke, Rudy Husar, Frank Lindsay, David McCabe, Erin.
Geographic Interoperability Office ISO and OGC Geographic Information Service Architecture George Percivall NASA Geographic.
What: System wide demonstration of the DMAC capabilities we’ve been working on for ca.10 years. Why: Proof of concept that DMAC can be unifying element.
The Model Output Interoperability Experiment in the Gulf of Maine: A Success Story Made Possible By CF, NcML, NetCDF-Java and THREDDS Rich Signell (USGS,
GEOSS Water Services for Data and Maps Community Recommendations David K. Arctur, Project Lead, GEOSS AIP-6 Water SBA University.
REASoN REASoN Project to link NASA's data, modeling and systems to users in research, education and applications Application of NASA ESE Data and Tools.
Integrating NOAA’s Unified Access Framework in GEOSS: Making Earth Observation data easier to access and use Matt Austin NOAA Technology Planning and Integration.
Crossing the Digital Divide
NOAA Metadata Update Ted Habermann. NOAA EDMC Documentation Directive This Procedural Directive establishes 1) a metadata content standard (International.
Unidata TDS Workshop THREDDS Data Server Overview October 2014.
NOAA Data Management Activities Deirdre Jones, EDMC Chair Jeff de La Beaujardière, DM Architect Prepared for DAARWG
Metadata (for the data users downstream) RFC GIS Workshop July 2007 NOAA/NESDIS/NGDC Documentation.
Crossing the Digital Divide Presented by: Fernando R. Salas David Maidment, Enrico Boldrini, Stefano Nativi, Ben Domenico OGC Technical Meeting – Met/Occean.
Unidata’s TDS Workshop TDS Overview – Part II October 2012.
Testing the US Integrated Ocean Observing System Data Discovery and Distribution Infrastructure with Real-World Problems Derrick Snowden 1, Rich Signell.
2 3 ROMS/COAWST NcML file 4 5 Exploiting IOOS: A Distributed, Standards-Based Framework and Software Stack for Searching, Accessing, Analyzing and.
Unidata TDS Workshop TDS Overview – Part I XX-XX October 2014.
IOOS Data Management Integration Standards Plans in the Northeast Eric Bridger (GMRI) Sep
THREDDS Data Server Ethan Davis GEOSS Climate Workshop 23 September 2011.
Mid-Course Review: NetCDF in the Current Proposal Period Russ Rew
Enhancements to a Community Toolset for Ocean Model Data Interoperability: Unstructured grids, NCTOOLBOX, and Distributed Search Rich Signell (USGS), Woods.
Tools in Support of a National DMAC Derrick Snowden NERACOOS/ODP Annual Meeting 26 Sep 2012.
Accomplishments and Remaining Challenges: THREDDS Data Server and Common Data Model Ethan Davis Unidata Policy Committee Meeting May 2011.
DMAC: Infrastructure to enable delivery of IOOS ® information Presentation to the IOOS Advisory Committee Derrick Snowden, System Architect, U.S. IOOS.
IOOS Model Data Interoperability Design ROMS POM WW3 WRF ECOM NcML Common Data Model OPeNDAP+CF WCS NetCDF Subset THREDDS Data Server Standardized (CF)
AIP-2 Kickoff Workshop End-to-end use case: Discovery, access, and use with variations Doug Nebert GEOSS AIP-2 Kickoff September 2008.
1 NOAA IOOS Program Data Integration Framework (DIF) Project Overview Adapted from a brief to the NOAA Data Management Committee August 6, 2008 by Jeff.
GEO-IDE Community Building and Best Practices Process GEO-IDE Standards Process Denver Post, Sunday, 9 April 2006.
OOI CI LCA REVIEW August 2010 Ocean Observatories Initiative External Observatory Integration Christopher Mueller, Matt Arrott, John Graybeal Life Cycle.
IOOS Modeling Testbed Cyberinfrastructure Rich Signell, USGS, Woods Hole, MA IOOS-RA-Briefing, Feb 14, 2012.
EarthCube Building Block for Integrating Discrete and Continuous Data (DisConBB) David Maidment, University of Texas at Austin (Lead PI) Alva Couch, Tufts.
IOOS Coastal Ocean Modeling Testbed (COMT) Cyberinfrastructure Oceans 12 Becky Baltes, IOOS Liz Smith, SURA Rich Signell, USGS Eoin Howlett, Kyle Wilcox,
Unidata TDS Workshop THREDDS Data Server Overview
Are Standards Really Standards Any More? Mélanie F. Meaux NASA / GCMD In response to Wyn Cudlip with regards to an IDN profile of ISO …
1 NASA CEOP Status & Demo CEOS WGISS-24 Oberpfaffenhofen, Germany October 15, 2007 Yonsook Enloe.
What is CWIC? Authors: Doug Newman Andrew Mitchell
IOOS Data Services with the THREDDS Data Server Rich Signell USGS, Woods Hole IOOS DMAC Workshop Silver Spring Sep 10, 2013 Rich Signell USGS, Woods Hole.
Unidata’s TDS Workshop TDS Overview – Part I July 2011.
® GEOSS AIP 5 Water SBA Update HDWG June 2012 Matt Austin NOAA Stefan Fuest KISTERS Jochen Schmidt NIWA.
IOOS National Glider Data Assembly Center
1 Using the GEOSS Common Infrastructure in the Air Quality & Health SBA: Wildfire & Smoke Assessment Prepared by the GEOSS AIP-2 Air Quality & Health Working.
TEMPLATE DESIGN © OOSTethys - Open Source Software for the Global Earth Observing Systems of Systems E. Bridger 1, L.
1 NASA CEOP Final Summary CEOS WGISS-26 Boulder, Colorado September 23, 2008 Yonsook Enloe
The Unified Access Framework for Gridded Data … the 1 st year focus of NOAA’s Global Earth Observation Integrated Data Environment (GEO-IDE) Steve Hankin,
1 Service Creation, Advertisement and Discovery Including caCORE SDK and ISO21090 William Stephens Operations Manager caGrid Knowledge Center February.
Jeff de La Beaujardière, PhD NOAA Sr System Architect, IOOS Program Office DAARWG Meeting Silver Spring, Integrated Ocean Observing System (IOOS)
The GEOSS Architecture Users and Scientific Communities Served By GEOSS Common Approaches Systems within their Mandates UIC Goal Organize this side of.
DMAC Services Implementation: the first success story of joint planning? Derrick Snowden System Architect
1 ISO WAF Community Catalog Product Access Servers Registry Clearinghouse(s) GEO Portals Community Portals Users Client Apps GetCapabilities ISO
U.S. INTEGRATED OCEAN OBSERVING SYSTEM DATA ACCESS SERVICES Coastal Geotools: Advances in Federal Data Access Services Hassan Moustahfid, Chris Duncombe.
Convergence And Trust in Earth and Space Science Data Systems Ted Habermann, NOAA National Geophysical Data Center Documentation: It’s not just discovery...
1 Using the GEOSS Common Infrastructure in the Air Quality & Health SBA: Wildfire & Smoke Assessment Prepared by the GEOSS AIP-2 Air Quality & Health Working.
1 CLASS – Simple NOAA Archive Access Portal SNAAP Eric Kihn and Rob Prentice NGDC CLASS Developers Meeting July 14th, 2008 Simple NOAA Archive Access Portal.
Access to IOOS Data Relevant to OOI Kathleen Bailey NOAA/NOS/IOOS January 6, 2016.
OOI CI LCA REVIEW August 2010 Ocean Observatories Initiative External Observatory Integration: Christopher Mueller Life Cycle Objectives Review La Jolla,
Rich Signell Roland Viger Curtis Price USGS Community for Data Integration Feb 15, 2012.
1 2.5 DISTRIBUTED DATA INTEGRATION WTF-CEOP (WGISS Test Facility for CEOP) May 2007 Yonsook Enloe (NASA/SGT) Chris Lynnes (NASA)
Interoperability Day Introduction Standards-based Web Services Interfaces to Existing Atmospheric/Oceanographic Data Systems Ben Domenico Unidata Program.
Update on Unidata Technologies for Data Access Russ Rew
Unidata Infrastructure for Data Services Russ Rew GO-ESSP Workshop, LLNL
GEOSS Architecture Implementation Pilot AIP-3 Engineering Use Cases Nadine Alameh & Josh Lieberman AIP-3 kickoff Frascati, Italy March
International Planetary Data Alliance Registry Project Update September 16, 2011.
AQ Participation in AIP AQ Scenario to Demonstrate –Reusable Architecture of GEOSS –Communication with SBA’s and Tech Groups Approach: Adopt two Standards:
Data Browsing/Mining/Metadata
Common Framework for Earth Observation Data
WGISS Connected Data Assets April 5, 2017 Yonsook Enloe
Prepared by: Jennifer Saleem Arrigo, Program Manager
Compliance Checker Presented by Luke Campbell (RPS)
4/5 May 2009 The Palazzo dei Congressi di Stresa Stresa, Italy
Presentation transcript:

DMAC ST and the Activities of the IOOS PO Derrick Snowden DMAC Steering Team

The recent IOOS summit issued a few recommendations or challenges wrt DMAC Clear instructions on how to participate Define a way to measure progress Presentation Objective Recent progress and near term plans for IOOS in the context of these two challenges

Great, a challenge, now what? Clear instructions to participate – (in what?) Metrics for progress – (towards what?) depressive-illness-confusion-and-fear-of-sanity/

The “what” of DMAC means different things to different people, particularly the system aspects.

There are several valid descriptions of “what” DMAC is GEOSS Architecture AIP-6Architecture EarthCube Concept Groups esp. Layered Architecture Cross Domain Interoperability NOAA Environmental Data Management Framework (v0.4) Alternatively, these are efforts to define the scope of the system we need.

IOOS Clients Discovery Service Access Service

This pattern or collection of activities is present in many of the geoscience data initiatives. 7 Illustrates the Publish, Find, Bind Pattern. OGC Reference Model (OGC r7) Discover Data/Service Register Data/Service Discovery Use Data/Service Access ServiceClients

The trouble with catalogs… 8 Illustrates the Publish, Find, Bind Pattern. OGC Reference Model (OGC r7) IOOS GEOSS WMO WIS data.gov One of the summit requests was for metrics to measure progress and community catalogs offer one possibility to focus on. More and better data services, more and better tools to use data, all data and tools registered in a catalog somewhere.

secure.html Metrics: Registry Inventories, quantity GEOSS – 286 s ervices IOOS records NODC records NGDC records NCDC records NASA PO.DAAC datasets

Metrics: Registry Inventories, quality ISO metadata completeness, internal consistency, accuracy secure.html

Another viewpoint on maturity and measuring progress

Clear directions for participating Guidelines for implementing a IOOS profile of SOS (

Tools to make it easier: Servers THREDDS 4.3 released (Unidata) –ncISO continued supportncISO –ncSOS new releasencSOS –Continued development on triangular mesh gridstriangular mesh 52North SOS implementing IOOS Profile52North SOSIOOS Profile SciWMS – Open source WMS server optimized for large netCDF data sets with some curvilinear grid supportSciWMS

ncSOS: SOS Service on top of THREDDS Open source plugin for TDS Maps CF (v1.6) Discrete Sampling Geometries to SWE Common SOS response types Wiki with installation instructions, compatible data sets and hints for use ( open.github.com/ncSOS/) open.github.com/ncSOS/ USGS fork at CIDA/ncSOSxhttps://github.com/USGS- CIDA/ncSOSx

52North.org SWE tools Adopted SOS service and modified to support IOOS Profile (beta released, needs testers) SOS2NC Archiver tools (periodic dump to NODC netcdf templates) Implicit QC routines built in to SOS 52North OXF Web Client

Tools: Clients Python library for SOS Java-netCDF IOSP for SOS output Java SWE parsing library ncToolbox: Matlab library for CF- netCDF and soon SOS/SWE Python based CF netCDF compliance checker Javascript SOS client Environmental Data Connector

Training accessed