Jeff de La Beaujardière, PhD NOAA Sr System Architect, IOOS Program Office DAARWG Meeting Silver Spring, 2010-12-09 Integrated Ocean Observing System (IOOS)

Slides:

Advertisements

Similar presentations

EuroGEOSS Implementing the GEOSS Data Sharing Action Plan: Drought.

Advertisements

Sensor Asia Development Progress HONDA Kiyoshi Asian Institute of Technology / Mie University Aadit Shrestha, Rassarin Ch., NGUYEN Duy Hung Asian Institute.

1 OGC Web Services Kai Lin San Diego Supercomputer Center

Integrating NOAA’s Unified Access Framework in GEOSS: Making Earth Observation data easier to access and use Matt Austin NOAA Technology Planning and Integration.

U.S. IOOS ® Assessment Results Posted December 2012.

Our Planet is Changing We need advanced tools to understand and monitor our oceans, coasts and Great Lakes Zdenka Willis Director, US IOOS Program Office.

Pacific Island Countries GIS/RS User Conference 2010, Suva, November 2010 Sensor Web Enablement for the Pacific Vulnerability and adaptation of coastal.

The SouthEast Coastal Ocean Observing SECOORA Meeting Regional Association (SECOORA) June 11-12, 2007 SECOORA Data Management and Communications SECOORA.

Welcome MACOORA Annual Meeting October 22-23, 2008 Fall River, Massachusetts Carolyn Thoroughgood.

Integrated Ocean Observing System Data Management and Communications March 2004 The US Integrated Ocean Observing System (IOOS) Plan for Data Management.

EuroGEOSS Implementing the GEOSS Data Sharing Action Plan: Forestry.

Steve Rutz NOAA/NESDIS National Oceanographic Data Center NODC Observing Systems Team Leader June 21, 2011.

NOAA Data Management Activities Deirdre Jones, EDMC Chair Jeff de La Beaujardière, DM Architect Prepared for DAARWG

A Global Agriculture Drought Monitoring and Forecasting System (GADMFS) Meixia Deng and Liping Di.

Metadata (for the data users downstream) RFC GIS Workshop July 2007 NOAA/NESDIS/NGDC Documentation.

Data Interoperability and Access Activities Prepared for the Data Archiving and Access Requirements Working Group (DAARWG) Ken McDonald, TPIO/GEO-IDE Jeff.

Graphic courtesy NOAA / PMEL / Center for Tsunami Research Pacific Northwest Waters Gateway to Our Future Communication through the NANOOS Visualization.

Bringing it All Together: NODC’s Geoportal Server as an Integration Tool for Interoperable Data Services Kenneth S. Casey, Ph.D. YuanJie Li NOAA National.

Unidata’s TDS Workshop TDS Overview – Part II October 2012.

Testing the US Integrated Ocean Observing System Data Discovery and Distribution Infrastructure with Real-World Problems Derrick Snowden 1, Rich Signell.

2 3 ROMS/COAWST NcML file 4 5 Exploiting IOOS: A Distributed, Standards-Based Framework and Software Stack for Searching, Accessing, Analyzing and.

Unidata TDS Workshop TDS Overview – Part I XX-XX October 2014.

IOOS Data Management Integration Standards Plans in the Northeast Eric Bridger (GMRI) Sep

Our Eyes on the Oceans Coasts and Great Lakes USACE Coastal Engineering Research Board Zdenka Willis Our Eyes on the Oceans Coasts and Great Lakes USACE.

Jeff de La Beaujardière, PhD Carmel Ortiz NOAA IOOS Program Office Integrated Ocean Observing System (IOOS)

Tools in Support of a National DMAC Derrick Snowden NERACOOS/ODP Annual Meeting 26 Sep 2012.

DMAC: Infrastructure to enable delivery of IOOS ® information Presentation to the IOOS Advisory Committee Derrick Snowden, System Architect, U.S. IOOS.

OOI CI EOI LCA REVIEW December 13, 2010 Ocean Observatories Initiative External Observatory Integration Christopher Mueller Life Cycle Architecture Review.

Josie Quintrell, NFRA Executive Director October, 2010 MACOORA Board Meeting.

1 NOAA IOOS Program Data Integration Framework (DIF) Project Overview Adapted from a brief to the NOAA Data Management Committee August 6, 2008 by Jeff.

OOI CI LCA REVIEW August 2010 Ocean Observatories Initiative External Observatory Integration Christopher Mueller, Matt Arrott, John Graybeal Life Cycle.

Information, data servers and data products for the Pacific regional association J. Potemra briefing to Z. Willis, UH Manoa, July 2009.

NODC ↔ Data Consumers Steve Rutz NOAA/NESDIS National Oceanographic Data Center NODC Observing Systems Team Leader June 21, 2011.

Zdenka Willis Briefing to GCOOS March 4, 2010 US IOOS Update.

ResEau: A Water Portal SensorWeb Implementation National Information Strategies Division Strategic Information Integration Directorate Environment Canada.

1 A Sample of NCDDC's GCOOS-Related Data Management Activities Julie Bosch NOAA/ National Coastal Data Development Center GCOOS DMAC Committee Meeting.

Geospatial Interoperability Jeff de La Beaujardière, PhD NASA Geospatial Interoperability Office.

IOOS Data Services with the THREDDS Data Server Rich Signell USGS, Woods Hole IOOS DMAC Workshop Silver Spring Sep 10, 2013 Rich Signell USGS, Woods Hole.

Water Quality Ru Morrison, NERACOOS Pixie Hamilton, USGS Water Quality John Haines, USGS, Pixie Hamilton, USGS, Ru Morrison, NERACOOS, Mario Tamburri,

Unidata’s TDS Workshop TDS Overview – Part I July 2011.

1 Implementing QA/QC Standards for In Situ Ocean Sensors Using OGC-Sensor Web Enablement a.k.a. QARTOD to OGC a.k.a. Q2O Project Status Brief to NOAA IOOS.

U.S. GLOBEC Georges Bank 2007 Phase 4B SI Meeting April 23, 2007 GoMODP, Data Interoperability and the MapServer Interface to U.S. GLOBEC Data Presented.

West Coast IOOS Partner Updates SCCOOS Darren Wright (DMAC), Jen McWorter (Institutional Liaisons) CeNCOOS Jennifer Patterson (DMAC), Shane StClair (DMAC)

IOOS Regional Data Management Workshop April 27 & 28, 2011 Silver Spring, MD COLLABORATION TO DATE Charles Alexander 1, Jeff de La Beaujardière 1, Arthur.

1 of 37 Next Steps SOS DescribeSensor implementation (SensorML) Testing/evaluation/refinement of existing work Build or borrow needed components … Reference.

CeNCOOS Progress Interim Executive Committee Interim Executive Committee Interim committees – Interim committees – –Evaluating options for governance and.

Integrated Ocean Observing System (IOOS) Update

U.S. INTEGRATED OCEAN OBSERVING SYSTEM DATA ACCESS SERVICES Coastal Geotools: Advances in Federal Data Access Services Hassan Moustahfid, Chris Duncombe.

Vision of an Integrated Global Observing System Gregory W. Withee Assistant Administrator for Satellite and Information Services National Oceanic and Atmospheric.

Data Stewardship at the NOAA Data Centers Sub Topic - Value Added Products ESIP Federation Meeting, Washington, DC January 6-8, 2009.

IOOS Sea Surface Temperatures: Realizing Truly Distributed Data with Open Standards Presenter Kyle Draganov.

National Geospatial Enterprise Architecture N S D I National Spatial Data Infrastructure An Architectural Process Overview Presented by Eliot Christian.

Access to IOOS Data Relevant to OOI Kathleen Bailey NOAA/NOS/IOOS January 6, 2016.

Maracoos DMAC and Asset Map June Maracoos DMAC Principles Data is served and integrated using open, interoperable data standards recommended by.

The Earth Information Exchange. Portal Structure Portal Functions/Capabilities Portal Content ESIP Portal and Geospatial One-Stop ESIP Portal and NOAA.

Future needs and plans for ocean observing in the Arctic AOOS Arctic Town Hall Futur Zdenka Willis Integrated Ocean Observing System National Program Office.

U.S. IOOS ® Update – SECOORA Annual Meeting Jack Harlan & Rob Ragsdale US IOOS Program Office.

OOI CI LCA REVIEW August 2010 Ocean Observatories Initiative External Observatory Integration: Christopher Mueller Life Cycle Objectives Review La Jolla,

1 2.5 DISTRIBUTED DATA INTEGRATION WTF-CEOP (WGISS Test Facility for CEOP) May 2007 Yonsook Enloe (NASA/SGT) Chris Lynnes (NASA)

Interoperability Day Introduction Standards-based Web Services Interfaces to Existing Atmospheric/Oceanographic Data Systems Ben Domenico Unidata Program.

NOAA IOOS SOS Implementations in 2008 Jeff de La Beaujardière, PhD NOAA IOOS Program DIF Sr Systems Architect.

NOAA EDMC Ocean Observatories Initiative Cyberinfrastructure Karen Stocks OOI CI Data Curator University of California, San Diego Ocean Observatories.

NOS DataExplorer Enterprise GIS Efforts within NOAA's Ocean Service Jason Marshall (PSGS) NOAA Coastal Services Center.

OGC’s role in GEO: Results from the Architectural Implementation Pilot (AIP) George Percivall Open Geospatial Consortium GEO Task IN-05 Coordinator

Grid Services for Digital Archive Tao-Sheng Chen Academia Sinica Computing Centre

Page 1 CSISS Center for Spatial Information Science and Systems IIB and GCI Meeting CSR Architecture and Current Registration Status Prof. Liping Di Director.

GEOSS Component and Service Registry (CSR)

Data Browsing/Mining/Metadata

US IOOS®, NDBC, CO-OPS Partnership Discussion

Eoin Howlett ASA, MARACOOS

Presentation transcript:

Jeff de La Beaujardière, PhD NOAA Sr System Architect, IOOS Program Office DAARWG Meeting Silver Spring, Integrated Ocean Observing System (IOOS) Data Management Activities

Interagency effort –Recent legislation: ICOOS Act –NOAA lead - program office –NSF, USACE, Navy collaborations most active 11 Regional Associations (RAs), 1 sensor V&V partner –US non-federal partners –Funding from NOAA 2 IOOS Program Overview

IOOS Data Types (available or in progress as of 2010) Buoys Shore Stations Coastal HF Radar Gliders Model Outputs Diver Surveys Satellite Ocean Color

IOOS Data Providers (available or in progress as of 2010) MODIS CoastWatch NOAA Natl. Satellite Data & Info. Svc. NWLONPORTS CO-OPS NOAA Ctr. for Oper. Oceanographic. Prods & Svcs Wx TAO DARTHF Radar NDBC NOAA/NWS Natl. Data Buoy Ctr IOOS RAs Regional Associations Water Levels USACE Army Corps - Mobile District Water Quality FIU Florida Intl. U.

model outputs Coastal radar satellite observations Goal: Enable Integration via Standards

established as part of Data Integration Framework pilot OGC SOS (Sensor Observation Service)‏ satellite gridded model outputs HF radar In situ Observations + Metadata Points, Profiles, Collections, Trajectories Structured Grids (+ unstructured grids)‏ DAP (Data Access Protocol) and OGC WCS (Web Coverage Service)‏ OGC WMS (Web Map Service)‏ Map Images (of all data types)‏ *OGC = Open Geospatial Consortium Formats: PNG, GeoTIFF, JPEG,... Formats: XML, ASCII, KML, + CF/NetCDF Format: CF/NetCDF IOOS Data Request Services Metadata: SensorML

7 DIF* Pilot Project & Beyond NDBC SOSDAPWMS Harmful Algal BloomsHurricane Intensity CO-OPS SOS IOOS RAs SOSDAPWMS CoastWatch DAP Public Internet Future Providers: USACE (WL), PacIOOS (Bio), Florida Intl U (WQ),... Google Oceans SOS Coastal Inundation SOS Tsunami Event DB SOS Future Customers: Espresso ROMS, CO-OPS, Ocean Acidification?, Ocean Energy? Integrated Ecosystem Assessments DAP SOS *DIF = Data Integration Framework DAP Public Internet

SOSDAPWMSSOSDAPWMSSOSDAPWMS Public Internet 8 IOOS Catalog Metadata Harvester Service Registry Web Interface SOSDAPWMS SOSDAPWMS Format Conversion Visualization Data Integration Additional Services Archive

9 Federated, Service-Oriented Architecture IOOS Catalog Regional Catalog data access service Regional Obs Syst. or Model Harvester Service Registry Web Interface Obs Syst. or Model DAC* Obs Syst. or Model data provider Other Services RegistryHarvester Archive DAC data access service DAC data access service DAC data access service *DAC = Data Assembly Center data access service

IOOS Catalog – v1.0 ORRAP Ocean Observing Sub-Panel – Washington, DC – December 7,

11 Service Registry List of servers, summary metadata Register (+verify compliance)‏ Data Catalog Detailed spatial & temporal extents US geodata.gov, GEOSS CSR Service Metadata (ISO 19119) PostgreSQL/PostGIS GeoNetwork Harvest (+verify continued operation)‏ IOOS Data Servers NOAA/NOS CO-OPS SOS NOAA/NESDIS CoastWatch DAP IOOS RA SOSDAPWMS NOAA/NWS NDBC SOSDAPWMS IOOS RA SOSDAPWMS Dataset Metadata (ISO 19115) IOOS Catalog Concept of Operations

DMAC Data Management and Communications Data Management Modeling & Analysis Web Portal Client Libraries Analysis Tools System Monitor Models Observing Systems Moored Buoys Fixed Stations Samples Moving Platforms RadarSatellite Data Assembly Centers Physical Obs Biological Obs Archives Model Outputs Utility Services Visualization Conversion Data Integration Catalog Registry Computational Viewpoint from Reference Model for Open Distributed Processing (RM-ODP) Component Types Needed for IOOS Data Access Services Subscription Pull Individual Features Structured Grids Unstructured Grids Undersea Imagery … … … … … Service Gateway Maps & Images Workflows Notification Surveys GIS Framework Data StartingWorking ExamplesNot Started w/NSF OOI-CI Legend:

IOOS Catalog 13 IOOS/NSF OOI-CI Collaboration NDBC Wx NDBC HFR CO-OPS WL IOOS Data Sources Non-IOOS Sources SOSTDSSOS Espresso ROMS other models IOOS RAs SOS IOOS as data source for OOI-CI & models OOI-CI Service Translation Format Conversion Notification Feeds/ Subscriptions External Observatory Integration (EOI)

Lack of complete metadata – IOOS helping fund improvements General standards that are too broad – IOOS is coordinating, implementing, documenting Needs of local RA stakeholders vs. greater good – IOOS published Guidance paper for FFO Getting all data archived – IOOS helping with Wx, HFR, RA, glider Long-term support for observing assets – ? Challenges