1 NOAA IOOS Program Data Integration Framework (DIF) Project Overview Adapted from a brief to the NOAA Data Management Committee August 6, 2008 by Jeff.

Slides:

Advertisements

Similar presentations

Integrated Ocean Observing System (IOOS) Data Management and Communication (DMAC) Standards Process Julie Bosch NOAA National Coastal Data Development.

Advertisements

Implementation of a Data Node in China's Spatial Information Grid Based on NWGISS Dengrong Zhang, Le Yu, Liping Di Institute of Spatial.

Pacific Island Countries GIS/RS User Conference 2010, Suva, November 2010 Sensor Web Enablement for the Pacific Vulnerability and adaptation of coastal.

1 Zdenka Willis Director, National Oceanographic Data Center SEADATANET June 9, 2006.

NOAA Integrated Ocean Observing System (IOOS) Data Integration Framework Richard Crout NOAA NWS National Data Buoy Center GCOOS Board of Directors Meeting.

IOOS ® : Our Eyes on the Oceans, Coasts and Great Lakes Suzanne Skelley Deputy Director NOAA IOOS ® Program February 25, 2009.

1 Integrated Ocean Observing System (IOOS) NOAA’s Approach to Build an Initial Operating Capability John H. Dunnigan Assistant Administrator NOAA’s National.

QARTOD III November 2-4, 2005 Metadata in the IOOS Community Julie Bosch NOAA Coastal Data Development Center QARTOD III November 2–4, 2005.

DMAC Report to the GCOOS BOD GCOOS Board of Directors Meeting Biloxi, MS February 2008 GCOOS Board of Directors Meeting Biloxi, MS February.

The SouthEast Coastal Ocean Observing SECOORA Meeting Regional Association (SECOORA) June 11-12, 2007 SECOORA Data Management and Communications SECOORA.

Integrated Ocean Observing System Data Management and Communications March 2004 The US Integrated Ocean Observing System (IOOS) Plan for Data Management.

The Gulf of Mexico Coastal Ocean Observing System: a component of the U.S. Integrated Ocean Observing System and of the Global Ocean Observing System.

Progress Towards a Regional Coastal Ocean Observing System for the Southeast (SEACOOS) Harvey Seim / University of North Carolina at Chapel Hill University.

Update on NOAA Implementation of Regional Integrated Ocean Observing Systems Mary Culver NOAA Coastal Services Center February 27, 2008 GCOOS Annual Meeting.

NOAA Integrated Ocean Observing System (IOOS)

1 NOAA/National Weather Service John Halquist. 2 Why Standards? Accessibility Versatility Consistency Ensure correct use Remove ambiguity Leverage toolkits.

Steve Rutz NOAA/NESDIS National Oceanographic Data Center NODC Observing Systems Team Leader June 21, 2011.

Metadata (for the data users downstream) RFC GIS Workshop July 2007 NOAA/NESDIS/NGDC Documentation.

From Data Integration to Integrated Solutions Tom Shyka, GMRI Paul Currier, NH DES Water Quality Workshop MACOORA - NERACOOS -SECOORA IOOS, USGS, EPA,

Data Interoperability and Access Activities Prepared for the Data Archiving and Access Requirements Working Group (DAARWG) Ken McDonald, TPIO/GEO-IDE Jeff.

Coastal and Marine Spatial Planning Debra Hernandez, SECOORA Walter Johnson, BOEMRE Ru Morrison, NERACOOS Charly Alexander, IOOS Office.

Implementation of Model Data Interoperability for IOOS: Successes and Lessons Learned Rich Signell USGS Woods Hole, MA / NOAA Silver Spring USA Model Data.

Unidata’s TDS Workshop TDS Overview – Part II October 2012.

Testing the US Integrated Ocean Observing System Data Discovery and Distribution Infrastructure with Real-World Problems Derrick Snowden 1, Rich Signell.

JCOMM Data Buoy Cooperation Panel October 16, 2006 National Data Buoy Center 2006 Review: A Year of Growth Paul F. Moersdorf, PhD, Director.

IOOS Data Management Integration Standards Plans in the Northeast Eric Bridger (GMRI) Sep

Our Eyes on the Oceans Coasts and Great Lakes USACE Coastal Engineering Research Board Zdenka Willis Our Eyes on the Oceans Coasts and Great Lakes USACE.

Jeff de La Beaujardière, PhD Carmel Ortiz NOAA IOOS Program Office Integrated Ocean Observing System (IOOS)

Tools in Support of a National DMAC Derrick Snowden NERACOOS/ODP Annual Meeting 26 Sep 2012.

Extensible Markup Language (XML) Extensible Markup Language (XML) is a simple, very flexible text format derived from SGML (ISO 8879).ISO 8879 XML is a.

1 Global Systems Division (GSD) Earth System Research Laboratory (ESRL) NextGen Weather Data Cube Chris MacDermaid October, 2010.

OOI CI LCA REVIEW August 2010 Ocean Observatories Initiative External Observatory Integration Christopher Mueller, Matt Arrott, John Graybeal Life Cycle.

EarthCube Building Block for Integrating Discrete and Continuous Data (DisConBB) David Maidment, University of Texas at Austin (Lead PI) Alva Couch, Tufts.

1 Integrated Ocean Observing System (IOOS) NOAA’s Approach to Building an Initial Operating Capability Zdenka S. Willis Director, IOOS Program January.

WGISS Technology Subgroup Report WGISS-29 Bonn, 2010 Nataliia Kussul WGISS.

Bob Keeley Marine Environmental Data Service Dept. of Fisheries and Oceans Ottawa, Canada Jun, 2006 SeaDataNet Meeting.

Geospatial Interoperability Jeff de La Beaujardière, PhD NASA Geospatial Interoperability Office.

IOOS Data Services with the THREDDS Data Server Rich Signell USGS, Woods Hole IOOS DMAC Workshop Silver Spring Sep 10, 2013 Rich Signell USGS, Woods Hole.

Air Quality Data Services: Application of OGC specifications Air Quality Data: Multi-dimensional, multi-source, multi-format Point observations are collected.

The Physical Observing System: From Monitoring and Predicting Hazards to Long Term Changes Doug Wilson Co-Chairman, IOCARIBE-GOOS U.S. NOAA GEO CZCP Workshop.

RSISIPL1 SERVICE ORIENTED ARCHITECTURE (SOA) By Pavan By Pavan.

Documenting UAF Data Ted Habermann NOAA/NESDIS/National Geophysical Data Center.

The Integrated Coastal and Oceans Observation System Act of 2009: Implementation 2009 IOOS Regional Coordination Workshop Thursday, August 27.

1 Implementing QA/QC Standards for In Situ Ocean Sensors Using OGC-Sensor Web Enablement a.k.a. QARTOD to OGC a.k.a. Q2O Project Status Brief to NOAA IOOS.

Creating Good Documentation NOAA National Geophysical Data Center

RA Presentation Template NOTE: Please refer to the “GUIDELINES FOR PRESENTING RA PLANS” and the Excel spreadsheet when preparing your presentation (delete.

IOOS Regional Data Management Workshop April 27 & 28, 2011 Silver Spring, MD COLLABORATION TO DATE Charles Alexander 1, Jeff de La Beaujardière 1, Arthur.

1 of 37 Next Steps SOS DescribeSensor implementation (SensorML) Testing/evaluation/refinement of existing work Build or borrow needed components … Reference.

Jeff de La Beaujardière, PhD NOAA Sr System Architect, IOOS Program Office DAARWG Meeting Silver Spring, Integrated Ocean Observing System (IOOS)

Integrated Ocean Observing System (IOOS) Update

Implementing Marine XML for NOAA Observing Data Nazila Merati and Eugene Burger NOAA/Pacific Marine Environmental Laboratory Seattle, WA.

U.S. INTEGRATED OCEAN OBSERVING SYSTEM DATA ACCESS SERVICES Coastal Geotools: Advances in Federal Data Access Services Hassan Moustahfid, Chris Duncombe.

U.S. Integrated Ocean Observing System (IOOS ® ) Z Improve safetyEnhance our economyProtect our environment CIMAR-GOMC meeting – 25 Feb 2015 Zdenka Willis.

IOOS Sea Surface Temperatures: Realizing Truly Distributed Data with Open Standards Presenter Kyle Draganov.

Convergence And Trust in Earth and Space Science Data Systems Ted Habermann, NOAA National Geophysical Data Center Documentation: It’s not just discovery...

Access to IOOS Data Relevant to OOI Kathleen Bailey NOAA/NOS/IOOS January 6, 2016.

IOOS DIF SOS Project. June 5, 2008IOOS DIF SOS Project2 What is SOS? Sensor Observation Service (SOS) – an API for providing sensor and observation data.

Future needs and plans for ocean observing in the Arctic AOOS Arctic Town Hall Futur Zdenka Willis Integrated Ocean Observing System National Program Office.

U.S. IOOS ® Update – SECOORA Annual Meeting Jack Harlan & Rob Ragsdale US IOOS Program Office.

OGC Web Services with complex data Stephen Pascoe How OGC Web Services relate to GML Application Schema.

OOI CI LCA REVIEW August 2010 Ocean Observatories Initiative External Observatory Integration: Christopher Mueller Life Cycle Objectives Review La Jolla,

1 2.5 DISTRIBUTED DATA INTEGRATION WTF-CEOP (WGISS Test Facility for CEOP) May 2007 Yonsook Enloe (NASA/SGT) Chris Lynnes (NASA)

Interoperability Day Introduction Standards-based Web Services Interfaces to Existing Atmospheric/Oceanographic Data Systems Ben Domenico Unidata Program.

NOAA IOOS SOS Implementations in 2008 Jeff de La Beaujardière, PhD NOAA IOOS Program DIF Sr Systems Architect.

Sensor Web Enablement (SWE) developments for fixed monitoring platforms and research vessels By Dick M.A. Schaap – SeaDataNet Technical Coordinator with.

NOS DataExplorer Enterprise GIS Efforts within NOAA's Ocean Service Jason Marshall (PSGS) NOAA Coastal Services Center.

Data Browsing/Mining/Metadata

2009 IOOS Regional Coordination Workshop Thursday, August 27

Common Framework for Earth Observation Data

US IOOS®, NDBC, CO-OPS Partnership Discussion

Presentation transcript:

1 NOAA IOOS Program Data Integration Framework (DIF) Project Overview Adapted from a brief to the NOAA Data Management Committee August 6, 2008 by Jeff de La Beaujardière, PhD NOAA IOOS Program, DIF Sr Systems Architect Ocean Observing Systems Interoperability Planning Workshop August , 2008 Julie Bosch NOAA National Coastal Data Development Center

2 IOOS Subsystems Observing Systems Data Management and Communications (DMAC) Modeling and Analysis = Providers (observing system, data archive) = Customers (decision support tool, analysis tool, generic client) = Providers (products) = Metadata, Data Discovery, Access, Transport, Online Browse, Archive

3 NOAA IOOS Program Components Standards –“adopt a gap” from DMAC –Develop and maintain a process to document, coordinate, evaluate and recommend standards to be applied to IOOS Regions –Invest in Regional Association efforts that contribute to the definition and implementation of IOOS Data Integration Framework (DIF) Project –Conduct a limited-scope implementation of IOOS as a proof of concept and to gather lessons learned to inform the larger IOOS effort

4 Data Integration Framework (DIF) First spiral of IOOS development Focus on 5 core variables –expanded to 7 variables Scope limited to some DMAC functions –access, transport, data discovery Web service approach and standardize on small number of services & encodings –catalog, access, and conversion services –data and metadata encodings Implement at selected data provider & customer sites Evaluate in FY 2010 (Graphic by i3 Aerospace Technologies Pty Ltd – used with permission)

5 DIF Data Provider and Customer Focus Areas Initially working with 3 NOAA data providers –NDBC –CO-OPS –CoastWatch –Expanding to Regional OS data providers Working with 4 customer groups –Harmful Algal Blooms –Coastal Inundation –Hurricane Intensification –Integrated Ecosystem Assessments

6 Recommended Web Services and Data Encodings In-situ data (buoys, fixed station, towed sensors) Gridded data (remotely sensed, model outputs) OGC Sensor Observation Service (SOS) OpenDAP and/or OGC Web Coverage Service (WCS) XML based on OGC Observations and Measurements (O&M) NetCDF using Climate and Forecast (CF) conventions Images of data OGC Web Map Service (WMS) GeoTIFF, PNG etc. -possibly with standardized styles OGC: Open Geospatial Consortium XML: Extensible Markup Language OPeNDAP: Open-source Project for a Network Data Access Protocol NetCDF: Network Common Data Format GeoTIFF: Geospatial Tagged Image File Format PNG: Portable Network Graphics Data TypeWeb ServiceEncoding

7 XML Encoding of In-Situ Data (SOS GetObservation Result) XML Extensible Markup Language Generic method for structuring text data OGC GML Open Geospatial Consortium Geography Markup Language XML that can represent any geospatial feature OGC O&M Observations and Measurements Model GML that describes the act of measuring real-world phenomena and the result of the measurement specialized by Data providers currently beta-testing this specification (

8 DIF Data Provider Status (expected by end of CY2008) Sensor Observation Service NDBC DAC - buoys, C-MAN, VOS, NOS NERRS, etc. IOOS DAC - Regional observations TAO DAC - Tropical Atmosphere Ocean DART DAC - Deep-Ocean Assessment and Reporting of Tsunamis National Water Level Observation Network PORTS® NDBC CO-OPS User Requests Sensor Observation Service High-Frequency Radar (HFR) surface currents Web Coverage Service & OPeNDAP Data Content & Encoding Standards Web Coverage Service & OPeNDAP Satellite Ocean Color (Aqua MODIS, Terra MODIS, SeaWiFS) CoastWatch Data Content & Encoding Standards Data Integrated from One Provider NDBC Data Assembly Centers (DACs) IOOS Variables: temperature, salinity, currents, water level, winds, waves, ocean color (chlorophyll)

9 DIF Data Provider Status - August 2008 CO-OPS Sensor Observation Service (SOS) Experimental IOOS DIF Implementation

10 DIF Data Provider Status - August 2008 National Data Buoy Center PROTOTYPE IOOS Sensor Observation Service

11 Additional Providers & Services IOOS Variables + other variables t.b.d. Single User Request Registry/Catalog Service Data Integration Service NDBC SOS WCS/OPeNDAP CO-OPS SOS Data Archives (NODC?) SOS CoastWatch WCS/OPeNDAP Region 1 SOS Region 2 WCS/OPeNDAP Agency 2 SOS Agency 1 WCS/OPeNDAP Data Integrated from Multiple Providers

12 Next Steps for the DIF (FY2009) GEOSS Architecture Implementation Pilot Interoperability testing Registry & catalog service Metadata (discovery, QA/QC, SensorML) Client components & general-purpose viewer Data translation service Data integration service Additional variables, providers, customers –incl. Regional Coastal Ocean Observing Systems –potential customers in Climate Change and Marine Transportation

13 DIF Service Layers Target for FY2010 Data Providers NOAA Regional Partners Other NOAA DSTs Customers COTS/ GIS General Public Other Services Integration Translation Registry/Catalog Sensor Observation Service Web Coverage Service OpenDAP Web Map Service Access Services

14 DIF Points of Contact Charlie Alexander - Program Manager Marcia Weaks - Customer POC Rebecca Shuford - Customer POC Jeff de La Beaujardière - Technical POC