Information, data servers and data products for the Pacific regional association J. Potemra briefing to Z. Willis, UH Manoa, July 2009.

Slides:



Advertisements
Similar presentations
ECOOP Data Management System (T2.2/WP2) Declan Dunne 13 th February 2008, Athens.
Advertisements

The Model Output Interoperability Experiment in the Gulf of Maine: A Success Story Made Possible By CF, NcML, NetCDF-Java and THREDDS Rich Signell (USGS,
GEOSS Water Services for Data and Maps Community Recommendations David K. Arctur, Project Lead, GEOSS AIP-6 Water SBA University.
Spatial Data Infrastructure: Concepts and Components Geog 458: Map Sources and Errors March 6, 2006.
Integrating NOAA’s Unified Access Framework in GEOSS: Making Earth Observation data easier to access and use Matt Austin NOAA Technology Planning and Integration.
PacIOOS Stakeholders Workshop Developing The Hawaii Ocean Observing System (HiOOS) One-stop-shop for Ocean information Chris Ostrander, PacIOOS Director.
The SouthEast Coastal Ocean Observing SECOORA Meeting Regional Association (SECOORA) June 11-12, 2007 SECOORA Data Management and Communications SECOORA.
Integrated Ocean Observing System Data Management and Communications March 2004 The US Integrated Ocean Observing System (IOOS) Plan for Data Management.
SURA Coastal Ocean Observing and Prediction (SCOOP) Program Philip Bogden CEO, GoMOOS Director, SCOOP Program at SURA Southeastern Universities Research.
Climate Change: Temperature and Coral Reefs. Climate Change Weather vs. Climate Weather: day to day changes in temperature, rainfall, cloudiness, moisture.
U.S./European Partnerships in Coastal Atlases and Coastal/Ocean Informatics Coastal Zone 2007 – Portland, Oregon National Coastal Zone Management Community.
U.S. Department of the Interior U.S. Geological Survey U.S. National Water Census “Cyber – Platform” Update Progress and challenges to overcome in realizing.
Steve Rutz NOAA/NESDIS National Oceanographic Data Center NODC Observing Systems Team Leader June 21, 2011.
Unidata TDS Workshop THREDDS Data Server Overview October 2014.
Serving society Stimulating innovation Supporting legislation Meeting on OGC Sensor Observation Service (SOS) for INSPIRE Mickael.
V. Chandrasekar (CSU), Mike Daniels (NCAR), Sara Graves (UAH), Branko Kerkez (Michigan), Frank Vernon (USCD) Integrating Real-time Data into the EarthCube.
Tsunami Warning System Elements IOC Assessment Mission to Indonesia 29 August-1 September 2005.
From Data Integration to Integrated Solutions Tom Shyka, GMRI Paul Currier, NH DES Water Quality Workshop MACOORA - NERACOOS -SECOORA IOOS, USGS, EPA,
Implementation of Model Data Interoperability for IOOS: Successes and Lessons Learned Rich Signell USGS Woods Hole, MA / NOAA Silver Spring USA Model Data.
Observing System Monitoring Center Integrating data and information across observing system networks.
Bringing it All Together: NODC’s Geoportal Server as an Integration Tool for Interoperable Data Services Kenneth S. Casey, Ph.D. YuanJie Li NOAA National.
2 3 ROMS/COAWST NcML file 4 5 Exploiting IOOS: A Distributed, Standards-Based Framework and Software Stack for Searching, Accessing, Analyzing and.
Unidata TDS Workshop TDS Overview – Part I XX-XX October 2014.
IOOS DMAC Meeting Regional Association Discussion IOOS PO May 2015.
U.S. Department of the Interior U.S. Geological Survey Management of Oceanographic time-series data at the Woods Hole Coastal and Marine Science Center.
IODE Ocean Data Portal - technological framework of new IODE system Dr. Sergey Belov, et al. Partnership Centre for the IODE Ocean Data Portal MINCyT,
Tools in Support of a National DMAC Derrick Snowden NERACOOS/ODP Annual Meeting 26 Sep 2012.
DMAC: Infrastructure to enable delivery of IOOS ® information Presentation to the IOOS Advisory Committee Derrick Snowden, System Architect, U.S. IOOS.
Unidata and Oceanography Through the Ages Rich Signell USGS Coastal and Marine Science Center Woods Hole, MA & NOAA Integrated Ocean Observing System (IOOS)
1 Global Systems Division (GSD) Earth System Research Laboratory (ESRL) NextGen Weather Data Cube Chris MacDermaid October, 2010.
Integrated Model Data Management S.Hankin ESMF July ‘04 Integrated data management in the ESMF (ESME) Steve Hankin (NOAA/PMEL & IOOS/DMAC) ESMF Team meeting.
1 NOAA IOOS Program Data Integration Framework (DIF) Project Overview Adapted from a brief to the NOAA Data Management Committee August 6, 2008 by Jeff.
THEME[ENV ]: Inter-operable integration of shared Earth Observation in the Global Context Duration: Sept. 1, 2011 – Aug. 31, 2014 Total EC.
NODC ↔ Data Consumers Steve Rutz NOAA/NESDIS National Oceanographic Data Center NODC Observing Systems Team Leader June 21, 2011.
Building a Web-based GIS Portal For the Great Lakes Observing System (GLOS) Pete Giencke Program Specialist Data and Information Management.
Modeling & Forecasting Breakout Group Input to SECOORA Business Plan (Jacksonville, July 27-28, 2005) ‏
Opendap dev - meeting, Boulder, Feb 2007 OPeNDAP infrastructure in European Operational Oceanography T Loubrieu (IFREMER) T Jolibois (CLS)
1ECOOP Plenary Meeting Athens 2008 EUROMISS EUROpean Marine Information System of Systems S Pouliquen, Thomas Loubrieu ECOOP plenary meeting.
Unidata TDS Workshop THREDDS Data Server Overview
ResEau: A Water Portal SensorWeb Implementation National Information Strategies Division Strategic Information Integration Directorate Environment Canada.
SensorGrid Galip Aydin June SensorGrid A flexible computing environment for coupling real-time data sources to High Performance Geographic Information.
IODE Ocean Data Portal - ODP  The objective of the IODE Ocean Data Portal (ODP) is to facilitate and promote the exchange and dissemination of marine.
THE USE OF OPEN GEOSPATIAL SOFTWARE IN SOPAC FOR DIGITAL ACHIVING OF MARINE INFORMATION The Late Brian Bishop- Project Initiator Keleni Raqisia – Geonetwork.
U.S. Integrated Ocean Observing System (IOOS ® ) IOOS ® Biological Observations Data Project A Multi-Agency Effort to Enable Access to Biological Observations.
RAINEX Data Management UCAR Joint Office for Science Support José Meitín Jim Moore Dick Dirks UCAR Joint Office for Science Support José Meitín Jim Moore.
REMUS AUV Jennifer Patterson HIOOS Workshop June 23, 2009.
A Collaborative Effort. IOOS – National Ocean Observing.
E2E Spatial Infrastructures The South Esk Hydrological Sensor Web Andrew Terhorst Project Lead: Real-Time Water Information Systems 6 December 2010 Water.
UAF/OSMC Presenters: Kevin O’Brien and Eugene Burger Abstract: Kevin O’Brien and Eugene Burger are from NOAA’s Pacific Marine Environmental Laboratory.
1-2-3 February 2006 –Page 1 Mersea Integrated System How to improve Access/Downloading services ? How far do we go in terms of standardization ?
International Data Exchange Workshop, Hotel Birke, Kiel, May 9-11, 2007 Benoît Pirenne, NEPTUNE Canada, Victoria, BC NEPTUNE Canada Fresh from the sea.
Tools for Monitoring in Coastal Alaska and the Arctic Darcy Dugan Alaska Ocean Observing System.
1 of 37 Next Steps SOS DescribeSensor implementation (SensorML) Testing/evaluation/refinement of existing work Build or borrow needed components … Reference.
Jeff de La Beaujardière, PhD NOAA Sr System Architect, IOOS Program Office DAARWG Meeting Silver Spring, Integrated Ocean Observing System (IOOS)
Role of Technical Agencies Responsible for Hazard Assessment, Monitoring, Observations, Data and Analysis Dr. David Green National Oceanic and Atmospheric.
HSRP Strategic Effectiveness Sub-Committee Proposed Focus and Scope Members: –Dr. David Jay, Portland State University –Dr. Michelle Dionne, Wells National.
U.S. INTEGRATED OCEAN OBSERVING SYSTEM DATA ACCESS SERVICES Coastal Geotools: Advances in Federal Data Access Services Hassan Moustahfid, Chris Duncombe.
Access to IOOS Data Relevant to OOI Kathleen Bailey NOAA/NOS/IOOS January 6, 2016.
Future needs and plans for ocean observing in the Arctic AOOS Arctic Town Hall Futur Zdenka Willis Integrated Ocean Observing System National Program Office.
1 2.5 DISTRIBUTED DATA INTEGRATION WTF-CEOP (WGISS Test Facility for CEOP) May 2007 Yonsook Enloe (NASA/SGT) Chris Lynnes (NASA)
GO-ESSP The Earth System Grid The Challenges of Building Web Client Geo-Spatial Applications Eric Nienhouse NCAR.
NOAA EDMC Ocean Observatories Initiative Cyberinfrastructure Karen Stocks OOI CI Data Curator University of California, San Diego Ocean Observatories.
Sensor Web Enablement (SWE) developments for fixed monitoring platforms and research vessels By Dick M.A. Schaap – SeaDataNet Technical Coordinator with.
IODE Ocean Data Portal - technological framework of new IODE system Dr. Sergey Belov, et al. Partnership Centre for the IODE Ocean Data Portal.
Developing a National Plan for Glider Operations: Data Management
US IOOS®, NDBC, CO-OPS Partnership Discussion
Eoin Howlett ASA, MARACOOS
About Thetus Thetus develops knowledge discovery and modeling infrastructure software for customers who: Have high value data that does not neatly fit.
21 November Data Science Capabilities
Presentation transcript:

Information, data servers and data products for the Pacific regional association J. Potemra briefing to Z. Willis, UH Manoa, July 2009

PacIOOS Development PacIOOS focus is development of Regional Association for the region HIOOS focus is as a pilot project for PacIOOS Designed around component systems Data management is one component, but a cross- cutting one Data management needs, capacity and requirements are very different between Hawaii and larger Pacific region

Catalyst Project 4: Marine Ecosystems Catalyst Project 2: Coastal Resiliency Catalyst Project 3: Water Quality Catalyst Project 1: Ocean state forecast Sensor 1Sensor 2 Sensor n Observing System Component 1 Product m Product 3 Product 2 Product 1 User group 1 research User group 2 education User group 3 planning User group 4 operational User group 5 general Modeling System Sensor 1Sensor 2 Sensor n Observing System Component n Sensor 1Sensor 2 Sensor n Observing System Component 2 Observing ArrayProductsProjectsUser Groups

Catalyst Project 4: Marine Ecosystems Catalyst Project 2: Coastal Resiliency Catalyst Project 3: Water Quality Catalyst Project 1: Ocean state forecast Sensor 1Sensor 2Sensor n Observing System Component 1 Product m Product 3 Product 2 Product 1 Modeling System Sensor 1Sensor 2Sensor n Observing System Component n Sensor 1Sensor 2Sensor n Observing System Component 2 Observing ArrayProductsProjects Role of “PI’s” is to: 1.design and develop this system; 2.provide a scientifically q/c’d data stream to the Data Management System

Product m Product 3 Product 2 Product 1 User group 1 research User group 2 education User group 3 planning User group 4 operational User group 5 general ProductsUser Groups Role of Education/Outreach (and really everyone): 1.Identify users 2.Identify useful products 3.Identify preferred form and format of product delivery

Catalyst Project 4: Marine Ecosystems Catalyst Project 2: Coastal Resiliency Catalyst Project 3: Water Quality Catalyst Project 1: Ocean state forecast Sensor 1Sensor 2 Sensor n Observing System Component 1 Product m Product 3 Product 2 Product 1 User group 1 research User group 2 education User group 3 planning User group 4 operational User group 5 general Modeling System Sensor 1Sensor 2 Sensor n Observing System Component n Sensor 1Sensor 2 Sensor n Observing System Component 2 Observing ArrayProductsProjectsUser Groups Role of Data Management: 1.Archive data 2.Provide networking infrastructure for product delivery  links between boxes

Role of data management PacIOOS (HIOOS) is being developed as an end-to- end system --> data issues are multi-faceted Instrument to shore Disk storage to scientist Data servers allowing web access to users Data servers to client software Data to data products User-driven data products will be critical in the region

1. Instrument to shore Cell phone modem, IRIDIUM, direct connect 2. Disk to scientist ftp, copy, OPeNDAP 3. Web access to users LAS, Dchart, ERDDAP 4. Binary access (data server to client s/w) OPeNDAP, SOS 5. Data to data product…..

Data Management Tenets Meta data Data archive Data discovery Data browse Data transport (data delivery); binary access

PacIOOS vs HIOOS Both limited by data of appropriate scales Pacific region more climate-related, long-term, planning/management issues Hawaii wants real-time and forecast, high spatial resolution data; rapid access There are data sets in the Pacific region, but not cataloged, easily accessible Metadata Data discovery Data archive Hawaii, on the other hand Data delivery

Issues Data by itself is not a product; a product in the IOOS context fuses data and knowledge Goal is operational system; role of research can thus be in product development (among other things, e.g., system design and development) Identify users Identify desired products Identify desired formats (delivery method) Data Management system will provide the solution

Challenges Drastically different data streams; servers could depend on data types (biological data, video, etc.) Starting close to zero Customers, delivery mechanisms largely unknown Many data sources Creativity in producing data products Provide model-data interface Operational 24/7? Resources in terms of appropriate technical skills

Plan Web services for information Traditional web pages Data product dissemination Providing access to data via data servers Data archiving Raw storage of data Data servers (IOOS “standards”) Web-based browsing tools OPeNDAP WCS for gridded data SOS for point/non-gridded data

Data & Products HIOOS Assets, observations, models, data servers, maps

Featured Products

HiOOS Data Streams ComponentLocation/instVariablesData streams Near-shore sensorsNS-01 (WYC)T, s, chl, turbKilo NaluPD NS-02 (HYC)T, s, chl, turbKilo NaluPD NS-03 (Waikiki)T, s, chl, turbP Kilo Nalu10m siteT, sKilo Nalud 10m T-chainTKilo Nalud 10m ADCPcurrentsKilo Nalu (3 mon) d 10m FLNTwater qualKilo Nalu (4/09)Pd 20m T-chainTKilo Nalud 20m ADCPcurrentsKilo NaluPd Wave buoy?wavesKilo NaluP Water QualityWQB-AWT, s, chl, turbIntSenP WQB-KNT, s, chl, turbIntSenP Event Response

HiOOS Data Streams (cont’d) ComponentLocation/instVariablesData streams Ocean GlidersSG-114 (2 mission)T,s,currentsSOESTD SG-139 (4 mission) T,s,currentsSOESTD HF RadiosBarber’s Pointcurrents Kaka’akocurrents Koko Headcurrents Coastal resiliencyWaikikitopo Waimeatopo Makapu’utopo Kaka’akotopo Acoustic tracking Acoustic monitoring A

HiOOS Data Streams (cont’d) ComponentLocation/instVariablesData streams Waves/water levelWB-106 (Waimea) wavesCDIPP WB-098 (Mokapu) wavesCDIPP WB-146 (Lanai)wavesCDIPP Tide gauge (8)Sea levelUHSLCPD Camera (Waimea)UHSLCP Camera (Waikiki)UHSLCP Models (atm)Pacificwind, rain, THIOOSD Hawaiian Islandswind, rain, THIOOSPD Models (wave)PacificwavesOREP Hawaiian IslandswavesOREP South ShorewavesOREP

HiOOS Data Streams (cont’d) ComponentLocation/instVariablesData streams Models (ocn)Pacific (NRL)T, s, curr, clevAPDRCPD Hawaii Isle (ROMS) T, s, curr, clevHIOOSPD Tidescurr, clevAPDRCPD

Data Products (example 1)

Data Products (example 2)

Data Servers OPeNDAP GDS TDS Visual browse LAS DCHART (google map) DCHART(google map) OGC WMS WCS