Observing System Monitoring Center (OSMC) Status Update April 2005 Steve Hankin – PMEL (co-PI) Kevin Kern – NDBC (co-PI)

… to provide a system view of global ocean climate observations

Systems View of the OSMC Live Access Server to provide web browser access & data visualization OSMC servers will store metadata for display and analysis. Data and metadata pulled from various sources. Analysts and Researchers DODS GODAE NCEP NDBC etc. PMEL

A partnership … PMEL User interface logic & tools PMEL User interface logic & tools NDBC Data assembly & operations NDBC Data assembly & operations & assistance from Todd Pearce (OCO) User interface layout

OSMC Schematic View NDBC Firewall NASA Firewall

OSMC (meta)database What is the “climate data record”? Current (meta)data (“realtime”) Current (meta)data (“realtime”) – GTS -- primary source Historical (meta)data Historical (meta)data – poorly integrated – need “DMAC” integration – for now … use a GTS archive (misses e.g. NOAA research cruises)

OSMC (meta)database at NDBC Met and Ocean surface data are updated daily with GODAE “T-files” (06, 12, 18, 24) from the previous day ~350 MB of data per day Met and Ocean surface data are updated daily with GODAE “T-files” (06, 12, 18, 24) from the previous day ~350 MB of data per day URL= Updates applied to NDBC-hosted time series metadata from NDBC system Updates applied to NDBC-hosted time series metadata from NDBC system Ship call sign info from the WMO Pub 47 Ship call sign info from the WMO Pub 47

OSMC (meta)database at NDBC Profiling float data from US GODAE Server Profiling float data from US GODAE Server Float updates from JCOMMOPS Float updates from JCOMMOPS URL = ftp://ftp.jcommops.org/Argo/Status/status.txt ftp://ftp.jcommops.org/Argo/Status/status.txt Country information is assigned based on WMO allocation table Country information is assigned based on WMO allocation table URL =

OSMC (meta)database at NDBC Met and surface ocean database back to June ‘04 Met and surface ocean database back to June ‘04 Profile data back to January ‘04 Profile data back to January ‘04 Platform Type # Observations ARGO FLOAT5,4326 CMAN794,262 DRIFTING BUOY4,447,127 MOORED BUOY2,066,686 SHIP682,757 NOT DEFINED934,451

OSMC Database – Entity Diagram Country is based on ISO 3166, which defines unique 2-character identifiers for each country Organization identifies an agency, institute, university, or private company that owns or operates a reporting platform Platform identifies a ship, drifting buoy, moored buoy station, or other platform that reports marine data Observation records the instance of a marine observation for a reporting date and time.

OSMC Database Environment Dell PowerEdge 2650 Dell PowerEdge 2650 – Dual Processor 3.06 GHz/1MB Cache – Five 146 GB Harddrive – Red Hat Enterprise Linux ES v3 Oracle Database Oracle Database

OSMC (meta)database Gridded files Observation metadata are summarized into 1X1 degree gridded files (netCDF) to support evaluation operations Gridded files Observation metadata are summarized into 1X1 degree gridded files (netCDF) to support evaluation operations

OSMC Database – Architecture

OSMC must provide: OSMC must provide: Overview (where are the obs?) Overview (where are the obs?) Drill-down (what are the obs?) Drill-down (what are the obs?) Evaluation (are the obs adequate?) Evaluation (are the obs adequate?)

User interface & tools for evaluation Web-accessible to the community

Visualization & evaluation Overview all platforms reporting today

Visualization & evaluation Overview all platforms reporting air temp. today

all platforms reporting SST today Visualization & evaluation Overview

all platforms reporting SST today colored by age Visualization & evaluation Overview

Drifters reporting SST today Visualization & evaluation Overview

U.S. drifters reporting SST today Visualization & evaluation Overview

U.S. drifters reporting SST this week Visualization & evaluation Overview

U.S. Pacific drifters reporting SST this week Visualization & evaluation Overview U.S. Pacific drifters reporting SST this month

mouse click for metadata summary Visualization & evaluation Drill Down

mouse click to view data Visualization & evaluation Drill Down

mouse click to view plot Visualization & evaluation Drill Down

User interface & tools for evaluation Overview (where are the obs?) Overview (where are the obs?) Drill-down (what are the obs?) Drill-down (what are the obs?)  Evaluation (adequacy of the observations)  Evaluation (adequacy of the observations)

Number of platforms per 1x1 degree box reporting SST today Visualization & evaluation

Number of platforms per 1x1 degree box reporting SST this week Visualization & evaluation

Number of platforms per 1x1 degree box reporting SST this month Visualization & evaluation

Number of platforms per 5x5 degree box reporting SST this month Visualization & evaluation

5x5 degree boxes this month that had one or more SST obs every day Visualization & evaluation

Percentage of days when a 5x5 degree box had at least 5 SST obs Visualization & evaluation

Percentage of days when a 5x5 degree box had at least 5 air temp obs Visualization & evaluation Evaluation

Click for time series record of SST obs in a single 5x5 grid cell Visualization & evaluation

Click for time series record of SST obs in of an ocean basin Visualization & evaluation

Click for global time series of SST obs Visualization & evaluation

OSMC LAS The OSMC doesn’t look like a Live Access Server … but it is (Shown is the more traditional LAS user interface)

“Adopt-a-Drifter” is another specialized user interface to the same OSMC server

Ready for integration into NVODS, DMAC, and IOOS

Ocean CO 2 data access with LAS

Next steps Wire it together robustly (It is not as mature as it appears) Wire it together robustly (It is not as mature as it appears) Improve performance Improve performance User interface make-over (w/Todd Pearce ) User interface make-over (w/Todd Pearce ) Full support for profile data Full support for profile data Bring NGDC/NOSA GIS efforts into the partnership Bring NGDC/NOSA GIS efforts into the partnership

Next steps (database) Improve Meta-data quantity and quality Improve Meta-data quantity and quality – Eliminate “Not Defined” platforms Further coordinate with JCOMM OPS Further coordinate with JCOMM OPS – Add organization URLs Expand data sources Expand data sources – Carbon Data – NOAA High Resolution Ship Data (FSU) – Repeat Lines, Ocean Reference Stations, …

and after that … Other types of data (biochem, fisheries, …) Other types of data (biochem, fisheries, …) IOOS/DMAC integration (satellites, models, GIS, …) IOOS/DMAC integration (satellites, models, GIS, …) Quality control metadata Quality control metadata Expanded evaluation metrics Expanded evaluation metrics to be guided by community input …

Suggestions? Questions?