1 Building the SST Climate Data Record Kenneth S. Casey NOAA National Oceanographic Data Center Seattle, November 2010

2 The National Oceanographic Data Center (NODC) opened its doors on November 1, 1960 with only 29 employees who were tasked with compiling the large, disparate collections of oceanographic data into a single system. A few months later in January of 1961, NODC was formally dedicated by the Asst. Secretary of the Navy for Research and Development, James H. Wakelin, Jr. (pictured) In 1970, NODC was formally transferred from the U.S. Hydrographic Office to the newly formed National Oceanic and Atmospheric Administration (NOAA), under the U.S. Department of Commerce.

Building the SST CDR 3

The Way It’s Been 4 Acronym Soup NOAA SDS (A)RC GHRSST RAN-TAG GCOS SST/SI WG + winds and ice

The Way It’s Been Unorganized Uncoordinated Ad hoc Piecemeal … Yet still productive! Progress on many fronts… 5

GCOS SST Intercomparison 6 Connecting historical in situ and satellite records

GCOS SST Intercomparison 7 Example: Linear trend comparisons –

SQUAM m/index.html 8

GHRSST Data Availability Getting closer for both GAC and HRPT Still no progress

GHRSST Data Availability Complete, but not at LTSRF yet Getting closer for both GAC and HRPT Proposed to NASA ROSES (Vazquez) Plans now in place for reprocessing during

(?) GHRSST Data Availability Pierre LeBorgne Ken Casey and Bob Evans Anne O'Carroll Peter Cornillon, Helen Beggs Andy Harris and Eileen Maturi Jorge Vazquez Andy Harris and Eileen Maturi Chelle Gentemann Chris Metchant Pierre LeBorgne

Now and Into the Future Now… More Coordination Clearer understanding of the interrelated pieces National programs: NOAA Climate Data Record Program (CDRP) and the ESA Climate Change Initiative (CCI). GHRSST RAN-TAG Coordination leading to… 12

The SST ECV Product Framework 13 SST_depth SST_fnd SST_subskin SST_skin L4 L3 L2 L1 L0 CoarseLess Coarse FineFiner

The SST ECV Product Framework 14 L4 L3 L2 L1 L0 CoarseLess Coarse FineFiner >= 25km, monthly 1 km, sub-daily SST_depth SST_fnd SST_subskin SST_skin

SST_depth SST_fnd SST_subskin SST_skin The SST ECV Product Framework 15 L4 L3 L2 L1 L0 CoarseLess Coarse FineFiner Note that not all combinations are possible MW

The SST ECV Product Framework 16 L4 L3 L2 L1 L0 CoarseLess Coarse FineFiner L0 layer is about data access! SST_depth SST_fnd SST_subskin SST_skin

The SST ECV Product Framework 17 L4 L3 L2 L1 L0 CoarseLess Coarse FineFiner Fundamental CDRs Thematic CDRs SST_depth SST_fnd SST_subskin SST_skin

The SST ECV Product Framework 18 L4 L3 L2 L1 L0 CoarseLess Coarse FineFiner User application requirements are fed into the framework SST_depth SST_fnd SST_subskin SST_skin

The SST ECV Product Framework 19 L4 L3 L2 L1 L0 CoarseLess Coarse FineFiner From the framework emanate many user applications SST_depth SST_fnd SST_subskin SST_skin

The SST ECV Product Framework 20 L4 L3 L2 L1 L0 CoarseLess Coarse FineFiner Special emphasis here at the skin SST_depth SST_fnd SST_subskin SST_skin

Clarifying the Connections This model is clarifying the connections and providing the basis for a systematic, sustained, coordinated global effort. Using the SST ECV Framework, the GHRSTS RAN- TAG established a list of prioritized actions necessary to begin piecing together the framework. 21

Piecing it Together GHRST Prioritized List: 1.Begin production of Pathfinder V6, 1981-near present, in GHRSST L2 and L3 format, for GAC and available LAC/HRPT 2.Fix the calibration of AVHRR and AMSR-E to remove latitudinal and other biases before reprocessing of data sets 3.Create MODIS retrospective data in GHRSST format 4.Complete ARC science for ATSR-1 to AATSR 22

Piecing it Together GHRSST Prioritized List: 5.Assign proposed HadSST3 in situ bias adjustments on a per-observation basis to allow incorporation into GHRSST reanalysis products 6.Test and possibly integrate improved AVHRR BTs and/or physical retrieval methods into Pathfinder 7.Create GOES retrospective data in GHRSST format 8.Improve data discovery and access mechanisms at GDAC and LTSRF – Live Access Server and THREDDS Catalog 23

AVHRR Pathfinder 24 SST_depth SST_fnd SST_subskin SST_skin L4 L3 L2 L1 L0 CoarseLess Coarse FineFiner

Pathfinder “Phases” Phase 1Phase 2Phase 3 NOAA/NASA AVHRR Oceans Pathfinder SST Project (Versions 1-4) NOAA-supported Pathfinder SST Program (Version 5) NOAA-supported with targeted NASA funding (Version 6 in preparation)

Current Status of PFV through 2009, 4.6 km Twice-daily, 5-day, 7-day, 8-day, and monthly –FTP –HTTP –OPeNDAP –WCS and WMS via TDS, LAS soon –ttp://ghrsst.nodc.noaa.gov 26 Casey, K.S., T.B. Brandon, P. Cornillon, and R. Evans (2010, in press). “The Past, Present, and Future of the AVHRR Pathfinder SST Program”, in Oceanography From Space, Revisited, eds. V. Barale, J.F.R. Gower and L. Alberotanza, Springer.

/85 Specially-Handled Insufficient buoys, so quality-controlled ICOADS ship observations are used –Bias-corrected by subtracting 0.14 K (empirically determined) –Extreme values eliminated –Noise reduced through smoothing Resulted in a five-fold increase in number of matchups and coverage similar to NOAA-14 period Matchups then used in the standard PFV5 coefficient estimation routines (5-month sliding windows) The large cool bias seen in March late 1983 was largely removed 27

Pathfinder Improves Over Operational 28 Operational – HadSST2 (Daytime) PFV5 – HadSST2 (Daytime) PFV5 – HadSST2 (Nighttime) Operational – HadSST2 (Nighttime) Satellite – In Situ (ºC)

Pathfinder Improves Over Operational 29 Operational – HadSST2 (Daytime) PFV5 – HadSST2 (Daytime) Satellite – In Situ (ºC)

Pathfinder Improves Over Operational 30 PFV5 – HadSST2 (Nighttime) Operational – HadSST2 (Nighttime) Satellite – In Situ (ºC)

Pathfinder During El Niño 31 SST Anomaly (ºC) December , 1982

Harmonic Climatology is More Robust PFV5 quality=7, day and night, day averages SST clim =Acos(2πt + B) + Ccos(4πt + D) + E Reject where n < 100 Median-fill Fill remaining gaps with “classic” climatology (typically ice prone regions) 32

Harmonic Climatology is More Robust 33 Classic Fails Harmonic Succeeds PFV5 quality=7, day and night, day averages SST clim =Acos(2πt + B) + Ccos(4πt + D) + E Reject where n < 100 Median-fill Fill remaining gaps with “classic” climatology (typically ice prone regions)

Climatology Benefits from Added Years 34 Good Failed to converge Less than 100 No Data Land

Pathfinder Still Being Improved! 35 Operational – HadSST2 (Daytime) PFV5 – HadSST2 (Daytime) PFV5 – HadSST2 (Nighttime) Operational – HadSST2 (Nighttime) Satellite – In Situ (ºC) Seasonal and latitudinal patterns being addressed with “LATBAND” coefficients Plus improvements to reference field, land masks, spatial binning, and GHRSST-compliance

PFV6 Workflow Overview 36 L1B AVHRR SeaDAS code base Winds, sea ice, aerosols Quality Assurance PFV6 L2P L3U L3C netCDF PFV6 L2P L3U L3C netCDF GHRSST Generator Archive, Data Access and User Services Climatologies + Products Coefficient Generator

Detailed PFV6 Workflow GAC files in CLASS L1B GAC files on local server Order and download GAC file list & aci.sh mkctrlfile s.pl aci.sh aci Radiance Files Geolocation Files aciseg.sh (whole date day) GAC, seg files aciseg Ancillary data: Reference SST 10m winds Sea ice Aerosol l2gen_both.sh l2gen_both par files & l2gen_both. sh mkl2gen_both.parf ile.pl L2P Ascending netCDF (merged ) L2 P Descending netCDF(merged) L3C Descending netCDF L3 C Ascending netCDF segRevise.pl Updated seg files with merging info conv_hdf_nc_ L2P l2p_proc. pl L2 HDF products l3c_proc.pl conv_hdf_nc_ L3C par files & l2bin_both.s h mkl2bin_both.parf ile.pl L3 HDF products file list descending file list ascending L3 binned Descending HDF L3 binned Ascending HDF L3C smi Descending HDF L3C smi Ascending HDF smigen _both createl3bin.pl L3U smi HDF L3U Ascending netCDF L3U Descending netCDF l3c_proc.pl conv_hdf_nc_ L3C l3u_proc.pl conv_hdf_nc_ L3U l2bin_both. sh l2bin_both l3bin_both. sh l3bin_both l3bin_both. sh l3bin_both

Coming up… 38 Details on the algorithm improvements in PFV6 in the presentation by Bob Evans Questions?