SCD Research Data for Ocean Observatories Steering Committee June 18, 2001 Steven Worley Scientific Computing Division Data Support Section

Outline Archive Basics Data Services Three Examples

History Began in 1960’s –Leadership by Roy Jenne Grown for 35+ years –Virtually NO data has been lost Dedicated stewards and reliable MSS –User community greatly expanded UCAR, Gov. Agencies, National and International Projects

People 9.2 FTE today –Manager, Admin., and 7.2 general staff –All staff are educated in meteorology or oceanography, MS and Bachelor degrees

Philosophy Get the required data Organize, check, and preserve Provide access –diverse collection –users skills, highly variable

Archive Collection 500+ distinct datasets 14 Terabytes on the MSS “All sizes, shapes, and formats”

Archive Collection Atmospheric and Oceanic in situ Observations Atmospheric and Oceanic Remotely Sensed Observations Operational Weather Center Analyses Global Atmospheric Renalyses Oceanographic Reanalyses Atmospheric Regional Model Output Oceanic Model Output High Altitude Scatter Radar Data Ancillary Datasets

How do people find out about the archive? Online information system –1000+ web pages and FTP server –Each dataset has a web page Discovery metadata File names for MSS files Links to other relevant WWW sites Software and descriptions Some datasets have data online Some datasets have order request forms –Other resources Catalogs, software libraries, project descriptions, etc

Unique Individuals Getting Data Service, 2000 University users from the MSS 281 NCAR users from the MSS 110 DSS + others from the MSS 39 Web/FTP access to permanently online data ?? Customized orders, via tape or FTP 362 CD-ROMS 124 Total 916

Data Relevant to Ocean Research WODB and WOA 1998, Levitus et al. –Other products; high res. T and S, MLD, annual temperature and heat content anomalies SST analyses –Reynolds et al., weekly, monthly, climatology –Hadley Centre, GISST, and HADISST Surface Forcing, air-sea interaction –Operational weather center analyses, NCEP, ECMWF –Reanalyses, NCEP, ECMWF (forthcoming ERA) –Heat Budgets, e.g. Josey, Oberhuber, da Silva, etc Surface Observations –COADS –Surface winds; scatterometers

Data Relevant to Ocean Research Special Collections –JGOFS sites, Nutr., Chlor., PP etc –TOGA COARE, atmosphere and ocean –Sea Ice –Tropical Pacific sea surface salinity, –Coastal T and S time series - MEDS and Scripps –Ocean Station Vessels, (A through Z) –Pacific Ocean island rainfall and global precip. characteristics form ships.

Three Service Examples Marine Surface Observations –COADS QSCAT winds + NCEP Analyses Ocean model output –RSMAS MICOM

COADS Co-developer and Co-PI with NOAA since 1980’s Marine surface dataset, Includes, merchant ships, WODB, TOA, Pirata, drifting buoys, etc. –(both GTS and delayed data are used) Funded upcoming improvements –NOAA NCDC, COADS real time ASCII data –Better quality control –Collect and organize ship and buoy metadata –Higher level products, e.g. monthly wave summaries

COADS Future data additions –Retrospective data Russian R/V data ( ) –6 million records U.S. Met. Journal Collection ( ) –1.8 million records –Modern data ARGO float data –GTS real time and delayed QC’ed data

COADS Data Distribution –All products from the MSS Absolutely up to date –SCD distributes Binary and ASCII formats –Automatic processes prepare the subsets 80 outside requests in 2001 –NOAA distributes netCDF format

Scatterometer winds ESA ERS-1 and ERS-2 – NASA NSCAT – , 9-months, lost in space NASA QSCAT, Level 2B, 25km resolution –July 1999, continuing –Two retrieval method product lines JPL, official NASA release RSS (Remote Sensing Systems), KU-2000 algorithm

Data handling and product development Collaborative effort with CoRA –Get and prepare the data (SCD) –Product comparisons (CoRA) –Product development (CoRA) –Archive products and redistribute (SCD) Example, wind stress curl

NCEP Operational Analysis, 01/24/ UTC Wind stress curl, + = red, - = blue

NCEP with QSCAT overlay, Wind stress curl, + = red, - = blue

NCEP QSCAT Blend, Wind stress curl, + = red, - = blue, Chin et al. 1998

Statistics are good –More details: research.com/~morzel/qscat.curl.miami2 001.htmlwww.colorado- research.com/~morzel/qscat.curl.miami2 001.html 18-month time series, curl, U and V –6 hourly interval –.5x.5 resolution –available to all from the MSS –time series will be extended “We like to help promote leading edge science in this way”

Ocean Model Output High resolution runs of RSMAS MICOM model –wind forcing, two cases; COADS and ECMWF –Access for Outside users Annual mean fields all online, web access Raw data via request forms and automatic offline processing –Large collections, 300 GB, and 100 GB

MICOM Ocean Data Metadata Page –General description –Links to online data (annual mean fields) –Links to Authors websites –Order request forms Automated process accesses the MSS files and create subset. –Data, software, documentation all provided via FTP download by the user.

MICOM Ocean Data “ Help scientists preserve their archives and facilitate exchange with collaborators and public in general”

Finale Traditional access Additional access for the future “Community Data Portal” Real time display, subsetting, analysis, and data downloads