Analyzed Data Products Available from NCAR that Support Marine Climate Research JCOMM ETMC-III 9-12 February 2010 Steven Worley Doug Schuster.

Slides:



Advertisements
Similar presentations
Use of VOS data in Climate Products Elizabeth Kent and Scott Woodruff National Oceanography Centre, Southampton NOAA Earth System Research Laboratory.
Advertisements

Data management in SCD Steven Worley General Categories –The Mass Storage System –NCAR user file services (home directories) –Computer attached storage.
New Resources in the Research Data Archive Doug Schuster.
Experiments with Monthly Satellite Ocean Color Fields in a NCEP Operational Ocean Forecast System PI: Eric Bayler, NESDIS/STAR Co-I: David Behringer, NWS/NCEP/EMC/GCWMB.
ICOADS Archive Practices at NCAR JCOMM ETMC-III 9-12 February 2010 Steven Worley.
Atmospheric Reanalyses Update Mike Bosilovich. ReanalysisHoriz.ResDatesVintageStatus NCEP/NCAR R1T present1995ongoing NCEP-DOE R2T present2001ongoing.
The Research Data Archive at NCAR Doug Schuster and Steve Worley NCAR.
THE BEST ANALYZED AIR- SEA FLUXES FOR SEASONAL FORECASTING 2.12 Glenn H. White, W. Wang, S. Saha, D. Behringer, S. Nadiga and H.-L. Pan Global Climate.
My Agenda for CFS Diagnostics Ancient Chinese proverb: “ Even a 9-month forecast begins with a single time step.” --Hua-Lu Pan.
Using Scatterometers and Radiometers to Estimate Ocean Wind Speeds and Latent Heat Flux Presented by: Brad Matichak April 30, 2008 Based on an article.
The NCEP operational Climate Forecast System : configuration, products, and plan for the future Hua-Lu Pan Environmental Modeling Center NCEP.
The International Surface Pressure Databank (ISPD) and Twentieth Century Reanalysis at NCAR Thomas Cram - NCAR, Boulder, CO Gilbert Compo & Chesley McColl.
Operational Dataset Update Functionality Included in the NCAR Research Data Archive Management System 1 Zaihua Ji Doug Schuster Steven Worley Computational.
Data assimilation of polar orbiting satellites at ECMWF
Scientific Investigations; Support from Research Data Archives for Computing in Atmospheric Sciences October, 2001 Steven Worley National Center.
U.S. Surface Archives Sent to China ( ) 7 th PRC-U.S. Joint Coordination Panel for Data and Information Cooperation 29 Nov. – 1 Dec, 2000 Steven.
October 16-18, Research Data Set Archives Steven Worley Scientific Computing Division Data Support Section.
EGU 2011 TIGGE, TIGGE LAM and the GIFS T. Paccagnella (1), D. Richardson (2), D. Schuster(3), R. Swinbank (4), Z. Toth (3), S.
Research Data at NCAR 1 August, 2002 Steven Worley Scientific Computing Division Data Support Section.
Growing and Future Datasets in the SCD Research Data Archives for NSF SCD Review Panel 16 October 2001 Steven Worley Scientific Computing Division Data.
Data for Climate and Energy Studies Steven Worley Computational and Information Systems Laboratory NCAR.
Applications and Limitations of Satellite Data Professor Ming-Dah Chou January 3, 2005 Department of Atmospheric Sciences National Taiwan University.
Collaborative Research: Toward reanalysis of the Arctic Climate System—sea ice and ocean reconstruction with data assimilation Synthesis of Arctic System.
Scientific Investigations; Support from Research Data Archives for Joint Office for Science Support 26 February, 2002 Steven Worley SCD/DSS.
A Comparison of the Northern American Regional Reanalysis (NARR) to an Ensemble of Analyses Including CFSR Wesley Ebisuzaki 1, Fedor Mesinger 2, Li Zhang.
Data to Support Ocean-Atmosphere Research NCAR Research Data Archive (RDA), Zaihua Ji, NCAR Steven Worley, NCAR Scott Woodruff,
Dataset Development within the Surface Processes Group David I. Berry and Elizabeth C. Kent.
Archive and Access Practices that Support Data Reuse and Transparency Steven Worley Doug Schuster Bob Dattore National Center for Atmospheric Research.
Data Access to Marine Surface Observations and Products from COADS 29 January, 2002 Steven Worley National Center for Atmospheric Research.
Reanalysis: When observations meet models
All about DATASETS Description and Algorithms Description and Algorithms Source Source Spatial and temporal Resolutions Spatial and temporal Resolutions.
Modern Era Retrospective-analysis for Research and Applications: Introduction to NASA’s Modern Era Retrospective-analysis for Research and Applications:
1 Motivation Motivation SST analysis products at NCDC SST analysis products at NCDC  Extended Reconstruction SST (ERSST) v.3b  Daily Optimum Interpolation.
Data Discovery and Access to The International Surface Pressure Databank (ISPD) 1 Thomas Cram Gilbert P. Compo* Doug Schuster Chesley McColl* Steven Worley.
Content, Discovery, and Accessibility Enhancements to the NCAR Research Data Archive Doug Schuster and Steve Worley NCAR.
Introduction to CMUG assessments, SST and plans for phase 2 Roger Saunders 4 th Integration Meeting.
Using satellite data to understand uncertainties in reanalyses: UERRA Richard Renshaw, Peter Jermey with thanks to Jörg Trentmann, Jennifer Lenhardt, Andrea.
TIGGE Data Archive and Access at NCAR November 2008 November 2008 Steven Worley National Center for Atmospheric Research Boulder, Colorado, U.S.A.
An evaluation of satellite derived air-sea fluxes through use in ocean general circulation model Vijay K Agarwal, Rashmi Sharma, Neeraj Agarwal Meteorology.
NOAA’s Climate Prediction Center & *Environmental Modeling Center Camp Springs, MD Impact of High-Frequency Variability of Soil Moisture on Seasonal.
TIGGE Data Archive at NCAR 8th GIFS-TIGGE Working Group World Meteorological Organization Geneva February, 2010 Doug Schuster Steven Worley Dave.
CTB computer resources / CFSRR project Hua-Lu Pan.
1. Analysis and Reanalysis Products Adrian M Tompkins, ICTP picture from Nasa.
The TIGGE Model Validation Portal: An Improvement in Data Interoperability 1 Thomas Cram Doug Schuster Hannah Wilcox Steven Worley National Center for.
Ocean Surface heat fluxes Lisan Yu and Robert Weller
TIGGE Archive Status at NCAR THORPEX Workshop and 6th GIFS-TIGGE Working Group Meetings WMO Headquarters Geneva September 2008 Steven Worley Doug.
Ocean Surface heat fluxes
SCD Research Data Archives; Availability Through the CDP About 500 distinct datasets, 12 TB Diverse in type, size, and format Serving 900 different investigators.
One-year re-forecast ensembles with CCSM3.0 using initial states for 1 January and 1 July in Model: CCSM3 is a coupled climate model with state-of-the-art.
The Research Data Archive at NCAR: A System Designed to Handle Diverse Datasets Bob Dattore and Steven Worley National Center for Atmospheric Research.
Assimilating Satellite Sea-Surface Salinity in NOAA Eric Bayler, NESDIS/STAR Dave Behringer, NWS/NCEP/EMC Avichal Mehra, NWS/NCEP/EMC Sudhir Nadiga, IMSG.
TIGGE Archive Access at NCAR Steven Worley Doug Schuster Dave Stepaniak Hannah Wilcox.
Data Discovery and Access to The International Surface Pressure Databank (ISPD) 1 Thomas Cram Gilbert P. Compo* Doug Schuster Chesley McColl* Steven Worley.
SCD Research Data for Ocean Observatories Steering Committee June 18, 2001 Steven Worley Scientific Computing Division Data Support Section.
The TIGGE Model Validation Portal: An Improvement in Data Interoperability 1 Thomas Cram Doug Schuster Hannah Wilcox Michael Burek Eric Nienhouse Steven.
1. Gridded Data Sub-setting Services through the RDA at NCAR Doug Schuster, Steve Worley, Bob Dattore, Dave Stepaniak.
1. Analysis and Reanalysis Products
Status and Outlook Evaluating CFSR Air-Sea Heat, Freshwater, and Momentum Fluxes in the context of the Global Energy and Freshwater Budgets PI: Lisan.
A Fear-Inspiring Intercomparison of Monthly Averaged Surface Forcing
TIGGE Data Archive and Access System at NCAR
Panel: Bill Large, Bob Weller, Tim Liu, Huug Van den Dool, Glenn White
Development and Futures of Research Data Archives
TIGGE Data Archive at NCAR
Research Data Archives at NCAR
Surface Fluxes and Model Error An introduction
Reanalyses – A sharing of juicy tidbits* and gory details**
Comeaux and Worley, NSF/NCAR/SCD
Robert Dattore and Steven Worley
Data Curation in Climate and Weather
Comeaux and Worley, NSF/NCAR/SCD
Presentation transcript:

Analyzed Data Products Available from NCAR that Support Marine Climate Research JCOMM ETMC-III 9-12 February 2010 Steven Worley Doug Schuster

Data Resources SST Wind Fluxes Reanalyses Feedback on Observations

SST Analyses Dataset TitleCoverage Global Temporal Increment Update NCAR NOAA ER-SST (2°x2°), v3b, (60°N-60°S)1850-presentMonthly NOAA OI SST (1°x1°), v21981-present Weekly & Monthly NOAA OI SST (0.25°x0.25°), v21981-presentDailyMonthly JAMSTEC, SST and Salinity (1°x1°), v MonthlyStatic Hadley Centre Sea Ice and SST (1°x1°), v11870-presentMonthly ICOADS Monthly Summary Statistics, R2.5 (1°x1°) and (2°x2°) , Monthly No satellite data ICOADS + GTS Not full global No satellite data ICOADS + GTS Not full global AVHRR + ICOADS + GTS Weekly and Monthly AVHRR + ICOADS + GTS Weekly and Monthly AVHRR + AMSR + ICOADS + GTS Daily, high resolution (.25°) AVHRR + AMSR + ICOADS + GTS Daily, high resolution (.25°) Multiple in situ data sources 16 levels down to 700m Has analysis error estimates Multiple in situ data sources 16 levels down to 700m Has analysis error estimates World respected sea-ice estimate uninterpolated data back to 1850 V2 is forthcoming World respected sea-ice estimate uninterpolated data back to 1850 V2 is forthcoming ICOADS is NOT analyzed, or bias adjusted Good first order reference ICOADS is NOT analyzed, or bias adjusted Good first order reference

Wind Analyses Dataset TitleCoverage Global Temporal Increment Update NCAR Scatterometer Climatology of Ocean Winds (0.25°x0.25°) Monthly?? QSCAT/NCEP Blended Winds SST, v5 (0.5°x0.5°) hrly?? FSU Fluxes, v More Wind Analyses in Flux Products ICOADS Monthly Summary Statistics, R2.5 (1°x1°) and (2°x2°) , Monthly Both have U and V wind components, stress, curl Both based on NASA QuikSCAT Satellite – ceased functioning 10/09. Carryon with ASCAT?? Not at NCAR Psuedo-stresses, not Atlantic Research and Quick-look Products Not at NCAR Psuedo-stresses, not Atlantic Research and Quick-look Products

Flux Analyses Dataset TitleCoverage Global Temporal Increment Update NCAR NOCS Surface Flux Dataset v2.0, (1°x1°) Monthly CORE.2 Air-Sea Flux Dataset, (1°x1°) Monthly Objectively Analyzed Air-Sea Fluxes v3.0, (1°x1°) Daily Monthly Soon Based on ICOADS, bias adjusted, uncertainty estimates Parameters: AT, SST, SLP, Wind Spd, Humidity, Cloud Cover Fluxes (Lat., LW, SW, Sen.) Based on ICOADS, bias adjusted, uncertainty estimates Parameters: AT, SST, SLP, Wind Spd, Humidity, Cloud Cover Fluxes (Lat., LW, SW, Sen.) Uses HadISST, NCEP Reanalysis, precip., various satellite data Parameters: Wind Stress, Water Fluxes (Evap., Precip., Runoff) Fluxes (Lat., LW, SW, Sen.) Uses HadISST, NCEP Reanalysis, precip., various satellite data Parameters: Wind Stress, Water Fluxes (Evap., Precip., Runoff) Fluxes (Lat., LW, SW, Sen.) Uses in situ ICOADS, several atmospheric reanalyses Parameters: AT, SST, Evap., wind spd., humidty Fluxes (Lat., LW, SW, Sen.) Uses in situ ICOADS, several atmospheric reanalyses Parameters: AT, SST, Evap., wind spd., humidty Fluxes (Lat., LW, SW, Sen.)

High Resolution Re-Analyses Dataset TitleCoverage Global Temporal Increment Update NCAR ERA-40, approx. 1.25°x1.25° hrlystatic ERA-Interim, approx. 0.7°x0.7°1989-present6-hrlyLag 2 months JRA-25, approx °x1.125° present6-hrlyyearly NCEP/NCAR, approx. 2.5°x2.5°1948-present6-hrlyquarterly NCEP CFSR, approx. 0.5°x0.5°1979-present6-hourlyTBD NOAA-CIRES 20 th Century, 2°x2° hrlystatic

High Resolution Re-Analyses Dataset TitleCoverage Global Temporal Increment Update NCAR ERA-40, approx. 1.25°x1.25° hrlystatic ERA-Interim, approx. 0.7°x0.7°1989-present6-hrlyLag 2 months JRA-25, approx °x1.125° present6-hrlyyearly NCEP/NCAR, approx. 2.5°x2.5°1948-present6-hrlyquarterly NCEP CFSR, approx. 0.5°x0.5°1979-present6-hourlyTBD NOAA-CIRES 20 th Century, 2°x2° hrlystatic ERA-40  40+ Surface parameters  ACCESS from NCAR limited to U.S. and several Canadian Universities ERA-40  40+ Surface parameters  ACCESS from NCAR limited to U.S. and several Canadian Universities ✔ ✔

High Resolution Re-Analyses Dataset TitleCoverage Global Temporal Increment Update NCAR ERA-40, approx. 1.25°x1.25° hrlystatic ERA-Interim, approx. 0.7°x0.7°1989-present6-hrlyLag 2 months JRA-25, approx °x1.125° present6-hrlyyearly NCEP/NCAR, approx. 2.5°x2.5°1948-present6-hrlyquarterly NCEP CFSR, approx. 0.5°x0.5°1979-present6-hourlyTBD NOAA-CIRES 20 th Century, 2°x2° hrlystatic ERA-Interim (Still under development)  70+ Surface parameters  ACCESS from NCAR limited to U.S. and several Canadian Universities ERA-Interim (Still under development)  70+ Surface parameters  ACCESS from NCAR limited to U.S. and several Canadian Universities ✔ ✔

High Resolution Re-Analyses Dataset TitleCoverage Global Temporal Increment Update NCAR ERA-40, approx. 1.25°x1.25° hrlystatic ERA-Interim, approx. 0.7°x0.7°1989-present6-hrlyLag 2 months JRA-25, approx °x1.125° present6-hrlyyearly NCEP/NCAR, approx. 2.5°x2.5°1948-present6-hrlyquarterly NCEP CFSR, approx. 0.5°x0.5°1979-present6-hourlyTBD NOAA-CIRES 20 th Century, 2°x2° hrlystatic JRA-25/JCDAS  70+ Surface parameters  Better moisture flux and tropical storms JRA-25/JCDAS  70+ Surface parameters  Better moisture flux and tropical storms ✔ ✔

✔ ✔ High Resolution Re-Analyses Dataset TitleCoverage Global Temporal Increment Update NCAR ERA-40, approx. 1.25°x1.25° hrlystatic ERA-Interim, approx. 0.7°x0.7°1989-present6-hrlyLag 2 months JRA-25, approx °x1.125° present6-hrlyyearly NCEP/NCAR, approx. 2.5°x2.5°1948-present6-hrlyquarterly NCEP CFSR, approx. 0.5°x0.5°1979-present6-hourlyTBD NOAA-CIRES 20 th Century, 2°x2° hrlystatic NCEP/NCAR – Long-term, low resolution  Not the best, but has had much scrutiny NCEP/NCAR – Long-term, low resolution  Not the best, but has had much scrutiny

High Resolution Re-Analyses Dataset TitleCoverage Global Temporal Increment Update NCAR ERA-40, approx. 1.25°x1.25° hrlystatic ERA-Interim, approx. 0.7°x0.7°1989-present6-hrlyLag 2 months JRA-25, approx °x1.125° present6-hrlyyearly NCEP/NCAR, approx. 2.5°x2.5°1948-present6-hrlyquarterly NCEP CFSR, approx. 0.5°x0.5°1979-present6-hourlyTBD NOAA-CIRES 20 th Century, 2°x2° hrlystatic CFSR (under development) .25° .5° ocean, 40 levels  100+ surface and single level fields CFSR (under development) .25° .5° ocean, 40 levels  100+ surface and single level fields ✔ ✔

High Resolution Re-Analyses Dataset TitleCoverage Global Temporal Increment Update NCAR ERA-40, approx. 1.25°x1.25° hrlystatic ERA-Interim, approx. 0.7°x0.7°1989-present6-hrlyLag 2 months JRA-25, approx °x1.125° present6-hrlyyearly NCEP/NCAR, approx. 2.5°x2.5°1948-present6-hrlyquarterly NCEP CFSR, approx. 0.5°x0.5°1979-present6-hourlyTBD NOAA-CIRES 20 th Century, 2°x2° hrlystatic 20 th Century Reanalysis  Run as ensemble  mean and spread fields  assimilated only SLP 20 th Century Reanalysis  Run as ensemble  mean and spread fields  assimilated only SLP ✔✔

Reanalyses, Feedback on Obs. An untapped resource? Data assimilation and analysis processing can produce. –Departures, difference between analysis and observed value –Spurious observations and some systematic errors standout as large departures We should use this source to enhance the quality of observations.

Data Discovery and Access Data Discovery Popular dataset list Google style search Drill down style search Enhanced content metadata

Data Discovery Log in Popular Dataset List Google Style Search Drill Down Style Search Enhanced Content Metadata

Data Discovery and Access Data Access Methods User created “dynamic” file list and download options Server default “static” file list and download options Delayed mode request and download options Specialized project portals

Data Access Internet Download Options Matrix Data Group Title Discover and Access Online Data Files for Immediate Download (40 TB) Online Data Example 1: User Created “Dynamic” File List and Access Options

Data Access Example 1: User Created “Dynamic” File List Select Desired Parameter(s) Select Type of ProductSelect Vertical LevelEnter Desired Date RangeUpdate the List

Data Access Example 1: User Created “Dynamic” File List Select Files for download Volume Summary Download as Single Tar File Download Full Files with Wget Script Download Select Parameters with cURL Script

Data Access Example 2: Server Default “Static” File List Online Data Example 2: Server Default Static File List Click on Magnifying Glass Icon to Access File Level Content Metadata Internet Download Options Matrix

Data Access Internet Download Options Matrix Discover and Request for Offline Data Files to be Staged Online for Delayed Mode Download (500 TB) Example 3: Request Access to Offline Data Files

Data Access Example 3: Request Access to Offline Data Files Notification when Delayed Mode Request is Ready for Download

Data Access Internet Download Options Matrix a Question Regarding Data Access

Special Project Portals TIGGE Portal –THORPEX Interactive Global Grand Ensemble Archive (TIGGE) –Supports Weather research leading to an integrated Global Interactive Forecast System Integrated across multiple international NWP Centers 10 NWP Centers contributing to TIGGE Future –Model Validation Portal (under design) –Upper Air Observations Portal (under development)

Special Project Portals TIGGE Portal