TIGGE Archive Status at NCAR THORPEX Workshop and 6th GIFS-TIGGE Working Group Meetings WMO Headquarters Geneva 22-26 September 2008 Steven Worley Doug.

Slides:



Advertisements
Similar presentations
17 Copyright © 2005, Oracle. All rights reserved. Deploying Applications by Using Java Web Start.
Advertisements

The International TIGGE Archive Baudouin Raoult, Manuel Fuentes - ECMWF Steven Worley, Doug Schuster - NCAR Bian Xiaofeng, Li Xiang - CMA Many Others!
ECMWF June 2006Slide 1 Access to ECMWF data for Research Manuel Fuentes Data and Services Section, ECMWF ECMWF Forecast Products User Meeting.
Data management in SCD Steven Worley General Categories –The Mass Storage System –NCAR user file services (home directories) –Computer attached storage.
New Resources in the Research Data Archive Doug Schuster.
ICOADS Archive Practices at NCAR JCOMM ETMC-III 9-12 February 2010 Steven Worley.
ERA-Interim and ASR Data Management at NCAR
The Research Data Archive at NCAR Doug Schuster and Steve Worley NCAR.
Smos user workshop 20 October 2010 | KlimaCampus Hamburg | Germany SMOS Data Distribution.
ERAU Weather Archive Status Update 6 October 2009.
Jonathan Voigt University of Michigan Soar Workshop 25
The International Surface Pressure Databank (ISPD) and Twentieth Century Reanalysis at NCAR Thomas Cram - NCAR, Boulder, CO Gilbert Compo & Chesley McColl.
Operational Dataset Update Functionality Included in the NCAR Research Data Archive Management System 1 Zaihua Ji Doug Schuster Steven Worley Computational.
Dynamic Web site With PHP and MySQL. MySQL The combination of MySQL database and PHP scripting language is optimum for building dynamic websites. MySQL.
Introduction Downloading and sifting through large volumes of data stored in differing formats can be a time-consuming and sometimes frustrating process.
October 16-18, Research Data Set Archives Steven Worley Scientific Computing Division Data Support Section.
EGU 2011 TIGGE, TIGGE LAM and the GIFS T. Paccagnella (1), D. Richardson (2), D. Schuster(3), R. Swinbank (4), Z. Toth (3), S.
TIGGE Archive Highlights. First Service Date ECMWF – October 2006 NCAR – October 2006 CMA – June 2007.
Research Data at NCAR 1 August, 2002 Steven Worley Scientific Computing Division Data Support Section.
BZUPAGES.COM Presentation on Content Management System (CMS) Presented to. Sir Ahmad Kareem.
Data for Climate and Energy Studies Steven Worley Computational and Information Systems Laboratory NCAR.
TIGGE Data Archive and Access System at NCAR 5th GIFS-TIGGE Working Group South African Weather Service Pretoria March 2008 Steven Worley Doug Schuster.
Marcel Casado NCAR/RAP WEATHER WARNING TOOL NCAR.
Scientific Investigations; Support from Research Data Archives for Joint Office for Science Support 26 February, 2002 Steven Worley SCD/DSS.
Slide 1 TIGGE phase1: Experience with exchanging large amount of NWP data in near real-time Baudouin Raoult Data and Services Section ECMWF.
Dan J. Grauman National Cancer Institute National Institutes of Health Department of Health and Human Services Bethesda, Maryland, USA Interactive Cancer.
Describe workflows used to maintain and provide the RDA to users – Both are 24x7 operations Transition to the NWSC with zero downtime NWSC is new environment.
Data Access to Marine Surface Observations and Products from COADS 29 January, 2002 Steven Worley National Center for Atmospheric Research.
THORPEX Interactive Grand Global Ensemble (TIGGE) China Meteorological Administration TIGGE-WG meeting, Boulder, June Progress on TIGGE Archive Center.
Improved Access to RDA from the MSS OSD Executive Meeting April 28, 2009.
ICOADS: Update Status and Data Distribution Steven J. Worley Scott D. Woodruff Sandra J. Lubker Ziahua Ji J. Eric Freeman NCAR, NOAA/ESRL, NOAA/NCDC CLIMAR-III,
Analyzed Data Products Available from NCAR that Support Marine Climate Research JCOMM ETMC-III 9-12 February 2010 Steven Worley Doug Schuster.
1 Takuya KOMORI 1 Kiyotomi SATO 1, Hitoshi YONEHARA 1 and Tetsuo NAKAZAWA 2 1: Numerical Prediction Division, Japan Meteorological Agency 2: Typhoon Research.
Data Discovery and Access to The International Surface Pressure Databank (ISPD) 1 Thomas Cram Gilbert P. Compo* Doug Schuster Chesley McColl* Steven Worley.
TIGGE, an International Data Archive and Access System Steven Worley Doug Schuster Dave Stepaniak Nate Wilhelmi (NCAR) Baudouin Raoult (ECMWF) Peiliang.
Content, Discovery, and Accessibility Enhancements to the NCAR Research Data Archive Doug Schuster and Steve Worley NCAR.
JRA-25 and JCDAS at NCAR Data from Japanese 25-year Reanalysis (JRA-25) and the operational follow- on JMA Climate Data Assimilation System (JCDAS) are.
RDA Data Support Section. Topics 1.What is it? 2.Who cares? 3.Why does the RDA need CISL? 4.What is on the horizon?
Progress of CMA TIGGE Archive Data center (updated) Bian Xiaofeng,Li Xiang,Sun Jing (National Meteorological Information Centre,CMA) Chen Jing Hu Jiangkai,
TIGGE Data Archive and Access at NCAR November 2008 November 2008 Steven Worley National Center for Atmospheric Research Boulder, Colorado, U.S.A.
Slide 1 GO-ESSP Paris. June 2007 Slide 1 (TIGGE and) the EU Funded BRIDGE project Baudouin Raoult Head of Data and Services Section ECMWF.
Kazuro Furukawa, KEK, Nov.2009.Web mirror at KEK 1 JACoW Mirror Web at KEK Kazuro Furukawa / KEK presented by Akihiro Shirakawa / KEK Nov.2009.
TIGGE Data Archive at NCAR 8th GIFS-TIGGE Working Group World Meteorological Organization Geneva February, 2010 Doug Schuster Steven Worley Dave.
The TIGGE Model Validation Portal: An Improvement in Data Interoperability 1 Thomas Cram Doug Schuster Hannah Wilcox Steven Worley National Center for.
29 March 2004 Steven Worley, NSF/NCAR/SCD 1 Research Data Stewardship and Access Steven Worley, CISL/SCD Cyberinfrastructure meeting with Priscilla Nelson.
Module: Software Engineering of Web Applications Chapter 2: Technologies 1.
SCD Research Data Archives; Availability Through the CDP About 500 distinct datasets, 12 TB Diverse in type, size, and format Serving 900 different investigators.
The Research Data Archive at NCAR: A System Designed to Handle Diverse Datasets Bob Dattore and Steven Worley National Center for Atmospheric Research.
TIGGE Archive Access at NCAR Steven Worley Doug Schuster Dave Stepaniak Hannah Wilcox.
Data Discovery and Access to The International Surface Pressure Databank (ISPD) 1 Thomas Cram Gilbert P. Compo* Doug Schuster Chesley McColl* Steven Worley.
RDA Data Support Section. Topics 1.What is it? 2.Who cares? 3.Why does the RDA need CISL? 4.What is on the horizon?
IBM Express Runtime Quick Start Workshop © 2007 IBM Corporation Deploying a Solution.
5-7 May 2003 SCD Exec_Retr 1 Research Data, May Archive Content New Archive Developments Archive Access and Provision.
C. Bruce Entwistle Science and Operations Officer Aviation Weather Center Kansas City, MO C. Bruce Entwistle Science and Operations.
The TIGGE Model Validation Portal: An Improvement in Data Interoperability 1 Thomas Cram Doug Schuster Hannah Wilcox Michael Burek Eric Nienhouse Steven.
1. Gridded Data Sub-setting Services through the RDA at NCAR Doug Schuster, Steve Worley, Bob Dattore, Dave Stepaniak.
A41I-0105 Supporting Decadal and Regional Climate Prediction through NCAR’s EaSM Data Portal Doug Schuster and Steve Worley National Center for Atmospheric.
Introduction What purpose does a data archive center serve if users can’t find or access the holdings they might need to facilitate their research discoveries?
TIGGE Archives and Access
TIGGE Data Archive and Access System at NCAR
Jennifer Boehnert Emily Riddle Tom Hopson
Operational Dataset Update Functionality Included in the NCAR Research Data Archive Management System Zaihua Ji Doug Schuster Steven Worley Computational.
Development and Futures of Research Data Archives
TIGGE Data Archive at NCAR
Applause Media System Audio/Video Release
Steven Worley, Douglas Schuster,
Implementation and Plans for TIGGE at NCAR and ECMWF
CXML data exchange Beth Ebert
Robert Dattore and Steven Worley
Comeaux and Worley, NSF/NCAR/SCD
Presentation transcript:

TIGGE Archive Status at NCAR THORPEX Workshop and 6th GIFS-TIGGE Working Group Meetings WMO Headquarters Geneva September 2008 Steven Worley Doug Schuster

TIGGE Archive Status at NCAR Update on archive content Phase 1 completion TC archive Advertisement Metrics

Update on archive content Changes Since Pretoria –More fields from NCEP prepared by NCDC 69) –NCAR installed new servers to receive and send the data System now very stable

Phase I Completion Get Forecast Data NCAR online file archive Selection options Center(s) Date File type (sl, pl, pt, pv) Initialization time Forecast length Download Options Point and click download through browser We prepare a script for user to run on local machine User and password encrypted ‘wget’ commands User customized files Selection options Same as for files, plus Parameter Regridding Spatial subsets Formats, GRIB2, netCDF Delayed ModeReal Time Two User Interfaces

Phase I Completion NEW Direct Download Option Simple file and directory structure; 16 days duration No special discovery interface; find the files you need Select files, we provide script to run on local machine User and password encrypted ‘wget’ commands Web address, dss.ucar.edu/datasets/ds330.2/data/

TC Archive NEW Direct Download Only Simple directory system, center/year/month Full period of record (earliest ECMWF ) Web address, dss.ucar.edu/datasets/ds330.3 z_tigge_c_babj_ _GEFS_glob_prod_etctr_nwp.xml CMA: 5 August 2008, 12Z Update Frequency 12 hours Size 6GB

Advertisement EOS, Transactions, American Geophysical Union, Vol. 89, Number 36, September 2, 2008 –Title: Improving High-Impact Weather Forecasts –Included an online supplement NCAR and CISL home page with Hurricane Gustav animation Objective: boost visibility in research community –Did it help?

Metrics NCAR TIGGE Portal (Oct Sep 15, 2008) Subset requests Direct File Download (Nov Sep 15, 2008) YearVol (GB)% USA#Req%USA#UU% USA YearVol (GB)%USA# Files%USA#UU%USA

Metrics NCAR TIGGE RDA File Download (Includes Specialist Staged Requests) (Oct Sep 7, 2008) 2007: 98% to 1 Japanese user (Specialist Staged Request) 2008: 99% to 1 Taiwanese user (Specialist Staged Request) NCAR MSS Download (NCAR Internal Users, Oct Sep 7, 2008) YearVol (GB)%USA# Files%USA#UU%USA YearVol (GB)%USA# Files%USA#UU%USA

Metrics NCAR TC Direct Download (RDA) (Aug 1, Sep 15, 2008) Total TIGGE Data Downloaded (Oct Sep 15, 2008) YearVol (GB)%USA# Files%USA#UU%USA YearVol (GB)%USA# Files%USA#UU%USA

End Basic Facts for NCAR TIGGE Archive, 9/’08 22 forecast cycles/forecast day 1,641,702 GRIB-2 fields/forecast day 245 GB/forecast day 3037 archive files created/forecast day ~16 forecast days online on web –45,592 Files –3.8 TB –3037 archive files aged off to MSS/day