THORPEX Interactive Grand Global Ensemble (TIGGE) China Meteorological Administration TIGGE-WG meeting, Boulder, 25-27 June Progress on TIGGE Archive Center.

Slides:



Advertisements
Similar presentations
© GEO Secretariat THORPEX-TIGGE Overall Concept What? –TIGGE: THORPEX will develop, demonstrate and evaluate a multi- model, multi-analysis and multi national.
Advertisements

Slide 1 TIGGE-LAM Workshop Bologna Jan TIGGE-LAM: Archiving at ECMWF Manuel Fuentes Data and Services Section ECMWF.
ECMWF June 2006Slide 1 Access to ECMWF data for Research Manuel Fuentes Data and Services Section, ECMWF ECMWF Forecast Products User Meeting.
New Resources in the Research Data Archive Doug Schuster.
The THORPEX Interactive Grand Global Ensemble (TIGGE) Richard Swinbank, Zoltan Toth and Philippe Bougeault, with thanks to the GIFS-TIGGE working group.
Slide 1 TECO on the WIS, Seoul, 6-8 November 2006 Slide 1 TECO on the WIS: Stakeholder Session THORPEX and TIGGE Walter Zwieflhofer ECMWF.
Providing Onboard and Onsite Ticketing Solutions to the Travel and Tourist Industry 1.
GEO Work Plan Symposium 2014 WE-01 Jim Caughey THORPEX IPO.
Recent activities on utilization of microwave imager data in the JMA NWP system - Preparation for AMSR2 data assimilation - Masahiro Kazumori Japan Meteorological.
EGU 2011 TIGGE, TIGGE LAM and the GIFS T. Paccagnella (1), D. Richardson (2), D. Schuster(3), R. Swinbank (4), Z. Toth (3), S.
Status Report on Tier-1 in Korea Gungwon Kang, Sang-Un Ahn and Hangjin Jang (KISTI GSDC) April 28, 2014 at 15th CERN-Korea Committee, Geneva Korea Institute.
TIGGE Archive Highlights. First Service Date ECMWF – October 2006 NCAR – October 2006 CMA – June 2007.
AERONET Web Data Access and Relational Database David Giles Science Systems and Applications, Inc. NASA Goddard Space Flight Center.
TIGGE Data Archive and Access System at NCAR 5th GIFS-TIGGE Working Group South African Weather Service Pretoria March 2008 Steven Worley Doug Schuster.
1 1 Japan Meteorological AgencyET-WISC-3, EUMETSAT Germany, Jun.2008 JMA’s Status Report related to WIS Toshikazu NISHIO JMA ET-WISC-III Jun.
Ensemble Forecasting: Thorpex-Tigge and use in Applications Tom Hopson.
3rd June 2004 CDF Grid SAM:Metadata and Middleware Components Mòrag Burgon-Lyon University of Glasgow.
Summary of MAP D-PHASE Strategy and Requirements MAP D-PHASE / Olympics Project Meeting 6 February 2006 Prepared by: Ron McTaggart-Cowan.
Slide 1 TIGGE phase1: Experience with exchanging large amount of NWP data in near real-time Baudouin Raoult Data and Services Section ECMWF.
Page 1 Pacific THORPEX Predictability, 6-7 June 2005© Crown copyright 2005 The THORPEX Interactive Grand Global Ensemble David Richardson Met Office, Exeter.
THEME[ENV ]: Inter-operable integration of shared Earth Observation in the Global Context Duration: Sept. 1, 2011 – Aug. 31, 2014 Total EC.
© GEO Secretariat Overall Concept What? B08FDP Forecast Demonstration Project (Nowcasting) B08RDP Research & Development Project (Ensemble Prediction Systems)
1 Takuya KOMORI 1 Kiyotomi SATO 1, Hitoshi YONEHARA 1 and Tetsuo NAKAZAWA 2 1: Numerical Prediction Division, Japan Meteorological Agency 2: Typhoon Research.
TIGGE, an International Data Archive and Access System Steven Worley Doug Schuster Dave Stepaniak Nate Wilhelmi (NCAR) Baudouin Raoult (ECMWF) Peiliang.
TIGGE and operational EPS 経田 正幸 KYOUDA Masayuki Numerical Prediction Division, Japan Meteorological Agency 9 th THORPEX GIFS-TIGGE Working Group meeting.
Content, Discovery, and Accessibility Enhancements to the NCAR Research Data Archive Doug Schuster and Steve Worley NCAR.
GEO - Weather Ocean Water Proposed Weather SBA and cross-linking work packages.
GIST 19: GGSPS status Status of GGSPS development and operations Andy Smith GGSPS software project manager.
Progress of CMA TIGGE Archive Data center (updated) Bian Xiaofeng,Li Xiang,Sun Jing (National Meteorological Information Centre,CMA) Chen Jing Hu Jiangkai,
Review of Meteorological Data Sharing Project in China Anyuan XIONG (National Meteorological Information Center, CMA, CHINA)
TIGGE Data Archive and Access at NCAR November 2008 November 2008 Steven Worley National Center for Atmospheric Research Boulder, Colorado, U.S.A.
06-1L ASTRO-E2 ASTRO-E2 User Group - 14 February, 2005 Astro-E2 Archive Lorella Angelini/HEASARC.
Slide 1 GO-ESSP Paris. June 2007 Slide 1 (TIGGE and) the EU Funded BRIDGE project Baudouin Raoult Head of Data and Services Section ECMWF.
TIGGE Data Archive at NCAR 8th GIFS-TIGGE Working Group World Meteorological Organization Geneva February, 2010 Doug Schuster Steven Worley Dave.
The TIGGE Model Validation Portal: An Improvement in Data Interoperability 1 Thomas Cram Doug Schuster Hannah Wilcox Steven Worley National Center for.
USQCD regional grid Report to ILDG /28/09ILDG14, June 5, US Grid Usage  Growing usage of gauge configurations in ILDG file format.  Fermilab.
TIGGE Archive Status at NCAR THORPEX Workshop and 6th GIFS-TIGGE Working Group Meetings WMO Headquarters Geneva September 2008 Steven Worley Doug.
Welcome to the PRECIS training workshop
TIGGE Archive Access at NCAR Steven Worley Doug Schuster Dave Stepaniak Hannah Wilcox.
31 October – 2 September 2011 Young-Youn Park Numerical Model Development Division, Korea Meteorological Administration KMA report.
THORPEX THORPEX (THeObserving system Research and Predictability Experiment) was established in 2003 by the Fourteenth World Meteorological Congress. THORPEX.
1 Collaboration for Beijing and Tokyo GISC prototypes Akira Nakamori JMA ET-WISC-III Jun.2008.
5-7 May 2003 SCD Exec_Retr 1 Research Data, May Archive Content New Archive Developments Archive Access and Provision.
The TIGGE Model Validation Portal: An Improvement in Data Interoperability 1 Thomas Cram Doug Schuster Hannah Wilcox Michael Burek Eric Nienhouse Steven.
Online Data Storage Companies MY Docs Online. Comparison Name Personal Edition Enterprise Edition Transcription Edition Price $9.95 monthly rate $4.99.
NOAA Near Real-Time AIRS Processing and Distribution System Walter Wolf Mitch Goldberg Lihang Zhou NESDIS/ORA/CRAD.
Status of GISC Tokyo GISC Tokyo / JMA.
Status of CMA S2S Archiving & Web portal
How to keep WIS performance healthy
Status report of GISC Beijing
Zhou Qing Liang(Shi Lijuan) CMA 31 Oct
Requirement for Full Global Operation on WIS Survey on the WIS Doc
Status Report of GISC Beijing
Tom Hopson, NCAR (among others) Satya Priya, World Bank
TIGGE Archives and Access
TIGGE Data Archive and Access System at NCAR
Jennifer Boehnert Emily Riddle Tom Hopson
Meningitis Forecasting using Climate Information Tom Hopson
Links with GEO.
Development and Futures of Research Data Archives
TIGGE Data Archive at NCAR
GIFS-TIGGE project Richard Swinbank, and Young-Youn Park,
AGREPS – ACCESS Global and Regional Ensemble Prediction System
Update of NMC/CMA Global Ensemble Prediction System
Steven Worley, Douglas Schuster,
Implementation and Plans for TIGGE at NCAR and ECMWF
CXML data exchange Beth Ebert
Data Curation in Climate and Weather
Comeaux and Worley, NSF/NCAR/SCD
Presentation transcript:

THORPEX Interactive Grand Global Ensemble (TIGGE) China Meteorological Administration TIGGE-WG meeting, Boulder, June Progress on TIGGE Archive Center in CMA

Provider Summary l Progress Overview l Archive Summary l Equipment Improvements l Service Improvements l Future Project 2

Progress overview : Establish test platform –Prepare Infrastructure (LDM server, Internet connection) –Test TIGGE data receiving, from ECMWF & NCAR via LDM –Develop GRIB2 encoding and decoding software : Upgrade Internet connection –Connect to CSTnet (China Science and Tech network) –Internet access rate upgraded to 100Mbps : Continuous data receiving test –About 8GB and 30,000 files received at CMA per day : Start routinely data providing and data receiving –Between CMA and ECMWF,NCAR : Fix the problem of losing data during the transmission between ECMWF

: development of TIGGE data portal Using MARS system –Localize and test MARS system –Test MARS local running environment –Establish MARS environment : Data cutting and interpolation function based on user requirement : Update LDM performance –upgrade high performance LDM data receive cache –Add one 16TB SAS store disk array –Update single LDM receive to multi LDM receive –Enlarge LDM server internal memory : Using SMS to monitoring TIGGE data exchange

: Use MARS for data archive All TIGGE data use MARS to archive Link MARS to CMA TIGGE portal : Upgrade data Portal start to running based on MARS : System upgrade Optimal network performance, keep the intactness of received data. Established a TIGGE Data Management System to provide data retrieval services directly for users : LDM System upgrade Replace 2 high-performance LDM received server Upgrade high-performance FC RAID (200,000 IOPS)

TIGGE Archive Platform Infrastructure and Data Processing Internet users HPC systems DATA R/D server DATA Proc server Online data Store disks array CMA users Archive system Off-line data Fire wall Data Transfer Data Service

Archive Centre Current Data Provider NCAR NCEP CMC UKMO ECMWF MeteoFrance JMA KMA CMA CPTEC TIGGE Archive Centres and Data Providers ( 9 ) BoM End in Aug.2010 Transfer the data of upgrade model since Oct.2011 Add 00Z data since Aug.2011

Product Center Prediction Time (Hour, Day) Mem bers Level typeTimesStart Time the Daily Incremental Data (GB) Total Data ( GB ) ( to ) egrr(UKMO) , 1524 pl, pt, pv, sl 2(00,12)03/ ,859 babj(CMA) , 1015pl, sl2(00,12)02/ ,892 ecmf(ECMW F) , 1551 pl, pt, pv, sl 2(00,12)01/ ,532 kwbc(NCEP) , 1621 pl, pt, pv, sl 4 (00,06,12,18)04/ ,676 rjtd(JMA) , 951pl, sl2(00,12)08/ ,088 ammc(BoM) ,1033pl, sl2(00,12)05/ ,202 cwao(CMC) ,1621pl, sl2(00,12)10/ ,387 lfpw(Meteo France) , 2.511pl, pv, sl2(06,18)12/ ,682 rksl(KMA) ,1017pl, sl 2(00,12) 01/ ,851 sbsj(CPTEC) , 1515pl, sl2(00,12)02/ ,779 合计 03/ ,948 Archive Summary at CMA We have recieved data from business centers since 1th,nov, It is reported that 581.9TB data exchange has been achieved totally by31th.oct.2011.Specifically, 52.9TB data of the products of CMA Ensemble Prediction System has been sent. According to the recieved data voume, ECMWF takes the lead with the total number 373.5TB , followed by UK Met Office with 59.86TB. End in Aug.2010 Add 00Z data since 3rd.Aug.2011,the data size is 3.8MB/00Z. End in Dec.2010 then begin to transfer the data of upgrade model since Oct.2010,the data size is 60GB/day.

Archive Summary at CMA 9 l Online Data –Period, most recent 1months –14.48TB l Offline Data –Full period of record –582TB, STK 9310 library

Equipment Improvements : LDM System upgrade Replace 2 high-performance LDM received server Upgrade high-performance FC RAID (200,000 IOPS) 10

Comparison Chart of Missing Number between 2011 and The data integrity has been improved greatly.

Service Improvements CMA on-line monitoring and EPS comparing, 2.3TB (May 2012). China domestic users off-line data services, 52TB (May 2012). TIGGE-LAM project, CMA regional EPS data archive, 3.6G/per day. TIGGE Portal: 30 Users Website ( Among them, 6 from ECMWF 、 JMA and Brazil Area.

13 Service Improvements TIGGE data-processing software We have developed “TIGGE data processing software” for the user's convenience. The system has confirmed the functions of ftp download, unzip, selecting the data elements, missing data checks, Area cut interpolation and format conversion preliminary.

Future Project Data storage process adjustment –In order to reduce the storage link, adjusted the Outer net (DMZ Zone) data to intranet. Tigge Display platform –To display the situation of the daily data reception. More funding support from CMA –Hardware –Software

Support to the lead centre on verification of EPS web site Upload CMA monthly statistics of GEPS verification from November 2009 up to the present; Will add the reliability table and CRPS table according to the guideline (update: July 2011),before the end of 2011

Jan.2006 May 2009 Jun 2010 The Updated of REPS at CMA working on REPS over China working on REPS based on the WMO BO8RDP project. Real time running. Operational implementation Jun 2011 Configuration of REPS  Model(WRF-ARW dynamical core)  15km grid space, 31 vertical levels  60h forecast  15 members Ens. mem Microphysicsscheme Convective scheme PBL scheme Ctrl.Lin schemeBettsMYJ Pair 1 Lin schemeKFYSU Pair 2 Lin schemeBetts-MillerYSU Pair 3 Lin schemeBetts-Miller-JanjicYSU Pair 4 Lin schemeKFMJY Pair 5 WSM6Betts-MillerMJY Pair 6 WSM3BettsMJY Pair 7 WSM3BettsYSU

- The End -