Verify WRF Forecast using MET

Slides:

Advertisements

Similar presentations

Model Evaluation Tools MET. What is MET Model Evaluation Tools ( MET )- a powerful and highly configurable verification package developed by DTC offering:

Advertisements

Code Management, testing and support Xiang-Yu (Hans) Huang 1 Hui Shao 1, Ming Hu 2, Don Stark 1 Kathryn Newman 1, Chunhua Zhou Community GSI Workshop,

Mei Xu, Jamie Wolff and Michelle Harrold National Center for Atmospheric Research (NCAR) Research Applications Laboratory (RAL) and Developmental Testbed.

WRF Modeling System V2.0 Overview

Ensembling Mesoscale Model Data National Weather Service, Cleveland, OH Christopher Mello.

LAPS Analysis & Software by Steve Albers. 2 Basic Solution LAPS coupled with MM5 NWP model Use diabatic initialization (“hot start”) Utilize parallel.

An Regional Enemble Kalman Filter Data Assimilation System Employing GSI Observation Processing and Initial Tests for Rapid Refresh Forecast Configurations.

Model Evaluation Tools (MET): An Overview. MET Verification Techniques Standard verification methods –gridded model data to point-based observations.

This is the footer Running WRF on HECToR Ralph Burton, NCAS (Leeds) Alan Gadian, NCAS (Leeds) With thanks to Paul Connolly, Hector.

Office of Research and Development National Exposure Research Laboratory, Atmospheric Modeling Division, Applied Modeling Research Branch October 8, 2008.

NCEP NAQFC Verification System Perry Shafran,Binbin Zhou, Caterina Tassone Jeff McQueen,Geoff DiMego NOAA/NWS/NCEP/EMC Jerry Gorline NOAA/NWS/MDL 15 June.

Copyright 2012, University Corporation for Atmospheric Research, all rights reserved Verifying Ensembles & Probability Fcsts with MET Ensemble Stat Tool.

13 ° COSMO General Meeting Rome VERSUS2 Priority Project Report and Plan Adriano Raspanti.

Introduction to the WRF Modeling System Wei Wang NCAR/MMM.

1 Tropical cyclone (TC) trajectory and storm precipitation forecast improvement using SFOV AIRS soundings Jun Tim Schmit &, Hui Liu #, Jinlong Li.

Verification in NCEP/HPC Using VSDB-fvs Keith F. Brill November 2007.

Barcelona, 06 May 2015 s2dverification Seasonal to decadal forecast verification in R Overview Nicolau Manubens.

, experience at the Israeli Meteorological Service Yoav Levi, Head R&D.

10/28/2014 Xiangshang Li, Yunsoo Choi, Beata Czader Earth and Atmospheric Sciences University of Houston The impact of the observational meteorological.

© Crown copyright Met Office An Introduction to Linux, PP utilities, CDO and NCL Bangkok Workshop, 26 th February– 1 st March 2013.

Installing and Running the WPS Michael Duda 2006 WRF-ARW Summer Tutorial.

Requirements from KENDA on the verification NetCDF feedback files: -produced by analysis system (LETKF) and ‘stat’ utility ((to.

MODEL OUTPUT STATISTICS (MOS) TEMPERATURE FORECAST VERIFICATION JJA 2011 Benjamin Campbell April 24,2012 EAS 4480.

WRF Four-Dimensional Data Assimilation (FDDA) Jimy Dudhia.

DATA ASSIMILATION M. Derkova, M. Bellus, M. Nestiak.

Introduction on WRF-Var Regression Test Ruifang Li MMM Phone:

Impact of Meteorological Inputs on Surface O 3 Prediction Jianping Huang 9 th CMAS Annual Conference Oct. 12, 2010, Chapel, NC.

MMET Team Michelle Harrold Tracy Hertneky Jamie Wolff Demonstrating the utility of the Mesoscale Model Evaluation Testbed (MMET)

Data Storage System, Model Output and Analysis Tools PRECIS Workshop Tanzania Meteorological Agency 29 th June – 3 rd July 2015.

The TIGGE Model Validation Portal: An Improvement in Data Interoperability 1 Thomas Cram Doug Schuster Hannah Wilcox Steven Worley National Center for.

Introduction to the WRF Modeling System

An introduction to CDO, NCL and PRECIS utilities

Running CESM An overview

Toward GSI Community Code Louisa Nance, Ming Hu, Hui Shao, Laurie Carson, Hans Huang.

WRF Modelling Aim:  18 th -19 th April Cyclone taking dust SW as opposed to SE  15 th – 16 th North Scotland hit  Cyclone has moved north dragging.

0 0 July, 2009 WRF-Var Tutorial Syed RH Rizvi WRFDA Analysis/Forecast Verification Syed RH Rizvi National Center For Atmospheric Research NCAR/ESSL/MMM,

4 th JCSDA Science Workshop, 31 May – 1 June 2006 Broadband Satellite-Like (Infrared) Cloud Products from NCEP Models and Preliminary Cloud Verification.

Installing and Running the WPS Michael Duda 2006 WRF-ARW Summer Tutorial.

Simulations of MAP IOPs with Lokal Modell: impact of nudging on forecast precipitation Francesco Boccanera, Andrea Montani ARPA – Servizio Idro-Meteorologico.

DET Module 1 Ensemble Configuration Linda Wharton 1, Paula McCaslin 1, Tara Jensen 2 1 NOAA/GSD, Boulder, CO 2 NCAR/RAL, Boulder, CO 3/8/2016.

Deutscher Wetterdienst FE VERSUS 2 Priority Project Meeting Langen Use of Feedback Files for Verification at DWD Ulrich Pflüger Deutscher.

Global vs mesoscale ATOVS assimilation at the Met Office Global Large obs error (4 K) NESDIS 1B radiances NOAA-15 & 16 HIRS and AMSU thinned to 154 km.

ALADIN 3DVAR at the Hungarian Meteorological Service 1 _____________________________________________________________________________________ 27th EWGLAM.

Evaluation of Operational WRF Model Simulations (in the SF Bay Area) By Ellen METR 702  Background  Research Question and Hypothesis  Method & Programs.

Testing of Objective Analysis of Precipitation Structures (Snowbands) using the NCAR Developmental Testbed Center (DTC) Model Evaluation Tools (MET) Software.

Using atmospheric CO2 data More than 100 CO2 records Use LMDz model as an “offline” transport tool based on “retro-plumes” (pre-calculated response function)

Centro Nazionale di Meteorologia e Climatologia Aeronautica Common Verification Suite Zurich, Sep 2005 Alessandro GALLIANI, Patrizio EMILIANI, Adriano.

The TIGGE Model Validation Portal: An Improvement in Data Interoperability 1 Thomas Cram Doug Schuster Hannah Wilcox Michael Burek Eric Nienhouse Steven.

Station lists and bias corrections Jemma Davie, Colin Parrett, Richard Renshaw, Peter Jermey © Crown Copyright 2012 Source: Met Office© Crown copyright.

Implementation of CLW RF Implementation of CLWRF for downscaling CCAM outputs and results Hanh NGUYEN-THI Hanoi University of Science, VNU 9 th - 15 th.

Indirect impact of ozone assimilation using Gridpoint Statistical Interpolation (GSI) data assimilation system for regional applications Kathryn Newman1,2,

Real-data WRF: Verification with MET package

Impact of AMDAR/RS Modelling at the SAWS

The Use of AMET and Automated Scripts for Model Evaluation

WRF Four-Dimensional Data Assimilation (FDDA)

Appendix B MathScript Basics

Rapid Update Cycle-RUC

Update on the Northwest Regional Modeling System 2013

National Scientific Library at Tbilisi State University

Cloud Verification package post-processing

gWRF Workflow and Input Data Requirements

Winter storm forecast at 1-12 h range

Heat Index Pentaho User Manual.

Lidia Cucurull, NCEP/JCSDA

CLIMO EXERCISE LONG-TERM AVERAGES.

GIRO APPLICATION Current status and NEXT STEPS

Real-time WRF EnKF 36km outer domain/4km nested domain D1 (36km)

Coastal Atmospheric Modeling for both Operational and Research Applications using the Weather Research Forecast (WRF) Model.

REGIONAL AND LOCAL-SCALE EVALUATION OF 2002 MM5 METEOROLOGICAL FIELDS FOR VARIOUS AIR QUALITY MODELING APPLICATIONS Pat Dolwick*, U.S. EPA, RTP, NC, USA.

WRAP 2014 Regional Modeling

Presentation transcript:

Verify WRF Forecast using MET Ruifang Li MMM Lir@ucar.edu

METv1.1 Installation /ptmp/lir/wrf/METv1.1 (bluefire) /users/lir/wrf/met/METv1.1-gnu (Linux)

MET Components

MET Tools used PB2NC Point-Stat VSDB-Analysic The PB2NC tool is used to stratify the contents of an input PrepBufr point observation file and reformat it into NetCDF format for use by the Point-Stat tool Point-Stat The Point-Stat tool provides verification statistics for forecasts at observation points, as opposed to over gridded analyses. VSDB-Analysic The VSDB-Analysis tool ties together results from the Point-Stat and Grid-Stat tools by providing summary statistical information and a way to filter their VSDB output files.

Scripts Path /ptmp/lir/wrf_test/wrf_em/verification/nudge/scripts I used some of the scripts which were wroten by our visitor Xiaqun Zhou. Thanks Xiaoqun

WRF Forcast and Obs Data Obs Data (Prebufr Format) /ptmp/liuz/t8_2008_45km/ob/2007081500 /ptmp/liuz/t8_2008_45km/ob/2007081506 . /ptmp/liuz/t8_2008_45km/ob/2007081700

WRF Forcast and Obs Data grid nudging experiment wrfout_d01_2007-08-14_12:00:00 wrfout_d01_2007-08-15_00:00:00 . wrfout_d01_2007-08-17_00:00:00 control experiment (without grid nudging)

WRF Postprocessing run_wrfpost_cyc.ksh Change WRF output in netcdf format to grib format.

Running Process . cnt_point_stat_TMP.vsdb Pb2nc.ksh point_stat_600000L_20070815_000000V.vsdb Obs in prebufr Obs in prebufr cnt_point_stat_TMP.vsdb Pb2nc.ksh point_stat_600000L_20070815_000006V.vsdb cnt_point_stat_SPFH.vsdb vsdb_analysis_point.ksh point_stat.ksh . cnt_point_stat_UGRD.vsdb cnt_point_stat_VGRD.vsdb fcst in grib cnt_point_stat_WIND.vsdb fcst in netcdf run_wrfpost _cyc.ksh point_stat_600000L_20070817_000000V.vsdb

One record in cnt_point_stat_TMP.vsdb V1.1 WRF 180000 20070815_060000 ADPSFC FULL CNT/0.050 TMP Z02 = 1221 300.77947 300.55386 301.00507 300.55137 300.93672 4.02209 3.86865 4.18829 3.85698 4.23203 297.25917 297.06136 297.45698 297.04889 297.42627 3.52660 3.39207 3.67234 3.35312 3.70185 0.77959 0.75658 0.80067 0.74965 0.79329 0.68545 0.51188 1221 717 1134 3.52030 3.37731 3.66328 3.43463 3.64954 2.54916 2.45191 2.65450 2.46988 2.66370 1.01184 1.01155 1.01228 3.70852 3.62637 3.83187 18.88538 18.48708 19.92617 6.49289 6.09545 7.08971 4.34573 4.29965 4.46379 0.19351 -0.00492 0.40473 1.81395 1.62959 1.98116 3.47373 3.37264 3.66670 5.37370 5.30947 5.54463 6.71369 6.68062 6.88146 UW_MEAN 1 Code to pick up statistic values: pick2ncl_control.f90 pick2ncl_nudge.f90 Get cnt_point_stat_TMP.txt for reading And cnt_point_stat_TMP.bin for plotting (NCL)

Final Result vi cnt_point_stat_TMP.txt 00 00 06 06 ………………………………48 48 . ADPUPA (Up air observations) RMSE number RMSE number 00 00 06 06 ………………………………48 48 P1000-1000 1.69 19. -999. -999. P925-875 0.84 52. 0.67 2. P875-825 0.75 63. 0.36 1. P725-675 0.56 93. 0.23 2. P625-575 1.16 105. 1.06 3. P525-475 0.69 83. 0.31 1. P425-375 0.67 96. 0.89 3. P325-275 0.84 89. 0.66 2. P225-175 1.31 77. 0.64 2. P125-75 4.96 224. 5.47 5.

Final Result vi cnt_point_stat_TMP.txt RMSE number RMSE number . ADPSFC (surface observations: in land) RMSE number RMSE number 00 00 06 06 ………………………………48 48 Z02 2.86 1284. 3.48 1221. 1000-1000 1.95 4. 0.03 1. P925-875 2.34 73. 5.08 73. P875-825 2.05 36. 1.98 26. P725-675 -999.00 -999. -999.00 -999. P625-575 -999.00 -999. -999.00 -999. P525-475 -999.00 -999. -999.00 -999. P425-375 -999.00 -999. -999.00 -999. P325-275 -999.00 -999. -999.00 -999. P225-175 -999.00 -999. -999.00 -999. P125-75 -999.00 -999. -999.00 -999.

Final Result vi cnt_point_stat_TMP.txt RMSE number RMSE number . SFCSHP (surface observations: ship) RMSE number RMSE number 00 00 06 06 ………………………………48 48 Z02 1.36 148. 1.27 152. 1000-1000 -999.00 -999. -999.00 -999. P925-875 -999.00 -999. -999.00 -999. P875-825 -999.00 -999. -999.00 -999. P725-675 -999.00 -999. -999.00 -999. P625-575 -999.00 -999. -999.00 -999. P525-475 -999.00 -999. -999.00 -999. P425-375 -999.00 -999. -999.00 -999. P325-275 -999.00 -999. -999.00 -999. P225-175 -999.00 -999. -999.00 -999. P125-75 -999.00 -999. -999.00 -999.

Final Result vi cnt_point_stat_TMP.txt AIRCFT(aircraft observation) RMSE number RMSE number 00 00 12 12 ………………………………48 48 Z02 -999.00 -999. -999.00 -999. 1000-1000 -999.00 -999. -999.00 -999. P925-875 -999.00 -999. -999.00 -999. P875-825 -999.00 -999. -999.00 -999. P725-675 -999.00 -999. -999.00 -999. P625-575 -999.00 -999. -999.00 -999. P525-475 -999.00 -999. -999.00 -999. P425-375 -999.00 -999. -999.00 -999. P325-275 -999.00 -999. -999.00 -999. P225-175 -999.00 -999. 0.48 1. P125-75 -999.00 -999. -999.00 -999.

Specific Humidity

Temperature

U component

V component

Wind

Appendix A The steps to run on bluefire . 1. Run wpp to change wrf output in netcdf format to grib format. /ptmp/lir/wrf_test/wrf_em/verification/nudge/scripts/run_wrfpost_cyc_control.ksh /ptmp/lir/wrf_test/wrf_em/verification/nudge/scripts/run_wrfpost_cyc_nudge.ksh 2. Run point-stat to get matched fcst and obs pairs /ptmp/lir/wrf_test/wrf_em/verification/nudge/scripts/point_stat_control.ksh /ptmp/lir/wrf_test/wrf_em/verification/nudge/scripts/point_stat_nudge.ksh 3. Run vsdb tool to get summary info of matched fcst and obs pairs /ptmp/lir/wrf_test/wrf_em/verification/nudge/scripts/vsdb_analysis_point_control.ksh /ptmp/lir/wrf_test/wrf_em/verification/nudge/scripts/vsdb_analysis_point_nudge.ksh 4. Get RMSE and BIAS info of matched fcst and obs pairs /ptmp/lir/wrf_test/wrf_em/verification/nudge/scripts/pick2ncl_control.f90 5. Plot figures /ptmp/lir/wrf_test/wrf_em/verification/nudge/scripts/plot/ .

Questions? Thanks!