Model Evaluation Tools (MET): An Overview. MET Verification Techniques Standard verification methods –gridded model data to point-based observations.

Slides:



Advertisements
Similar presentations
Jennifer M. Adams and Brian Doty IGES/COLA
Advertisements

PREPARED BY BRADLEY ZAVODSKY NASA/MSFC SHORT-TERM PREDICTION RESEARCH AND TRANSITION (SPORT) CENTER SPoRT MET Scripts Tutorial.
Lecture 5: Jacobians In 1D problems we are used to a simple change of variables, e.g. from x to u 1D Jacobian maps strips of width dx to strips of width.
Model Evaluation Tools MET. What is MET Model Evaluation Tools ( MET )- a powerful and highly configurable verification package developed by DTC offering:
Mei Xu, Jamie Wolff and Michelle Harrold National Center for Atmospheric Research (NCAR) Research Applications Laboratory (RAL) and Developmental Testbed.
ATMO5332 WRF-ARW Tutorial 0.01”.
Report of the Q2 Short Range QPF Discussion Group Jon Ahlquist Curtis Marshall John McGinley - lead Dan Petersen D. J. Seo Jean Vieux.
WRF Modeling System V2.0 Overview
Running CAMx. 1. Emissions Acquire appropriate information to get emissions inputs that are:  Representing the mobile, area, and biogenic emissions 
Maximum Covariance Analysis Canonical Correlation Analysis.
Exploring the Use of Object- Oriented Verification at the Hydrometeorological Prediction Center Faye E. Barthold 1,2, Keith F. Brill 1, and David R. Novak.
Thinking inside the box 26 June 2003 Soar Workshop - Slide 1 © 2003 Soar Technology, Inc. Thinking… …inside the box SoarDoc Presented on Thursday, 26 June.
This is the footer WRF Basics Weather Research and Forecasting.
Univ of AZ WRF Model Verification. Method NCEP Stage IV data used for precipitation verification – Stage IV is composite of rain fall observations and.
This is the footer Running WRF on HECToR Ralph Burton, NCAS (Leeds) Alan Gadian, NCAS (Leeds) With thanks to Paul Connolly, Hector.
Ensemble Post-Processing and it’s Potential Benefits for the Operational Forecaster Michael Erickson and Brian A. Colle School of Marine and Atmospheric.
Tara Jensen for DTC Staff 1, Steve Weiss 2, Jack Kain 3, Mike Coniglio 3 1 NCAR/RAL and NOAA/GSD, Boulder Colorado, USA 2 NOAA/NWS/Storm Prediction Center,
1 Robert Schaefer and Joe Comberiate for the SSUSI Team Robert SchaeferJoe Comberiate (240) (240)
1 WRF PreProcessing System (WPS) A Brief Overview WMO, Training Course, September 2011 Alanya, Turkey Dr Meral Demirtaş Turkish State Meteorological.
Copyright 2012, University Corporation for Atmospheric Research, all rights reserved Verifying Ensembles & Probability Fcsts with MET Ensemble Stat Tool.
Introduction to the WRF Modeling System Wei Wang NCAR/MMM.
Thiago Quirino and S.G. Gopalakrishnan, AOML/NOAA Hurricane Research Division, Miami, FL Thiago Quirino and S.G. Gopalakrishnan, AOML/NOAA.
November 1, 2013 Bart Brashers, ENVIRON Jared Heath Bowden, UNC 3SAQS WRF Modeling Recommendations.
+ Best Practices in Regional Climate Modeling Dr. Michel d. S. Mesquita Bjerknes Centre for Climate Research, Uni Research
Page 1© Crown copyright 2005 SRNWP – Revised Verification Proposal Clive Wilson, COSMO Annual Meeting September 18-21, 2007.
Summary of MAP D-PHASE Strategy and Requirements MAP D-PHASE / Olympics Project Meeting 6 February 2006 Prepared by: Ron McTaggart-Cowan.
CCAM Numerical Weather Prediction Dr Marcus Thatcher Research Scientist December 2007.
Verification in NCEP/HPC Using VSDB-fvs Keith F. Brill November 2007.
Towards an object-oriented assessment of high resolution precipitation forecasts Janice L. Bytheway CIRA Council and Fellows Meeting May 6, 2015.
The Available NCEP Reanalyses Wesley Ebisuzaki Climate Prediction Center National Centers for Environmental Prediction NWS/NOAA Maryland, USA
Applications of the Land Information System (LIS) Fifth Meeting of the Science Advisory Committee November, 2009 Jonathan Case transitioning unique.
Henry Fuelberg Pete Saunders Pendleton, Oregon Research Region Map Types and Lightning Frequencies.
OUTLINE Current state of Ensemble MOS
The WRF Preprocessing System Michael Duda 2006 WRF-ARW Summer Tutorial.
CKD Workshop  30 March 2011  Jim Kinter  Data Lessons from Project Athena GrADS Station Data Model Used for in situ observational data Individual reports.
Use of Mesoscale Ensemble Weather Predictions to Improve Short-Term Precipitation and Hydrological Forecasts Michael Erickson 1, Brian A. Colle 1, Jeffrey.
Current and Future Initialization of WRF Land States at NCEP Ken Mitchell NCEP/EMC WRF Land Working Group Workshop 18 June 2003.
Feature-based (object-based) Verification Nathan M. Hitchens National Severe Storms Laboratory.
The TIGGE Model Validation Portal: An Improvement in Data Interoperability 1 Thomas Cram Doug Schuster Hannah Wilcox Steven Worley National Center for.
Object-oriented verification of WRF forecasts from 2005 SPC/NSSL Spring Program Mike Baldwin Purdue University.
AMSR-E Ocean Rainfall Algorithm Status AMSR-E Science Team Meeting Asheville, NC June, 2011 C. Kummerow Colorado State University.
Introduction to the WRF Modeling System
Do the NAM and GFS have displacement biases in their MCS forecasts? Charles Yost Russ Schumacher Department of Atmospheric Sciences Texas A&M University.
Diagnostic Evaluation of Mesoscale Models Chris Davis, Barbara Brown, Randy Bullock and Daran Rife NCAR Boulder, Colorado, USA.
1 DHM: Operational Distributed Hydrologic Model Lecture 5 DHM/HL-RDHM Workshop ABRFC June 5 -7, 2007 Lee Cajina OHD/HL Hydrologic Software Engineering.
Proposed THORPEX/HEPEX Hydrologic Ensemble Project (THEPS) Presentation for 3 rd THORPEX Science Symposium September 14-18, 2009 Prepared by John Schaake,
Rapid Update Cycle-RUC. RUC A major issue is how to assimilate and use the rapidly increasing array of offtime or continuous observations (not a 00.
DET Module 1 Ensemble Configuration Linda Wharton 1, Paula McCaslin 1, Tara Jensen 2 1 NOAA/GSD, Boulder, CO 2 NCAR/RAL, Boulder, CO 3/8/2016.
The WRF Verification Toolkit Lacey Holland, Tressa Fowler, and Barbara Brown Research Applications Laboratory NCAR Lacey Holland, Tressa Fowler, and Barbara.
16-1 PC-HYSPLIT WORKSHOP Workshop Agenda Introduction to HYSPLIT Introduction.ppt Model Overview Model_Overview.ppt Meteorological Data Meteorological_Data.ppt.
Testing of Objective Analysis of Precipitation Structures (Snowbands) using the NCAR Developmental Testbed Center (DTC) Model Evaluation Tools (MET) Software.
The TIGGE Model Validation Portal: An Improvement in Data Interoperability 1 Thomas Cram Doug Schuster Hannah Wilcox Michael Burek Eric Nienhouse Steven.
1. Gridded Data Sub-setting Services through the RDA at NCAR Doug Schuster, Steve Worley, Bob Dattore, Dave Stepaniak.
1 Application of MET for the Verification of the NWP Cloud and Precipitation Products using A-Train Satellite Observations Paul A. Kucera, Courtney Weeks,
Using MODE-TD John Halley Gotway NCAR/RAL/JNTP and Developmental Testbed Center (DTC) MET Team: Tara Jensen, Randy Bullock, Tressa Fowler, Barbara Brown,
Implementation of CLW RF Implementation of CLWRF for downscaling CCAM outputs and results Hanh NGUYEN-THI Hanoi University of Science, VNU 9 th - 15 th.
Verify WRF Forecast using MET
Running the WRF Preprocessing System
A few examples of heavy precipitation forecast Ming Xue Director
Investigation of different flyby geometries for asteroid Steins - Surface area, stereo and phase angle coverage Sofie Spjuth Max-Planck-Institut für Sonnensystemforschung.
Rapid Update Cycle-RUC
TIGGE Archives and Access
NCEP’s UNIFIED POST PROCESSOR (UPP)
Tuning the horizontal diffusion in the COSMO model
gWRF Workflow and Input Data Requirements
Heat Index Pentaho User Manual.
Rapid Update Cycle-RUC Rapid Refresh-RR High Resolution Rapid Refresh-HRRR RTMA.
AMSR-E Ocean Rainfall Algorithm Status
University of Washington Center for Science in the Earth System
MECH 3550 : Simulation & Visualization
Presentation transcript:

Model Evaluation Tools (MET): An Overview

MET Verification Techniques Standard verification methods –gridded model data to point-based observations –gridded model data to gridded observations Object-based verification method –comparing gridded model data to gridded observations

Working Example: 6-h precip forecast valid 00z 2 June 08 Forecast Observations

Stage IV Hourly Precip Files ST h ST h ST h ST h ST h ST h

4-km Stage IV grid Specification 1121 x 881 polar stereographic grid. LL point: N W. UL point: N W. LR point: N W. UR point: N W. True longitude: 105W. The resolution is km at 60N. The pole point is (I,J) = (400.5,1600.5) This and numerous other standard grids defined at:

PCP-Combine command options pcp_combine init_time in_accum valid_time out_accum out_file [-pcpdir path] [-pcprx reg_exp]

PCP-combine command options init_time: –Initialization time of the input Grib files in YYYYMMDD_HHMMSS format (required). in_accum: –Accumulation interval of the input Grib files in HH format (required). valid_time: –Desired valid time in YYYYMMDD_HHMMSS format (required). out_accum: –Desired accumulation interval for the output NetCDF file in HH format (required). out_file: –Name of the output NetCDF file to be written consisting of the sum of the accumulation intervals (required).

PCP_combine example: Summing individual Stage IV hourly precip pcp_combine -sum _ _ obs_6hr.nc -pcpdir. –Note: Set init_time to _ when summing observation files Above command yields 6-hour OBS precip valid at 00z 2 June 2008 in netcdf format –Filename “obs_6hr.nc”

Regrid forecasts with “copygb” STIV Obs Grid – 1121x881,polar stereo, Dx,Dy 4763 WRF Data Grid –308 x 310; Lambert Proj with Dx,Dy = 4000 –Extract precip grid from WRF output GRIB file –Needs to be projected onto OBS grid (i.e. Stage IV) –wgrib –V filename: provides necessary details on each grid

Regrid forecasts with “copygb” Output of wgrib –V on Stage IV file yields: polar stereo: Lat Long Orient , north pole (1121 x 881) Dx 4763 Dy 4763 scan 64 mode 8 set grid=" "

WRF Forecast GRIB files: 03z 1 June initialization time copygb -xg "$grid" -i1 -X WRFPRS15.tm00.d01.grb WRFPRS15.tm00.d01.grb.new copygb -xg "$grid" -i1 -X WRFPRS21.tm00.d01.grb WRFPRS21.tm00.d01.grb.new

PCP-Combine for WRF files: Subtract 15-h from 21-h precip pcp_combine -subtract WRFPRS21.tm00.d01.grb.new 21 WRFPRS15.tm00.d01.grb.new 15 WRFPRS_6hr.nc

MODE command mode fcst_file obs_file Config_file [options] Configuration file: WrfModeConfig mode WRFPRS_6hr.nc obs_6hr.nc WrfModeConfig

MODE output 3 output formats– ASCII,NetCDF,PS mode_APCP_06_SFC_vs_APCP_06_SFC_ L_ _030000V_060000A_cts.txt mode_APCP_06_SFC_vs_APCP_06_SFC_ L_ _030000V_060000A_obj.nc mode_APCP_06_SFC_vs_APCP_06_SFC_ L_ _030000V_060000A_obj.txt mode_APCP_06_SFC_vs_APCP_06_SFC_ L_ _030000V_060000A.ps

No Mask Masking Obs

0.1 mm thresh 5.0 mm thresh

Centroid radius variations 800/(delta-x) 200/(delta-x)