Spatial Forecast Methods Inter-Comparison Project -- ICP Spring 2008 Workshop NCAR Foothills Laboratory Boulder, Colorado.

Slides:



Advertisements
Similar presentations
Test Development.
Advertisements

Model Evaluation Tools MET. What is MET Model Evaluation Tools ( MET )- a powerful and highly configurable verification package developed by DTC offering:
14 May 2001QPF Verification Workshop Verification of Probability Forecasts at Points WMO QPF Verification Workshop Prague, Czech Republic May 2001.
Advanced Computer Graphics (Spring 2006) COMS 4162, Lecture 4: Image Processing 1 Ravi Ramamoorthi
Tim Smyth and Jamie Shutler Assessment of analysis and forecast skill Assessment using satellite data.
Venugopal, Basu, and Foufoula-Georgiou, 2005: New metric for comparing precipitation patterns… Verification methods reading group April 4, 2008 D. Ahijevych.
Improving Excessive Rainfall Forecasts at HPC by using the “Neighborhood - Spatial Density“ Approach to High Res Models Michael Eckert, David Novak, and.
Freeman Algorithms and Applications in Computer Vision Lihi Zelnik-Manor Lecture 5: Pyramids.
Verification Methods for High Resolution Model Forecasts Barbara Brown NCAR, Boulder, Colorado Collaborators: Randy Bullock, John Halley.
NWP Verification with Shape- matching Algorithms: Hydrologic Applications and Extension to Ensembles Barbara Brown 1, Edward Tollerud 2, Tara Jensen 1,
© 2004 Prentice-Hall, Inc.Chap 1-1 Basic Business Statistics (9 th Edition) Chapter 1 Introduction and Data Collection.
Exploring the Use of Object- Oriented Verification at the Hydrometeorological Prediction Center Faye E. Barthold 1,2, Keith F. Brill 1, and David R. Novak.
Classification of Music According to Genres Using Neural Networks, Genetic Algorithms and Fuzzy Systems.
Introduction to Numerical Weather Prediction and Ensemble Weather Forecasting Tom Hamill NOAA-CIRES Climate Diagnostics Center Boulder, Colorado USA.
Data Mining – Intro.
Models for model error –Additive noise. What is Q(x 1, x 2, t 1, t 2 )? –Covariance inflation –Multiplicative noise? –Parameter uncertainty –“Structural”
4th Int'l Verification Methods Workshop, Helsinki, 4-6 June Methods for verifying spatial forecasts Beth Ebert Centre for Australian Weather and.
Spatial Data Integration Deana D. Pennington, PhD University of New Mexico.
Page 1© Crown copyright 2007SRNWP 8-11 October 2007, Dubrovnik SRNWP – Revised Verification Proposal Clive Wilson Presented by Terry Davies at SRNWP Meeting.
Page 1© Crown copyright 2005 SRNWP – Revised Verification Proposal Clive Wilson, COSMO Annual Meeting September 18-21, 2007.
Barbara Brown 1, Ed Tollerud 2, and Tara Jensen 1 1 NCAR/RAL, Boulder, CO and DTC 2 NOAA/GSD, Boulder, CO and DTC DET: Testing and Evaluation Plan Wally.
Towards an object-oriented assessment of high resolution precipitation forecasts Janice L. Bytheway CIRA Council and Fellows Meeting May 6, 2015.
Preliminary Results of Global Climate Simulations With a High- Resolution Atmospheric Model P. B. Duffy, B. Govindasamy, J. Milovich, K. Taylor, S. Thompson,
Downscaling and its limitation on climate change impact assessments Sepo Hachigonta University of Cape Town South Africa “Building Food Security in the.
June 19, 2007 GRIDDED MOS STARTS WITH POINT (STATION) MOS STARTS WITH POINT (STATION) MOS –Essentially the same MOS that is in text bulletins –Number and.
12 June 2008TIES -- Kelowna, B.C. Canada The Image Warp for Evaluating Gridded Weather Forecasts Eric Gilleland National Center for Atmospheric Research.
© Crown copyright Met Office Preliminary results using the Fractions Skill Score: SP2005 and fake cases Marion Mittermaier and Nigel Roberts.
Large scale IP filtering using Apache Pig and case study Kaushik Chandrasekaran Nabeel Akheel.
Large scale IP filtering using Apache Pig and case study Kaushik Chandrasekaran Nabeel Akheel.
Data Mining – Intro. Course Overview Spatial Databases Temporal and Spatio-Temporal Databases Multimedia Databases Data Mining.
ACCELERATED UNDERSTANDING BIGDATA AND VISUALIZATION: WHAT IS IT?
Page 1© Crown copyright Scale selective verification of precipitation forecasts Nigel Roberts and Humphrey Lean.
MATH – High School Common Core Vs Kansas Standards.
The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL Clustering COMP Research Seminar BCB 713 Module Spring 2011 Wei Wang.
Refinement and Evaluation of Automated High-Resolution Ensemble-Based Hazard Detection Guidance Tools for Transition to NWS Operations Kick off JNTP project.
Basic Verification Concepts
Feature-based (object-based) Verification Nathan M. Hitchens National Severe Storms Laboratory.
Remote Sensing Unsupervised Image Classification.
Spatial Smoothing and Multiple Comparisons Correction for Dummies Alexa Morcom, Matthew Brett Acknowledgements.
Introduction To Statistics
Diagnostic Evaluation of Mesoscale Models Chris Davis, Barbara Brown, Randy Bullock and Daran Rife NCAR Boulder, Colorado, USA.
U. Damrath, COSMO GM, Athens 2007 Verification of numerical QPF in DWD using radar data - and some traditional verification results for surface weather.
Page 1© Crown copyright 2005 Met Office Verification -status Clive Wilson, Presented by Mike Bush at EWGLAM Meeting October 8- 11, 2007.
Indexing OLAP Data Sunita Sarawagi Monowar Hossain York University.
Ch. Eick: Some Ideas for Task4 Project2 Ideas on Creating Summaries that Characterize Clustering Results Focus: Primary Focus Cluster Summarization (what.
Page 1© Crown copyright 2004 The use of an intensity-scale technique for assessing operational mesoscale precipitation forecasts Marion Mittermaier and.
Diagnostic verification and extremes: 1 st Breakout Discussed the need for toolkit to build beyond current capabilities (e.g., NCEP) Identified (and began.
WRF Verification Toolkit Workshop, Boulder, February 2007 Spatial verification of NWP model fields Beth Ebert BMRC, Australia.
NCAR, 15 April Fuzzy verification of fake cases Beth Ebert Center for Australian Weather and Climate Research Bureau of Meteorology.
Comparison of Convection-permitting and Convection-parameterizing Ensembles Adam J. Clark – NOAA/NSSL 18 August 2010 DTC Ensemble Testbed (DET) Workshop.
Clustering Wei Wang. Outline What is clustering Partitioning methods Hierarchical methods Density-based methods Grid-based methods Model-based clustering.
Post Processing Of digitally classified imagery….
Testing of Objective Analysis of Precipitation Structures (Snowbands) using the NCAR Developmental Testbed Center (DTC) Model Evaluation Tools (MET) Software.
User-Focused Verification Barbara Brown* NCAR July 2006
1 Application of MET for the Verification of the NWP Cloud and Precipitation Products using A-Train Satellite Observations Paul A. Kucera, Courtney Weeks,
City, State By Group Names. Today’s Weather Current conditions l Temperature l Humidity l Wind l Precipitation.
Indirect impact of ozone assimilation using Gridpoint Statistical Interpolation (GSI) data assimilation system for regional applications Kathryn Newman1,2,
LES of Turbulent Flows: Lecture 8 (ME EN )
Intensity-scale verification technique
Fuzzy verification using the Fractions Skill Score
Spatial Verification Intercomparison Meeting, 20 February 2007, NCAR
General framework for features-based verification
(C) 2002 University of Wisconsin, CS 559
Outline Announcement Local operations (continued) Linear filters
University College London (UCL), UK
Image Enhancement in the
CSCE 643 Computer Vision: Thinking in Frequency
Image Restoration - Focus on Noise
Topic 1 Three related sub-fields Image processing Computer vision
Review and Importance CS 111.
Presentation transcript:

Spatial Forecast Methods Inter-Comparison Project -- ICP Spring 2008 Workshop NCAR Foothills Laboratory Boulder, Colorado

Welcome !! Main objectives Agenda Subjective Evaluations General (Topic-specific ) Discussion Questions Some other things to think about Where do we go from here?

Main Objectives What can a forecaster learn from the results of each approach? –What are the pros and cons of each? –What user-specific needs are met?

General (topic) discussions How would one use results from each method? What information is given about scale? Operational concerns? –Summarizing multiple cases –Computational efficiency Uncertainty characterization

General Questions cont. Ease of interpretation Appropriate applications –Variables (e.g., precipitation, humidity, winds) –Domains –What information is needed for them to work –Can they characterize different attributes, and how? –Diagnostic information? Comparison of cases –How do they discern good vs. bad?

Focus on Fake Cases How do the methods handle the fake cases? Has anything been learned from the cases?

Other things to contemplate Categories –Filter Methods Scale-decomposition methods Fuzzy/Neighborhood methods –Motion Methods Features-based methods Field Morphing methods –Not so easy to categorize Methods FQI, CA, Composite, others?

Scale Questions All methods can be run for different resolutions. Filter Methods –Scale-decomposition separates scale information –Fuzzy/Neighborhood do not separate scale information, but do directly provide info on scales Motion Methods –Can information about scale be gleaned? –MODE uses quilt plots of threshold against convolution radius. Similar to fuzzy. Other Methods –CA refers to numbers of clusters as “scale.”

Filter vs. Motion Filter compares F and O fields at different scales, k, in the manner of Where G is a traditional score (e.g., rmse) B is a filter (smoothing or band pass)

Filter vs. Motion Motion moves forecast field (or structures within the fields) in the manner: Where s are coordinates in the domain of the image.