Providing distributed forecasts of precipitation using a Bayesian nowcast scheme Neil I. Fox & Chris K. Wikle University of Missouri - Columbia.

Slides:



Advertisements
Similar presentations
Bayesian Hierarchical Models Selected Approaches Geophysical Examples
Advertisements

1 The relation between rainfall and area-time Integrals At the transition from and arid to an equatorial Climate: application to rainfall estimation by.
Bayesian Deconvolution of Belowground Ecosystem Processes Kiona Ogle University of Wyoming Departments of Botany & Statistics.
Markov-Chain Monte Carlo
Gridded OCF Probabilistic Forecasting For Australia For more information please contact © Commonwealth of Australia 2011 Shaun Cooper.
State space model of precipitation rate (Tamre Cardoso, PhD UW 2004) Updating wave height forecasts using satellite data (Anders Malmberg, PhD U. Lund.
Computing the Posterior Probability The posterior probability distribution contains the complete information concerning the parameters, but need often.
Paper Discussion: “Simultaneous Localization and Environmental Mapping with a Sensor Network”, Marinakis et. al. ICRA 2011.
PROVIDING DISTRIBUTED FORECASTS OF PRECIPITATION USING A STATISTICAL NOWCAST SCHEME Neil I. Fox and Chris K. Wikle University of Missouri- Columbia.
Hierarchical models STAT 518 Sp 08. Rainfall measurement Rain gauge (1 hr) High wind, low rain rate (evaporation) Spatially localized, temporally moderate.
Spatially clustered processes are very pervasive in nature Can we do more to insure that our estimates are physically realistic? How can we incorporate.
Statistics, data, and deterministic models NRCSE.
Statistics, data, and deterministic models NRCSE.
ENSO project El Niño/Southern Oscillation is driven by surface temperature in tropical Pacific Data 2 o x2 o monthly SST anomalies at 2261 locations; zonal.
Data assimilation Derek Karssenberg, Faculty of Geosciences, Utrecht University.
Extreme Value Analysis, August 15-19, Bayesian analysis of extremes in hydrology A powerful tool for knowledge integration and uncertainties assessment.
Space-time Modelling Using Differential Equations Alan E. Gelfand, ISDS, Duke University (with J. Duan and G. Puggioni)
Bayesian Analysis for Extreme Events Pao-Shin Chu and Xin Zhao Department of Meteorology School of Ocean & Earth Science & Technology University of Hawaii-
Ensemble Post-Processing and it’s Potential Benefits for the Operational Forecaster Michael Erickson and Brian A. Colle School of Marine and Atmospheric.
Spatial statistics 2 Stat 518 Sp 08. Ordinary kriging where and kriging variance.
Water Supply Forecast using the Ensemble Streamflow Prediction Model Kevin Berghoff, Senior Hydrologist Northwest River Forecast Center Portland, OR.
IE 594 : Research Methodology – Discrete Event Simulation David S. Kim Spring 2009.
ESA DA Projects Progress Meeting 2University of Reading Advanced Data Assimilation Methods WP2.1 Perform (ensemble) experiments to quantify model errors.
Monte Carlo Simulation CWR 6536 Stochastic Subsurface Hydrology.
Hierarchical Distributed Genetic Algorithm for Image Segmentation Hanchuan Peng, Fuhui Long*, Zheru Chi, and Wanshi Siu {fhlong, phc,
Atmospheric Science Department University of Missouri - Columbia A Procrustes Shape Analysis Verification Tool Steve Lack Sakis Micheas Neil Fox Chris.
“High resolution ensemble analysis: linking correlations and spread to physical processes ” S. Dey, R. Plant, N. Roberts and S. Migliorini Mesoscale group.
Towards an object-oriented assessment of high resolution precipitation forecasts Janice L. Bytheway CIRA Council and Fellows Meeting May 6, 2015.
STEPS: An empirical treatment of forecast uncertainty Alan Seed BMRC Weather Forecasting Group.
The General Data Assimilation Problem Ronald Errico Goddard Earth Sciences Technology and Research Center at Morgan State University and Global Modeling.
GAUGES – RADAR – SATELLITE COMBINATION Prof. Eng. Ezio TODINI
Spatio-Temporal Surface Vector Wind Retrieval Error Models Ralph F. Milliff NWRA/CoRA Lucrezia Ricciardulli Remote Sensing Systems Deborah K. Smith Remote.
MODEL ERROR ESTIMATION EMPLOYING DATA ASSIMILATION METHODOLOGIES Dusanka Zupanski Cooperative Institute for Research in the Atmosphere Colorado State University.
An ATD Model that Incorporates Uncertainty R. Ian Sykes Titan Research & Technology Div., Titan Corp. 50 Washington Road Princeton NJ OFCM Panel Session.
Dynamics of Climate Variability & Climate Change Dynamics of Climate Variability & Climate Change EESC W4400x Fall 2006 Instructors: Lisa Goddard, Mark.
Bayesian Generalized Kernel Mixed Models Zhihua Zhang, Guang Dai and Michael I. Jordan JMLR 2011.
Analyzing wireless sensor network data under suppression and failure in transmission Alan E. Gelfand Institute of Statistics and Decision Sciences Duke.
Additional Topics in Prediction Methodology. Introduction Predictive distribution for random variable Y 0 is meant to capture all the information about.
- 1 - Overall procedure of validation Calibration Validation Figure 12.4 Validation, calibration, and prediction (Oberkampf and Barone, 2004 ). Model accuracy.
Eawag: Swiss Federal Institute of Aquatic Science and Technology Mechanism-Based Emulation of Dynamic Simulation Models – Concept and Application in Hydrology.
Probabilistic models Jouni Tuomisto THL. Outline Deterministic models with probabilistic parameters Hierarchical Bayesian models Bayesian belief nets.
Markov Chain Monte Carlo for LDA C. Andrieu, N. D. Freitas, and A. Doucet, An Introduction to MCMC for Machine Learning, R. M. Neal, Probabilistic.
Bayesian Travel Time Reliability
 Present by 陳群元.  Introduction  Previous work  Predicting motion patterns  Spatio-temporal transition distribution  Discerning pedestrians  Experimental.
Space-Time Data Modeling A Review of Some Prospects Upmanu Lall Columbia University.
Generate ξ m,i for each direction i given H, σ 1 and m (Eq. 2) calculate X’ m,i for each direction i (Eq. 1) given ξ m,i and X m, which corresponds for.
Lab for Remote Sensing Hydrology and Spatial Modeling Dept of Bioenvironmental Systems Engineering National Taiwan University 1/45 GEOSTATISTICS INTRODUCTION.
Page 1© Crown copyright 2004 Development of a stochastic precipitation nowcast scheme for flood forecasting and warning Clive Pierce 1, Alan Seed 2, Neill.
Generalized Spatial Dirichlet Process Models Jason A. Duan Michele Guindani Alan E. Gelfand March, 2006.
Nathalie Voisin 1, Florian Pappenberger 2, Dennis Lettenmaier 1, Roberto Buizza 2, and John Schaake 3 1 University of Washington 2 ECMWF 3 National Weather.
Stochastic Hydrology Random Field Simulation Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National Taiwan University.
Enrica Bellone, Jessica Turner, Alessandro Bonazzi 2 nd IBTrACS Workshop.
Diagnostic verification and extremes: 1 st Breakout Discussed the need for toolkit to build beyond current capabilities (e.g., NCEP) Identified (and began.
A latent Gaussian model for compositional data with structural zeroes Adam Butler & Chris Glasbey Biomathematics & Statistics Scotland.
WRF Verification Toolkit Workshop, Boulder, February 2007 Spatial verification of NWP model fields Beth Ebert BMRC, Australia.
Spatial Point Processes Eric Feigelson Institut d’Astrophysique April 2014.
Matrix Models for Population Management & Conservation March 2014 Lecture 10 Uncertainty, Process Variance, and Retrospective Perturbation Analysis.
Remote sensing and modeling of cloud contents and precipitation efficiency Chung-Hsiung Sui Institute of Hydrological Sciences National Central University.
EVALUATION OF A GLOBAL PREDICTION SYSTEM: THE MISSISSIPPI RIVER BASIN AS A TEST CASE Nathalie Voisin, Andy W. Wood and Dennis P. Lettenmaier Civil and.
Anders Nielsen Technical University of Denmark, DTU-Aqua Mark Maunder Inter-American Tropical Tuna Commission An Introduction.
Kevin Stevenson AST 4762/5765. What is MCMC?  Random sampling algorithm  Estimates model parameters and their uncertainty  Only samples regions of.
Team  Spatially distributed deterministic models  Many hydrological phenomena vary spatially and temporally in accordance with the conservation.
Ch 1. Introduction Pattern Recognition and Machine Learning, C. M. Bishop, Updated by J.-H. Eom (2 nd round revision) Summarized by K.-I.
Probabilistic Robotics Bayes Filter Implementations Gaussian filters.
A New Climatology of Surface Energy Budget for the Detection and Modeling of Water and Energy Cycle Change across Sub-seasonal to Decadal Timescales Jingfeng.
Biointelligence Laboratory, Seoul National University
Forecasting Seasonal and
Stochastic Hydrology Random Field Simulation
Expectation-Maximization & Belief Propagation
Verification of Tropical Cyclone Forecasts
Presentation transcript:

Providing distributed forecasts of precipitation using a Bayesian nowcast scheme Neil I. Fox & Chris K. Wikle University of Missouri - Columbia

Contents §Reasoning §Method / model l Statistical method l Dynamics l More reasoning §Products §Case study example §Development

Reasoning §Need realistic representation of uncertainty in precipitation forecasts §Previous methods too deterministic (no measure of uncertainty) or too probabilistic (stochastic) §This methodology allows for the integration of some real physics with a realistic statistical formulation that can provide genuine information on forecast uncertainty

Hierarchical Model §5 stage model l Data l Process l Spatial distributions l Parameters

Spatio-Temporal Dynamic Models Hierarchical Space-Time Framework:

Used in §Ecology: e.g. Model species dispersion §Data sparse obs: e.g. Scatterometer winds §Long-term modeling: e.g. SST prediction

Model formulation §Stage 3: The integro-difference equation (IDE) k s (r;θ s ) is a redistribution kernel that describes how the process Y at time t is redistributed spatially at time t+1.

IDE Kernel Parameterization For 2-D space, consider the multivariate Gaussian kernel for location s: The kernel is centered at s + µ(θ s ) and thus the µ parameters control the translation and the covariance parameters control the dilation and orientation. * These parameters can be given spatial distributions at the next level of the hierarchy!! Alternative kernel parameterization: ellipse foci, e.g., Higdon et al. 1999

Spatial distribution §Model the θ s parameters with a spatial distribution at the next level of the hierarchy §Gaussian random field Diffusive wave fronts; shape and speed of diffusion depend on kernel width and tail behavior (dilation); (e.g., Kot et al. 1996) Non-diffusive propagation via relative displacement of kernel (translation); e.g., Wikle (2001; 2002)

Model implementation: MCMC §Markov Chain Monte-Carlo §Gibbs sampler

Things this can do §Full spatial variance field l Where do we have least confidence in the forecast l Quantitative uncertainty for defined points and areas (i.e. catchment QPF uncertainty)

More things we can do §Incorporation of physics l γ can become a spatially varying growth parameter l Kernel can incorporate windfield information

Products - domain §Nowcast fields l Mean nowcast l to T+60 (10 minute intervals at present) §Variance fields l Uncertainty

Mean nowcast fields

Indication of uncertainty in space

Products - point / catchment §Nowcast reflectivity l 10 minute intervals to T+60 l With variance §Nowcast Rainfall l Point or group of points l Mean or median nowcast rainfall or accumulation out to T+60 l Cumulative frequency / probability distributions

Rainrate distribution

Cumulative frequency of nowcast rainrate Pixel 1Pixel 2Pixel 3 3 pixel aggreg

Cumulative frequency of nowcast rain accumulations Pixel 1Pixel 2Pixel 3 3 pixel aggreg

In the future §Verification and adjustment §Incorporation of physics §Computational efficiency §Hydrology l lumped model probabilities l distributed probabilistic input

References §Wikle, C.K., Berliner, L.M., and Cressie, N. (1998). Hierarchical Bayesian space-time models. Environmental and Ecological Statistics, 5, §Wikle, C.K., Milliff, R.F., Nychka, D., and L.M. Berliner, 2001: Spatiotemporal hierarchical Bayesian modeling: Tropical ocean surface winds, Journal of the American Statistical Association, 96, §Berliner, L.M., Wikle, C.K., and Cressie, N., 2000: Long-lead prediction of Pacific SSTs via Bayesian dynamic modeling. Journal of Climate, 13, §Xu, B., Wikle, C.K., and N.I. Fox, 2003: A kernel-based spatio-temporal dynamical model for nowcasting radar precipitation. Journal of the American Statistical Association. In review. Available at: