A stochastic nonparametric technique for space-time disaggregation of streamflows May 27, 2005 2005 Joint Assembly.

Slides:



Advertisements
Similar presentations
STATISTICS Joint and Conditional Distributions
Advertisements

Stochastic Nonparametric Framework for Basin Wide Streamflow and Salinity Modeling Application to Colorado River basin Study Progress Meeting James R.
Incorporating Climate Information in Long Term Salinity Prediction with Uncertainty Analysis James Prairie(1,2), Balaji Rajagopalan(1), and Terry Fulp(2)
A Stochastic Nonparametric Technique for Space-time Disaggregation of Streamflows Balaji Rajagopalan, Jim Prairie and Upmanu Lall May 27, Joint.
4 th International Symposium on Flood Defence Generation of Severe Flood Scenarios by Stochastic Rainfall in Combination with a Rainfall Runoff Model U.
Budapest May 27, 2008 Unifying mixed linear models and the MASH algorithm for breakpoint detection and correction Anders Grimvall, Sackmone Sirisack, Agne.
1 Approximated tracking of multiple non-rigid objects using adaptive quantization and resampling techniques. J. M. Sotoca 1, F.J. Ferri 1, J. Gutierrez.
Data preprocessing before classification In Kennedy et al.: “Solving data mining problems”
The General Linear Model. The Simple Linear Model Linear Regression.
Stochastic Nonparametric Techniques for Ensemble Streamflow Forecast : Applications to Truckee/Carson and Thailand Streamflows Balaji Rajagopalan, Katrina.
Cox Model With Intermitten and Error-Prone Covariate Observation Yury Gubman PhD thesis in Statistics Supervisors: Prof. David Zucker, Prof. Orly Manor.
Comparison of natural streamflows generated from a parametric and nonparametric stochastic model James Prairie(1,2), Balaji Rajagopalan(1) and Terry Fulp(2)
Investigating the Colorado River Simulation Model James Prairie Bureau of Reclamation.
Colorado River Basin Supply and Demand Study What’s Normal and What’s New?
Maximum likelihood separation of spatially autocorrelated images using a Markov model Shahram Hosseini 1, Rima Guidara 1, Yannick Deville 1 and Christian.
This presentation can be downloaded at Water Cycle Projections over Decades to Centuries at River Basin to Regional Scales:
Resampling techniques Why resampling? Jacknife Cross-validation Bootstrap Examples of application of bootstrap.
5. CONCLUSIONS Initially constructed and applied for the New York State’s rainfall stations (Wilks, 1998), DUM was able to reproduce its good performance.
Descriptive statistics Experiment  Data  Sample Statistics Experiment  Data  Sample Statistics Sample mean Sample mean Sample variance Sample variance.
Lattices for Distributed Source Coding - Reconstruction of a Linear function of Jointly Gaussian Sources -D. Krithivasan and S. Sandeep Pradhan - University.
Arizona State University DMML Kernel Methods – Gaussian Processes Presented by Shankar Bhargav.
1 Bootstrap Confidence Intervals in Variants of Component Analysis Marieke E. Timmerman 1, Henk A.L. Kiers 1, Age K. Smilde 2 & Cajo J.F. ter Braak 3 1.
Alan F. Hamlet Anthony L. Westerling Tim P. Barnett Dennis P. Lettenmaier JISAO/CSES Climate Impacts Group Dept. of Civil and Environmental Engineering.
Colorado River Water Availability Assessment Under Climate Variability Annie Yarberry 1, Balaji Rajagopalan 2,3 and James Prairie 4 1. Humboldt State University,
Incorporating Climate Information in Long Term Salinity Prediction with Uncertainty Analysis James Prairie(1,2), Balaji Rajagopalan(1), and Terry Fulp(2)
Lecture II-2: Probability Review
Long-Term Salinity Prediction with Uncertainty Analysis: Application for Colorado River Above Glenwood Springs, CO James Prairie Water Resources Division,
1 Comparison of Discrimination Methods for the Classification of Tumors Using Gene Expression Data Presented by: Tun-Hsiang Yang.
Long-Term Salinity Prediction with Uncertainty Analysis: Application for Colorado River Above Glenwood Springs, CO James Prairie Water Resources Division,
Hydrologic Statistics
Colorado River Basin Long Lead Forecasting Research Tom Piechota (UNLV) Kenneth Lamb (UNLV) Glenn Tootle (University of Tennessee) Tyrel Soukup (University.
Bivariate Flood Frequency Analysis using Copula with Parametric and Nonparametric Marginals Subhankar Karmakar Slobodan P. Simonovic The University of.
Downscaling in time. Aim is to make a probabilistic description of weather for next season –How often is it likely to rain, when is the rainy season likely.
Computer vision: models, learning and inference Chapter 19 Temporal models.
COMMON EVALUATION FINAL PROJECT Vira Oleksyuk ECE 8110: Introduction to machine Learning and Pattern Recognition.
Hierarchical Dirichlet Process (HDP) A Dirichlet process (DP) is a discrete distribution that is composed of a weighted sum of impulse functions. Weights.
New Mexico Rio Grande Water Operations Modeling: Creating a synthetic flow sequence representative of regional paleo-hydrology for alternatives analysis.
AN ORTHOGONAL PROJECTION
Simulation of the matrix Bingham-von Mises- Fisher distribution, with applications to multivariate and relational data Discussion led by Chunping Wang.
Repairing the long-term salinity projection model for the Colorado River basin April 25-27, 2005 International Salinity Forum Riverside, California.
Lecture 11 Pairs and Vector of Random Variables Last Time Pairs of R.Vs. Marginal PMF (Cont.) Joint PDF Marginal PDF Functions of Two R.Vs Expected Values.
Improved Cross Entropy Method For Estimation Presented by: Alex & Yanna.
Computational statistics, lecture3 Resampling and the bootstrap  Generating random processes  The bootstrap  Some examples of bootstrap techniques.
CIA Annual Meeting LOOKING BACK…focused on the future.
Water Demand, Risk, and Optimal Reservoir Storage James F. Booker with contributions by John O’Neil Siena College Annual Conference.
Chapter 13 (Prototype Methods and Nearest-Neighbors )
STOCHASTIC HYDROLOGY Stochastic Simulation of Bivariate Distributions Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National.
Model Fusion and its Use in Earth Sciences R. Romero, O. Ochoa, A. A. Velasco, and V. Kreinovich Joint Annual Meeting NSF Division of Human Resource Development.
Incorporating Uncertainties into Economic Forecasts: an Application to Forecasting Economic Activity in Croatia Dario Rukelj Ministry of Finance of the.
1 Chapter 8: Model Inference and Averaging Presented by Hui Fang.
Mesh Resampling Wolfgang Knoll, Reinhard Russ, Cornelia Hasil 1 Institute of Computer Graphics and Algorithms Vienna University of Technology.
ESTIMATION METHODS We know how to calculate confidence intervals for estimates of  and  2 Now, we need procedures to calculate  and  2, themselves.
Climate change, hydrodynamical models & extreme sea levels Adam Butler Janet Heffernan Jonathan Tawn Lancaster University Department of Mathematics &
Dario Grana and Tapan Mukerji Sequential approach to Bayesian linear inverse problems in reservoir modeling using Gaussian mixture models SCRF Annual Meeting,
Incorporating Large-Scale Climate Information in Water Resources Decision Making Balaji Rajagopalan Dept. of Civil, Env. And Arch. Engg. And CIRES Katrina.
Let-It-Rain: A Web-based Stochastic Rainfall Generator Huidae Cho 1 Dekay Kim 2, Christian Onof 3, Minha Choi 4 April 20, Dewberry, Atlanta, GA.
Colorado Center for Astrodynamics Research The University of Colorado 1 STATISTICAL ORBIT DETERMINATION Statistical Interpretation of Least Squares ASEN.
1 C.A.L. Bailer-Jones. Machine Learning. Data exploration and dimensionality reduction Machine learning, pattern recognition and statistical data modelling.
ESTIMATION METHODS We know how to calculate confidence intervals for estimates of  and 2 Now, we need procedures to calculate  and 2 , themselves.
Multiple Random Variables and Joint Distributions
Application to Colorado River basin Boulder Dendro Workshop
Why Stochastic Hydrology ?
Nonparametric Density Estimation
Multi-modality image registration using mutual information based on gradient vector flow Yujun Guo May 1,2006.
John McCartney CVEN 5454 Spring 2003
Alafia river: Autocorrelation Autocorrelation of standardized flow.
ESTIMATION METHODS We know how to calculate confidence intervals for estimates of  and 2 Now, we need procedures to calculate  and 2 , themselves.
Streamflow Forecasting Project
Stochastic Simulation and Frequency Analysis of the Concurrent Occurrences of Multi-site Extreme Rainfalls Prof. Ke-Sheng Cheng Department of Bioenvironmental.
Professor Ke-sheng Cheng
Presentation transcript:

A stochastic nonparametric technique for space-time disaggregation of streamflows May 27, Joint Assembly

Agenda Motivation Current Methods Proposed Technique Step Through Solution Application Results Conclusion Next Steps

Motivation Develop realistic streamflow scenarios at several sites on a network simultaneously Difficult to model the network from individual gauges

Motivation Present methods can not capture higher order features Present methods can be difficult to implement Can not easily incorporate climate information Finding the probability of events Required for long-term basin-wide planning –Develop shortage criteria –Meeting standards for salinity

Current Methods Parametric –Valencia and Schaake, 1972 Basic form –Mejia and Rousselle, 1976 –Lane, 1979 –Salas et al –Stedinger and Vogel, 1984 Nonparametric –Tarboton et al –Kumar et al. 2000

Drawbacks of Parametric Data must be transformed to a normal distribution –During transformation additivity is lost There are many parameters to estimate –Al least 36 parameters for annual to monthly Inability to capture non-Guassian and non- linear features

Basic Problem Resampling from a conditional PDF Where Z is the annual flow X are the monthly flows Or this can be viewed as a spatial problem –Where Z is the sum of d locations of monthly flows X are the d locations of monthly flow Joint probability Marginal probability

Step 1 Transform monthly flow X with rotational matirx R such that XR=Y Steps for Temporal Disagg Step 2 Generate an annual flow vector Z with an appropriate model Step 3 Build a matrix U where the first 11 columns are from Y and the final column is Z’, where Z’ = Z/√12

Step 4 Resample a vector u from the conditional PDF f(U|Z) Steps for Temporal Disagg Step 5 Back transform the resampled u such that uR T = X monthly values X X are the monthly values that add to Z

Gauge 1 Gauge 2Gauge 1 +2 Solve for R with Gram Schmidt orthonormalization Note the last column of R = 1/√d R T = R -1 Observed data at 2 gauges for 2 years

Generate Z sim let us say Then Next we find the K – nearest neighbors to Zsim The neighbors are weighted so closest gets higher weight We pick a neighbor, let us say year 2 Then we generate U from Y and Z’sim U is a matrix of nyears by dstations

Via back rotation we can solve for the disaggregated components of Z sim Note the disaggregated components add to Z sim = The only key parameter is K which is estimated with a heuristic scheme K=√N

Application The Upper Colorado River Basin –4 key gauges Perform 500 simulations each of 90 years length Annual Model – a modified K-NN lag-1 model

Results Basic Statistics –Lower order: mean, standard deviation, skew, autocorrelation (lag-1) Extended Statistics –Higher order: probability density function, drought statistics We provide some comparison with a parametric disaggregation model

Bluff

Lees Ferry

Bluff gauge June flows Nonparametric Parametric

Lees Ferry Gauge May Flows Nonparametric Parametric

Lees Ferry Gauge Drought Statistics Annual Model Modified K-NN lag-1 Annual Model 18 year block bootstrap

Conclusions No need for data transformation Limited parameters Preserves basic statistics Preserves summability Preserves arbitrary PDF Preserves cross correlation Simple to implement

Next Steps Simulate policy and discuss results Analysis paleo-streamflows –Data analysis –Transition Probability Matrix Conditioning on climate

A stochastic nonparametric technique for space-time disaggregation of streamflows For further information: