Asaf Cohen Department of Mathematics University of Michigan Financial Mathematics Seminar University of Michigan September 10, 2014 1.

Slides:



Advertisements
Similar presentations
Chp.4 Lifetime Portfolio Selection Under Uncertainty
Advertisements

Statistical Decision Theory Abraham Wald ( ) Wald’s test Rigorous proof of the consistency of MLE “Note on the consistency of the maximum likelihood.
Week 11 Review: Statistical Model A statistical model for some data is a set of distributions, one of which corresponds to the true unknown distribution.
CHAPTER 8 More About Estimation. 8.1 Bayesian Estimation In this chapter we introduce the concepts related to estimation and begin this by considering.
Bayesian inference “Very much lies in the posterior distribution” Bayesian definition of sufficiency: A statistic T (x 1, …, x n ) is sufficient for 
The General Linear Model. The Simple Linear Model Linear Regression.
Visual Recognition Tutorial
Maximum likelihood (ML) and likelihood ratio (LR) test
A gentle introduction to fluid and diffusion limits for queues Presented by: Varun Gupta April 12, 2006.
Maximum likelihood (ML) and likelihood ratio (LR) test
Basics of Statistical Estimation. Learning Probabilities: Classical Approach Simplest case: Flipping a thumbtack tails heads True probability  is unknown.
Presenting: Assaf Tzabari
BCOR 1020 Business Statistics Lecture 21 – April 8, 2008.
Using ranking and DCE data to value health states on the QALY scale using conventional and Bayesian methods Theresa Cain.
July 3, A36 Theory of Statistics Course within the Master’s program in Statistics and Data mining Fall semester 2011.
Maximum likelihood (ML)
Incorporating New Information to Decision Trees (posterior probabilities) MGS Chapter 6 Part 3.
1 10. Joint Moments and Joint Characteristic Functions Following section 6, in this section we shall introduce various parameters to compactly represent.
CHEN RONG ZHANG WEN JUN.  Introduction and Features  Price model including Bayesian update  Optimal trading strategies  Coding  Difficulties and.
References for M/G/1 Input Process
Asaf Cohen (joint work with Rami Atar) Department of Mathematics University of Michigan Financial Mathematics Seminar University of Michigan March 11,
Simulation Output Analysis
Sequential Detection Overview & Open Problems George V. Moustakides, University of Patras, GREECE.
Statistical Decision Theory
Bayesian Inference, Basics Professor Wei Zhu 1. Bayes Theorem Bayesian statistics named after Thomas Bayes ( ) -- an English statistician, philosopher.
Traffic Modeling.
1 Introduction to Estimation Chapter Concepts of Estimation The objective of estimation is to determine the value of a population parameter on the.
Estimating parameters in a statistical model Likelihood and Maximum likelihood estimation Bayesian point estimates Maximum a posteriori point.
Maximum Likelihood Estimator of Proportion Let {s 1,s 2,…,s n } be a set of independent outcomes from a Bernoulli experiment with unknown probability.
ECE 8443 – Pattern Recognition ECE 8423 – Adaptive Signal Processing Objectives: Deterministic vs. Random Maximum A Posteriori Maximum Likelihood Minimum.
Overview Particle filtering is a sequential Monte Carlo methodology in which the relevant probability distributions are iteratively estimated using the.
ECE 8443 – Pattern Recognition LECTURE 07: MAXIMUM LIKELIHOOD AND BAYESIAN ESTIMATION Objectives: Class-Conditional Density The Multivariate Case General.
Maximum Likelihood - "Frequentist" inference x 1,x 2,....,x n ~ iid N( ,  2 ) Joint pdf for the whole random sample Maximum likelihood estimates.
Bayesian Classification. Bayesian Classification: Why? A statistical classifier: performs probabilistic prediction, i.e., predicts class membership probabilities.
Michael J. Neely, University of Southern California CISS, Princeton University, March 2012 Asynchronous Scheduling for.
Clustering and Testing in High- Dimensional Data M. Radavičius, G. Jakimauskas, J. Sušinskas (Institute of Mathematics and Informatics, Vilnius, Lithuania)
On optimal quantization rules for some sequential decision problems by X. Nguyen, M. Wainwright & M. Jordan Discussion led by Qi An ECE, Duke University.
Statistical Decision Theory Bayes’ theorem: For discrete events For probability density functions.
ECE 8443 – Pattern Recognition ECE 8527 – Introduction to Machine Learning and Pattern Recognition LECTURE 07: BAYESIAN ESTIMATION (Cont.) Objectives:
CHAPTER 17 O PTIMAL D ESIGN FOR E XPERIMENTAL I NPUTS Organization of chapter in ISSO –Background Motivation Finite sample and asymptotic (continuous)
Ch15: Decision Theory & Bayesian Inference 15.1: INTRO: We are back to some theoretical statistics: 1.Decision Theory –Make decisions in the presence of.
Bayesian Prior and Posterior Study Guide for ES205 Yu-Chi Ho Jonathan T. Lee Nov. 24, 2000.
Human and Optimal Exploration and Exploitation in Bandit Problems Department of Cognitive Sciences, University of California. A Bayesian analysis of human.
1 Optimizing Decisions over the Long-term in the Presence of Uncertain Response Edward Kambour.
Machine Learning 5. Parametric Methods.
Sampling Design and Analysis MTH 494 Lecture-21 Ossam Chohan Assistant Professor CIIT Abbottabad.
The Unscented Particle Filter 2000/09/29 이 시은. Introduction Filtering –estimate the states(parameters or hidden variable) as a set of observations becomes.
Introduction to Estimation Theory: A Tutorial
Univariate Gaussian Case (Cont.)
1 Tom Edgar’s Contribution to Model Reduction as an introduction to Global Sensitivity Analysis Procedure Accounting for Effect of Available Experimental.
Green Belt – SIX SIGMA OPERATIONAL Central Limit Theorem.
Sampling Theory Determining the distribution of Sample statistics.
Evaluating Hypotheses. Outline Empirically evaluating the accuracy of hypotheses is fundamental to machine learning – How well does this estimate accuracy.
Bayesian Estimation and Confidence Intervals Lecture XXII.
Univariate Gaussian Case (Cont.)
Lecture 1.31 Criteria for optimal reception of radio signals.
Renewal Theory Definitions, Limit Theorems, Renewal Reward Processes, Alternating Renewal Processes, Age and Excess Life Distributions, Inspection Paradox.
Visual Recognition Tutorial
Probability Theory and Parameter Estimation I
risk Sensitive control of the lifetime ruin problem
risk Sensitive control of the lifetime ruin problem
Ch3: Model Building through Regression
Combining Random Variables
More about Posterior Distributions
Bayesian Inference, Basics
Summarizing Data by Statistics
LECTURE 09: BAYESIAN LEARNING
Parametric Methods Berlin Chen, 2005 References:
Learning From Observed Data
#10 The Central Limit Theorem
Presentation transcript:

Asaf Cohen Department of Mathematics University of Michigan Financial Mathematics Seminar University of Michigan September 10,

Contents Motivation: Brownian Motion with Unknown Drift Introduction: Bayesian Parameter Estimation, Examples Current & Future Work Scaled Renewal Processes Brownian Motion (with unknown drift) The Posterior Processes and their Limits 2

Contents Motivation: Brownian Motion with Unknown Drift Introduction: Bayesian Parameter Estimation, Examples Current & Future Work The Posterior Processes and their Limits 2 Scaled Renewal Processes Brownian Motion (with unknown drift)

A DM (Decision Maker) wants to estimate a parameter. His i.i.d. (given ) observations are Introduction: Bayesian Parameter Estimation, Examples Bayesian Parameter Estimation has a prior distribution The DM chooses an estimator that minimizes the expected loss function Bayesian A fundamental tool is the posterior distribution Parameter Estimation 3 e.g.,

Sampling is stopped accordance with a stopping rule The sample size is not fixed in advance. 4 Introduction: Bayesian Parameter Estimation, Examples Bayesian Sequential Parameter Estimation A fundamental tool is the posterior process The DM chooses an estimator that minimizes the expected loss function has a prior distribution Bayesian Parameter Estimation Sequential e.g., A DM wants to estimate a parameter

The samples are observed continuously 5 Introduction: Bayesian Parameter Estimation, Examples Bayesian Sequential Parameter Estimation with Renewal Process has a prior distribution t 2 3 Time 1 The posterior process A DM wants to estimate a parameter

The DM continuously observes 6 Introduction: Bayesian Parameter Estimation, Examples Bayesian Sequential Parameter Estimation with Brownian Noise has a prior distribution The posterior process A DM wants to estimate a parameter Standard Brownian Motion noise coefficient

The DM continuously observes 6 Introduction: Bayesian Parameter Estimation, Examples Brownian Motion with Unknown Drift has a prior distribution The posterior process A DM wants to estimate a parameter Standard Brownian Motion noise coefficient

Contents Motivation: Brownian Motion with Unknown Drift Introduction: Bayesian Parameter Estimation, Examples Current & Future Work The Posterior Processes and their Limits 7 Scaled Renewal Processes Brownian Motion (with unknown drift)

Observation: 8 The Model has a prior distribution The posterior process A DM wants to estimate a parameter Motivation: Brownian Motion with Unknown Drift

9 The Model has a prior distribution e.g., A common solution: A First Exit Time of A First Exit Time of the posterior process A DM wants to estimate a parameter. Observation:

10 Literature Motivation: Brownian Motion with Unknown Drift Kalman and Bucy (1961) Zakai (1969) - Bayesian Posterior Process Filtering Theory Shiryaev (1978) - formulated the problem (discrete and continuous time) Gapeev and Peskir (2004) - Finite Horizon Gapeev and Shiryaev (2011) - General Diffusion Zhitlukhin and Shiryaev (2011) - Three hypotheses Buonaguidi and Muliere (2013) - Levy Processes Sequential 2-Hypothesis Testing Berry and Friestedt (1985) - formulated the problem C. and Solan (2013) - Levy Processes Bayesian Brownian Bandit Economics Bolton and Harris (1999), Felli and Harris (1996), Bergemann and Valimaki (1997), Keller and Rady (1999), Moscarini (2005), Jovanovic (1979)...

11 Motivation: Brownian Motion with Unknown Drift

11 Motivation: Brownian Motion with Unknown Drift

12 Is This Model Useful? has a prior distribution e.g., A common solution: A First Exit Time of Observation: A First Exit Time of the posterior process A DM wants to estimate a parameter. a “discrete process” What if ? Advantages of the Brownian model: easier for investigation Motivation: Bayesian Parameter Estimation with Brownian Noise Slide from before

13 Is This Model Useful? Motivation: Bayesian Parameter Estimation with Brownian Noise Kalman and Bucy (1961) Zakai (1969) - Bayesian Posterior Process Filtering Theory Shiryaev (1978) - formulated the problem (discrete and continuous time) Gapeev and Peskir (2004) - Finite Horizon Gapeev and Shiryaev (2011) - General Diffusion Zhitlukhin and Shiryaev (2011) - Three hypotheses Buonaguidi and Muliere (2013) - Levy Processes Sequential 2-Hypothesis Testing Berry and Friestedt (1985) - formulated the problem C. and Solan (2013) - Levy Processes Bayesian Brownian Bandit Economics Bolton and Harris (1999), Felli and Harris (1996), Bergemann and Valimaki (1997), Keller and Rady (1999), Moscarini (2005), Jovanovic (1979)... No Justification Slide from before

14 Is This Model Useful? Suppose that 1. For a given rule of strategy does the losses satisfy 2.Are the optimal rules of strategies for the observed processes and relatively close? 3.Are the optimal losses relatively close? Usually not! So… Why to study Bayesian parameter estimation with Brownian noise? Motivation: Brownian Motion with Unknown Drift Questions:

14 Is This Model Useful? Suppose that 1. For a given rule of strategy does the losses satisfy 2.Are the optimal rules of strategies for the observed processes and relatively close? 3.Are the optimal losses relatively close? Usually not! So… Why to study Bayesian parameter estimation with Brownian noise? Motivation: Brownian Motion with Unknown Drift Questions: Weird phenomena: a different approximation works…. How to calculate? Fundamental tool: posterior processes Why different?

Contents Motivation: Brownian Motion with Unknown Drift Introduction: Bayesian Parameter Estimation, Examples Current & Future Work The Posterior Processes and their Limits 15 Scaled Renewal Processes Brownian Motion (with unknown drift)

are i.i.d. distributed as the RV 16 Renewal Process with Rate 1 Scaled Renewal Processes Brownian Motion (unknown drift) 2 3 Time 1 Renewal Process with Rate 2 3 Time 1 t

17 High Rate Take. How behaves? By proper scaling: Similar to Brownian Motion FCLT Scaled Renewal Processes Brownian Motion (unknown drift)

18 High and Unknown Rate - The Proper Scaling is chosen at time The DM continuously observes FCLT Why ? Scaled Renewal Processes Brownian Motion (unknown drift)

Contents Motivation: Brownian Motion with Unknown Drift Introduction: Bayesian Parameter Estimation, Examples Current & Future Work The Posterior Processes and their Limits 19 Scaled Renewal Processes Brownian Motion (with unknown drift)

20 The Posterior Processes and their Limits The Posterior Processes

21 The Posterior Processes and their Limits Diffusion Limits has a density with the support 2 3 Time 1

22 The Posterior Processes and their Limits Diffusion Limits has a density with the support Why ?

23 The Posterior Processes and their Limits ? Using the Taylor’s Series Origins of

24 The Posterior Processes and their Limits Heuristics for Why ? Recall that The smaller : “easier” to estimate larger When is a “large” R.V.? The interarrival time for the discussion, or

The Posterior Processes and their Limits Why ? recall that the smaller : “easier” to estimate larger When is a “large” R.V.? The interarrival time for the discussion, or “easier” to estimate ? ? ? x 25 Heuristics for

26 The Posterior Processes and their Limits The New, and equality holds iff. What is the relation between and ? In fact can be arbitrary large So, can be very different from

27 The Posterior Processes and their Limits Intuition (Theorem 2) is a sufficient statistic for : Usually is not a sufficient statistic for : However, if, it is sufficient! and since, then.

28 The Posterior Processes and their Limits Proof (Theorem 2) Cauchy– Schwarz Equality iff and are linearly dependent iff

29 The Posterior Processes and their Limits Back to the Motivation Since can be arbitrary large can be very different from

Contents Motivation: Brownian Motion with Unknown Drift Introduction: Bayesian Parameter Estimation, Examples The Posterior Processes and their Limits Current & Future Work 30 Scaled Renewal Processes Brownian Motion (with unknown drift)

2. - replace FCLT with stable FCLT. 31 Current & Future Work A) Behavior of posteriors in more general frameworks: B) The Disorder Problem 1. General diffusions (e.g., Zakai Equation type). Assume that at some unobservable random time the drift of a Brownian motion (rate of an arrival process) changes. similar structure. Find the posterior belief that the change has already occurred?

32 Current & Future Work C) Apply the results in context of queues with uncertainty about the service/arrival rates, asymptotic solution using Bayesian bandits. D) Apply the results in context of risk processes. Arrival process General CDF customers: Bandit (index solution) customers: non-classical Bandit (empty periods) Asymptotic solution under heavy traffic using BM with unknown drift router

33