Combining Monte Carlo Estimators If I have many MC estimators, with/without various variance reduction techniques, which should I choose?

Slides:



Advertisements
Similar presentations
Insert Date HereSlide 1 Using Derivative and Integral Information in the Statistical Analysis of Computer Models Gemma Stephenson March 2007.
Advertisements

1 MADE Why do we need econometrics? If there are two points and we want to know what relation describes that? X Y.
Asset Pricing. Pricing Determining a fair value (price) for an investment is an important task. At the beginning of the semester, we dealt with the pricing.
Sample Approximation Methods for Stochastic Program Jerry Shen Zeliha Akca March 3, 2005.
How do we generate the statistics of a function of a random variable? – Why is the method called “Monte Carlo?” How do we use the uniform random number.
Mean-variance portfolio theory
Pattern Recognition and Machine Learning
Slide deck by Dr. Greg Reese Miami University MATLAB An Introduction With Applications, 5 th Edition Dr. Amos Gilat The Ohio State University Chapter 3.
Investment Science D.G. Luenberger
Regression with One Explanator
Psychology 202b Advanced Psychological Statistics, II February 10, 2011.
Importance Sampling. What is Importance Sampling ? A simulation technique Used when we are interested in rare events Examples: Bit Error Rate on a channel,
Pricing an Option Monte Carlo Simulation. We will explore a technique, called Monte Carlo simulation, to numerically derive the price of an option or.
Copyright © 2006 Pearson Addison-Wesley. All rights reserved. Lecture 5: Regression with One Explanator (Chapter 3.1–3.5, 3.7 Chapter 4.1–4.4)
G. Cowan Lectures on Statistical Data Analysis 1 Statistical Data Analysis: Lecture 8 1Probability, Bayes’ theorem, random variables, pdfs 2Functions of.
Estimation and the Kalman Filter David Johnson. The Mean of a Discrete Distribution “I have more legs than average”
Basic Mathematics for Portfolio Management. Statistics Variables x, y, z Constants a, b Observations {x n, y n |n=1,…N} Mean.
Estimation Error and Portfolio Optimization Global Asset Allocation and Stock Selection Campbell R. Harvey Duke University, Durham, NC USA National Bureau.
1 A MONTE CARLO EXPERIMENT In the previous slideshow, we saw that the error term is responsible for the variations of b 2 around its fixed component 
Lecture II-2: Probability Review
Supported by Workshop on Stochastic Analysis and Computational Finance, November 2005 Imperial College (London) G.N. Milstein and M.V. Tretyakov Numerical.
Structural Equation Modeling Continued: Lecture 2 Psy 524 Ainsworth.
Monte Carlo Simulation 1.  Simulations where random values are used but the explicit passage of time is not modeled Static simulation  Introduction.
Problem 1 Given a high-resolution computer image of a map of an irregularly shaped lake with several islands, determine the water surface area. Assume.
Colorado Center for Astrodynamics Research The University of Colorado STATISTICAL ORBIT DETERMINATION Project Report Unscented kalman Filter Information.
Short Resume of Statistical Terms Fall 2013 By Yaohang Li, Ph.D.
Simulating the value of Asian Options Vladimir Kozak.
Empirical Financial Economics Asset pricing and Mean Variance Efficiency.
Chapter 14 Monte Carlo Simulation Introduction Find several parameters Parameter follow the specific probability distribution Generate parameter.
Probabilistic Mechanism Analysis. Outline Uncertainty in mechanisms Why consider uncertainty Basics of uncertainty Probabilistic mechanism analysis Examples.
Modern Portfolio Theory. History of MPT ► 1952 Horowitz ► CAPM (Capital Asset Pricing Model) 1965 Sharpe, Lintner, Mossin ► APT (Arbitrage Pricing Theory)
Kalman Filter (Thu) Joon Shik Kim Computational Models of Intelligence.
Module 1: Statistical Issues in Micro simulation Paul Sousa.
CSC321: 2011 Introduction to Neural Networks and Machine Learning Lecture 11: Bayesian learning continued Geoffrey Hinton.
Mixture Models, Monte Carlo, Bayesian Updating and Dynamic Models Mike West Computing Science and Statistics, Vol. 24, pp , 1993.
Center for Radiative Shock Hydrodynamics Fall 2011 Review Assessment of predictive capability Derek Bingham 1.
Monté Carlo Simulation  Understand the concept of Monté Carlo Simulation  Learn how to use Monté Carlo Simulation to make good decisions  Learn how.
Importance Resampling for Global Illumination Justin F. Talbot Master’s Thesis Defense Brigham Young University Provo, UT.
Covariance Estimation For Markowitz Portfolio Optimization Ka Ki Ng Nathan Mullen Priyanka Agarwal Dzung Du Rezwanuzzaman Chowdhury 14/7/2010.
Monte-Carlo Simulation. Mathematical basis The discounted price is a martingale (MA4257 and MA5248).
© The MathWorks, Inc. ® ® Monte Carlo Simulations using MATLAB Vincent Leclercq, Application engineer
Chapter 7 Point Estimation of Parameters. Learning Objectives Explain the general concepts of estimating Explain important properties of point estimators.
1 Standard error Estimated standard error,s,. 2 Example 1 While measuring the thermal conductivity of Armco iron, using a temperature of 100F and a power.
Concept learning, Regression Adapted from slides from Alpaydin’s book and slides by Professor Doina Precup, Mcgill University.
Chapter5: Evaluating Hypothesis. 개요 개요 Evaluating the accuracy of hypotheses is fundamental to ML. - to decide whether to use this hypothesis - integral.
CHAPTER 17 O PTIMAL D ESIGN FOR E XPERIMENTAL I NPUTS Organization of chapter in ISSO –Background Motivation Finite sample and asymptotic (continuous)
Confidence Interval & Unbiased Estimator Review and Foreword.
Computer simulation Sep. 9, QUIZ 2 Determine whether the following experiments have discrete or continuous out comes A fair die is tossed and the.
פרקים נבחרים בפיסיקת החלקיקים אבנר סופר אביב
Variance Reduction Fall 2012
MAT 4830 Mathematical Modeling 04 Monte Carlo Integrations
G. Cowan Lectures on Statistical Data Analysis Lecture 9 page 1 Statistical Data Analysis: Lecture 9 1Probability, Bayes’ theorem 2Random variables and.
The Unscented Kalman Filter for Nonlinear Estimation Young Ki Baik.
G. Cowan Lectures on Statistical Data Analysis Lecture 5 page 1 Statistical Data Analysis: Lecture 5 1Probability, Bayes’ theorem 2Random variables and.
Ka-fu Wong © 2007 ECON1003: Analysis of Economic Data Lesson0-1 Supplement 2: Comparing the two estimators of population variance by simulations.
Computacion Inteligente Least-Square Methods for System Identification.
Week 21 Statistical Model A statistical model for some data is a set of distributions, one of which corresponds to the true unknown distribution that produced.
Introduction We consider the data of ~1800 phenotype measurements Each mouse has a given probability distribution of descending from one of 8 possible.
Probability Theory and Parameter Estimation I
Chapter 3: TWO-VARIABLE REGRESSION MODEL: The problem of Estimation
Monte Carlo Approximations – Introduction
Lecture 2 – Monte Carlo method in finance
Estimation Error and Portfolio Optimization
Estimation Error and Portfolio Optimization
Estimation Error and Portfolio Optimization
Simulation Part 1: Simulation with Discrete Random Variables
Estimation Error and Portfolio Optimization
Monte Carlo Integration
Maximum Likelihood Estimation (MLE)
Uncertainty Propagation
Presentation transcript:

Combining Monte Carlo Estimators If I have many MC estimators, with/without various variance reduction techniques, which should I choose?

Combining Estimators Suppose I have m unbiased estimators all of the same parameter Put these estimators in a vector Y Any linear combination of these estimators with coefficients that add to one is also an unbiased estimator of the parameter Which such linear combination is best?

Best linear combination of estimators.

Estimating Covariance

Theorem on Optimal Linear Combination of estimators

Example: combining the estimators of the call option price

Example: (cont)

MATLAB function OPTIMAL function [o,v,b,t1]=optimal(U) % generates optimal linear combination of five estimators and outputs % average estimator and variance. t1=cputime; Y1=(.53/2)*(fn( *U)+fn(1-.53*U)); t1=[t1 cputime]; Y2=.37*.5*(fn( *U)+fn( *U))+.16*.5*(fn( *U)+fn(1-.16*U)); t1=[t1 cputime]; Y3=.37*fn( *U)+.16*fn(1-.16*U); t1=[t1 cputime]; intg=2*(.53)^3+.53^2/2; Y4=intg+fn(U)-GG(U); t1=[t1 cputime]; Y5=importance('fn','importancedens','Ginverse',U); t1=[t1 cputime]; X=[Y1' Y2' Y3' Y4' Y5']; mean(X) V=cov(X); Z=ones(5,1); C=inv(V); b=C*Z/(Z'*C*Z); o=mean(X*b); % this is mean of the optimal linear combinations t1=[t1 cputime]; v=1/(Z'*V1*Z); t1=diff(t1); % these are the cputimes of the various estimators.

Results for option pricing [o,v,b]=optimal(rand(1,100000)) Estimators = o = % best linear combination (true value= ) v = e-005 %variance per uniform input b’ =

Efficiency of Optimal Linear Combination Efficiency gain based on number of uniform random numbers / or about 40,000. However, one uniform generates 5 estimators requiring 10 function evaluations. Efficiency based on function evaluations approx 4,000 A simulation using 500,000 uniform random numbers ; 13 seconds on Pentium IV (2.4 Ghz) equivalent to twenty billion simulations by crude Monte Carlo.

Interpreting the coefficients b. Dropping estimators. Variance of the mean of 100,000 is Standard error is around Some weights are negative, (e.g. on Y1) some more than 1 (on Y2), some approximately 0 (could they be dropped? For example if we drop

More examples Integrate the function (exp(u)-1)/(exp(1)-1), u is from 0 to 1 The efficiency gain is over