Geology 5670/6670 Inverse Theory 26 Jan 2015 © A.R. Lowry 2015 Read for Wed 28 Jan: Menke Ch 4 (69-88) Last time: Ordinary Least Squares (   Statistics)

Slides:



Advertisements
Similar presentations
Modeling of Data. Basic Bayes theorem Bayes theorem relates the conditional probabilities of two events A, and B: A might be a hypothesis and B might.
Advertisements

Statistics for Business and Economics
Sampling: Final and Initial Sample Size Determination
Statistics for Business and Economics
1 Copyright © 2010, 2007, 2004 Pearson Education, Inc. All Rights Reserved. Section 7.5 Estimation of a Population Variance This section presents methods.
G. Cowan Lectures on Statistical Data Analysis 1 Statistical Data Analysis: Lecture 10 1Probability, Bayes’ theorem, random variables, pdfs 2Functions.
AGC DSP AGC DSP Professor A G Constantinides© Estimation Theory We seek to determine from a set of data, a set of parameters such that their values would.
SUMS OF RANDOM VARIABLES Changfei Chen. Sums of Random Variables Let be a sequence of random variables, and let be their sum:
Statistical inference form observational data Parameter estimation: Method of moments Use the data you have to calculate first and second moment To fit.
Lec 6, Ch.5, pp90-105: Statistics (Objectives) Understand basic principles of statistics through reading these pages, especially… Know well about the normal.
Probability & Statistics for Engineers & Scientists, by Walpole, Myers, Myers & Ye ~ Chapter 10 Notes Class notes for ISE 201 San Jose State University.
Chapter Topics Confidence Interval Estimation for the Mean (s Known)
Let sample from N(μ, σ), μ unknown, σ known.
1 Confidence Intervals for Means. 2 When the sample size n< 30 case1-1. the underlying distribution is normal with known variance case1-2. the underlying.
 a fixed measure for a given population  ie: Mean, variance, or standard deviation.
Lecture II-2: Probability Review
Principles of the Global Positioning System Lecture 10 Prof. Thomas Herring Room A;
Standard error of estimate & Confidence interval.
Physics 114: Lecture 15 Probability Tests & Linear Fitting Dale E. Gary NJIT Physics Department.
Confidence Interval Estimation
GEO7600 Inverse Theory 09 Sep 2008 Inverse Theory: Goals are to (1) Solve for parameters from observational data; (2) Know something about the range of.
Stats for Engineers Lecture 9. Summary From Last Time Confidence Intervals for the mean t-tables Q Student t-distribution.
Basic Business Statistics, 11e © 2009 Prentice-Hall, Inc. Chap 8-1 Confidence Interval Estimation.
Estimating Population Parameters Mean Variance (and standard deviation) –Degrees of Freedom Sample size –1 –Sample standard deviation –Degrees of confidence.
Physics 114: Exam 2 Review Lectures 11-16
Normal Distributions Z Transformations Central Limit Theorem Standard Normal Distribution Z Distribution Table Confidence Intervals Levels of Significance.
Linear Regression Andy Jacobson July 2006 Statistical Anecdotes: Do hospitals make you sick? Student’s story Etymology of “regression”
Lecture 4 Basic Statistics Dr. A.K.M. Shafiqul Islam School of Bioprocess Engineering University Malaysia Perlis
General Statistics Ch En 475 Unit Operations. Quantifying variables (i.e. answering a question with a number) 1. Directly measure the variable. - referred.
Statistical Methods II&III: Confidence Intervals ChE 477 (UO Lab) Lecture 5 Larry Baxter, William Hecker, & Ron Terry Brigham Young University.
Determination of Sample Size: A Review of Statistical Theory
ELEC 303 – Random Signals Lecture 18 – Classical Statistical Inference, Dr. Farinaz Koushanfar ECE Dept., Rice University Nov 4, 2010.
Example: Bioassay experiment Problem statement –Observations: At each level of dose, 5 animals are tested, and number of death are observed.
Copyright © 2010, 2007, 2004 Pearson Education, Inc. All Rights Reserved. Section 7-5 Estimating a Population Variance.
Geology 5670/6670 Inverse Theory 21 Jan 2015 © A.R. Lowry 2015 Read for Fri 23 Jan: Menke Ch 3 (39-68) Last time: Ordinary Least Squares Inversion Ordinary.
: An alternative representation of level of significance. - normal distribution applies. - α level of significance (e.g. 5% in two tails) determines the.
© 2008 McGraw-Hill Higher Education The Statistical Imagination Chapter 8. Parameter Estimation Using Confidence Intervals.
Estimation Method of Moments (MM) Methods of Moment estimation is a general method where equations for estimating parameters are found by equating population.
1 Copyright © 2010, 2007, 2004 Pearson Education, Inc. All Rights Reserved. Section 7.4 Estimation of a Population Mean  is unknown  This section presents.
Statistics for Business and Economics 8 th Edition Chapter 7 Estimation: Single Population Copyright © 2013 Pearson Education, Inc. Publishing as Prentice.
1 Introduction to Statistics − Day 4 Glen Cowan Lecture 1 Probability Random variables, probability densities, etc. Lecture 2 Brief catalogue of probability.
Point Estimates point estimate A point estimate is a single number determined from a sample that is used to estimate the corresponding population parameter.
Statistical Inference Statistical inference is concerned with the use of sample data to make inferences about unknown population parameters. For example,
ES 07 These slides can be found at optimized for Windows)
Least Squares Estimate Additional Notes 1. Introduction The quality of an estimate can be judged using the expected value and the covariance matrix of.
Lesoon Statistics for Management Confidence Interval Estimation.
Geology 5670/6670 Inverse Theory 20 Feb 2015 © A.R. Lowry 2015 Read for Mon 23 Feb: Menke Ch 9 ( ) Last time: Nonlinear Inversion Solution appraisal.
Geology 5670/6670 Inverse Theory 27 Feb 2015 © A.R. Lowry 2015 Read for Wed 25 Feb: Menke Ch 9 ( ) Last time: The Sensitivity Matrix (Revisited)
Geology 5670/6670 Inverse Theory 28 Jan 2015 © A.R. Lowry 2015 Read for Fri 30 Jan: Menke Ch 4 (69-88) Last time: Ordinary Least Squares: Uncertainty The.
Business Statistics: Contemporary Decision Making, 3e, by Black. © 2001 South-Western/Thomson Learning 8-1 Business Statistics, 3e by Ken Black Chapter.
Geology 5670/6670 Inverse Theory 16 Mar 2015 © A.R. Lowry 2015 Last time: Review of Inverse Assignment 1 Expect Assignment 2 on Wed or Fri of this week!
Geology 5670/6670 Inverse Theory 18 Mar 2015 © A.R. Lowry 2015 Last time: Review of Inverse Assignment 1; Constrained optimization for nonlinear problems.
Chapter 8 Estimation ©. Estimator and Estimate estimator estimate An estimator of a population parameter is a random variable that depends on the sample.
R. Kass/W03 P416 Lecture 5 l Suppose we are trying to measure the true value of some quantity (x T ). u We make repeated measurements of this quantity.
Geology 6600/7600 Signal Analysis 04 Sep 2014 © A.R. Lowry 2015 Last time: Signal Analysis is a set of tools used to extract information from sequences.
Geology 5670/6670 Inverse Theory 12 Jan 2015 © A.R. Lowry 2015 Read for Wed 14 Jan: Menke Ch 2 (15-37) Last time: Course Introduction (Cont’d) Goal is.
ESTIMATION OF THE MEAN. 2 INTRO :: ESTIMATION Definition The assignment of plausible value(s) to a population parameter based on a value of a sample statistic.
MEGN 537 – Probabilistic Biomechanics Ch.5 – Determining Distributions and Parameters from Observed Data Anthony J Petrella, PhD.
Geology 5670/6670 Inverse Theory 6 Feb 2015 © A.R. Lowry 2015 Read for Mon 9 Feb: Menke Ch 5 (89-114) Last time: The Generalized Inverse; Damped LS The.
Geology 5670/6670 Inverse Theory 20 Mar 2015 © A.R. Lowry 2015 Last time: Cooperative/Joint Inversion Cooperative or Joint Inversion uses two different.
Why Model? Make predictions or forecasts where we don’t have data.
Physics 114: Lecture 13 Probability Tests & Linear Fitting
Point and interval estimations of parameters of the normally up-diffused sign. Concept of statistical evaluation.
(5) Notes on the Least Squares Estimate
Physics 114: Exam 2 Review Weeks 7-9
Statistical Inference for the Mean Confidence Interval
CONCEPTS OF ESTIMATION
Last Update 12th May 2011 SESSION 41 & 42 Hypothesis Testing.
Interval Estimation Download this presentation.
Statistical Inference for the Mean: t-test
Presentation transcript:

Geology 5670/6670 Inverse Theory 26 Jan 2015 © A.R. Lowry 2015 Read for Wed 28 Jan: Menke Ch 4 (69-88) Last time: Ordinary Least Squares (   Statistics) The expected value of is: Based on this, if (N – M) is “large” we can estimate unknown data variance as: If data variance is known a priori, we can calculate the chi-squared parameter of fit as: (so called because a sum of squared r.v.’s follows a   distribution). This can be used to evaluate fit and adjust parameterization…

The   2 parameter is commonly used to evaluate data fit & optimize the choice of number of parameters : 1) If, can safely add more model parameters 2) If, too many parameters (model is fitting noise). Solution appraisal : What is the range of solutions? Assume: zero-mean, Gaussian, uncorrelated errors Estimate: Confidence intervals expressed as %: 100(1–  )% (i.e.,  is probability the true value falls in the conf interval). Case 1: Data error variance is known ( =   2 ) -z+z 1-  /2 Desired confidence interval is ±z of the normal ( z ) distribution function Can get this from standard statistical tables or codes

Suppose we want the 95% confidence interval: Typically we use the F -distribution for F = 1 –  /2 95% conf  1 –  = –  /2 = Looking up on a standard table, find F(z) = when z = 1.96 (i.e. not quite 2  ). Case 2: Use estimated error variance from (Look up the t -distribution as you would z -distribution in math probability tables, or use corresponding routines in Matlab or other stat codes).

For a multi-parameter linear model, in reality we have confidence regions : hyperellipsoids in a multidimensional model parameter space m1m1 m2m2 E min E.g. Mars…

Another example: Gravity modeling from the Lowry & Pérez-Gussinyé approach to joint inversion of crustal thickness & V P /V S. Here, confidence intervals were estimated by varying H & K at one seismic site (a nonlinear problem, so not perfectly elliptical).

Note that some nonlinear problems can have rather pathological misfit error functions… Especially if sampling is sub-optimal.

Confidence on Linear sol’ns… To estimate confidence regions from contours of (G  m) T G  m : Example 1 : Given known   2, the confidence region is defined by where is the inverse F -distribution with M,  DOF Example: to get 95% confidence for M = 10,