Geology 5670/6670 Inverse Theory 20 Feb 2015 © A.R. Lowry 2015 Read for Mon 23 Feb: Menke Ch 9 (163-188) Last time: Nonlinear Inversion Solution appraisal.

Slides:



Advertisements
Similar presentations
Modeling of Data. Basic Bayes theorem Bayes theorem relates the conditional probabilities of two events A, and B: A might be a hypothesis and B might.
Advertisements

Factorial Mixture of Gaussians and the Marginal Independence Model Ricardo Silva Joint work-in-progress with Zoubin Ghahramani.
Lecture 13 L1 , L∞ Norm Problems and Linear Programming
Lecture 23 Exemplary Inverse Problems including Earthquake Location.
Lecture 22 Exemplary Inverse Problems including Filter Design.
Lecture 3 Probability and Measurement Error, Part 2.
Visual Recognition Tutorial
Lecture 5 A Priori Information and Weighted Least Squared.
Lecture 4 The L 2 Norm and Simple Least Squares. Syllabus Lecture 01Describing Inverse Problems Lecture 02Probability and Measurement Error, Part 1 Lecture.
Lecture 9 Inexact Theories. Syllabus Lecture 01Describing Inverse Problems Lecture 02Probability and Measurement Error, Part 1 Lecture 03Probability and.
Lecture 17 Factor Analysis. Syllabus Lecture 01Describing Inverse Problems Lecture 02Probability and Measurement Error, Part 1 Lecture 03Probability and.
Lecture 24 Exemplary Inverse Problems including Vibrational Problems.
Lecture 6 Resolution and Generalized Inverses. Syllabus Lecture 01Describing Inverse Problems Lecture 02Probability and Measurement Error, Part 1 Lecture.
Maximum likelihood (ML) and likelihood ratio (LR) test
Maximum likelihood Conditional distribution and likelihood Maximum likelihood estimations Information in the data and likelihood Observed and Fisher’s.
Lecture 12 Equality and Inequality Constraints. Syllabus Lecture 01Describing Inverse Problems Lecture 02Probability and Measurement Error, Part 1 Lecture.
Prénom Nom Document Analysis: Data Analysis and Clustering Prof. Rolf Ingold, University of Fribourg Master course, spring semester 2008.
Maximum likelihood (ML) and likelihood ratio (LR) test
Descriptive statistics Experiment  Data  Sample Statistics Experiment  Data  Sample Statistics Sample mean Sample mean Sample variance Sample variance.
Lecture 8 The Principle of Maximum Likelihood. Syllabus Lecture 01Describing Inverse Problems Lecture 02Probability and Measurement Error, Part 1 Lecture.
G. Cowan Lectures on Statistical Data Analysis 1 Statistical Data Analysis: Lecture 8 1Probability, Bayes’ theorem, random variables, pdfs 2Functions of.
Retrieval Theory Mar 23, 2008 Vijay Natraj. The Inverse Modeling Problem Optimize values of an ensemble of variables (state vector x ) using observations:
Lecture 11 Vector Spaces and Singular Value Decomposition.
Lecture outline Support vector machines. Support Vector Machines Find a linear hyperplane (decision boundary) that will separate the data.
Visual Recognition Tutorial
Linear and generalised linear models
Ch. 9: Direction Generation Method Based on Linearization Generalized Reduced Gradient Method Mohammad Farhan Habib NetLab, CS, UC Davis July 30, 2010.
Maximum likelihood (ML)
Applications in GIS (Kriging Interpolation)
Lecture II-2: Probability Review
Principles of the Global Positioning System Lecture 10 Prof. Thomas Herring Room A;
Today Wrap up of probability Vectors, Matrices. Calculus
Binary Variables (1) Coin flipping: heads=1, tails=0 Bernoulli Distribution.
Physics 114: Lecture 15 Probability Tests & Linear Fitting Dale E. Gary NJIT Physics Department.
Geology 5670/6670 Inverse Theory 26 Jan 2015 © A.R. Lowry 2015 Read for Wed 28 Jan: Menke Ch 4 (69-88) Last time: Ordinary Least Squares (   Statistics)
GEO7600 Inverse Theory 09 Sep 2008 Inverse Theory: Goals are to (1) Solve for parameters from observational data; (2) Know something about the range of.
880.P20 Winter 2006 Richard Kass 1 Confidence Intervals and Upper Limits Confidence intervals (CI) are related to confidence limits (CL). To calculate.
Stats for Engineers Lecture 9. Summary From Last Time Confidence Intervals for the mean t-tables Q Student t-distribution.
Analytical vs. Numerical Minimization Each experimental data point, l, has an error, ε l, associated with it ‣ Difference between the experimentally measured.
Stochastic Linear Programming by Series of Monte-Carlo Estimators Leonidas SAKALAUSKAS Institute of Mathematics&Informatics Vilnius, Lithuania
ECE 8443 – Pattern Recognition ECE 8423 – Adaptive Signal Processing Objectives: Deterministic vs. Random Maximum A Posteriori Maximum Likelihood Minimum.
Computer Animation Rick Parent Computer Animation Algorithms and Techniques Optimization & Constraints Add mention of global techiques Add mention of calculus.
Computational Intelligence: Methods and Applications Lecture 23 Logistic discrimination and support vectors Włodzisław Duch Dept. of Informatics, UMK Google:
Monte-Carlo method for Two-Stage SLP Lecture 5 Leonidas Sakalauskas Institute of Mathematics and Informatics Vilnius, Lithuania EURO Working Group on Continuous.
Geology 5670/6670 Inverse Theory 21 Jan 2015 © A.R. Lowry 2015 Read for Fri 23 Jan: Menke Ch 3 (39-68) Last time: Ordinary Least Squares Inversion Ordinary.
Machine Learning CUNY Graduate Center Lecture 2: Math Primer.
1 Introduction to Statistics − Day 4 Glen Cowan Lecture 1 Probability Random variables, probability densities, etc. Lecture 2 Brief catalogue of probability.
ECE 8443 – Pattern Recognition ECE 8423 – Adaptive Signal Processing Objectives: MLLR For Two Gaussians Mean and Variance Adaptation MATLB Example Resources:
Geology 5670/6670 Inverse Theory 27 Feb 2015 © A.R. Lowry 2015 Read for Wed 25 Feb: Menke Ch 9 ( ) Last time: The Sensitivity Matrix (Revisited)
Geology 5670/6670 Inverse Theory 28 Jan 2015 © A.R. Lowry 2015 Read for Fri 30 Jan: Menke Ch 4 (69-88) Last time: Ordinary Least Squares: Uncertainty The.
Geology 5670/6670 Inverse Theory 16 Mar 2015 © A.R. Lowry 2015 Last time: Review of Inverse Assignment 1 Expect Assignment 2 on Wed or Fri of this week!
University of Colorado Boulder ASEN 5070 Statistical Orbit determination I Fall 2012 Professor George H. Born Professor Jeffrey S. Parker Lecture 9: Least.
G. Cowan Lectures on Statistical Data Analysis Lecture 9 page 1 Statistical Data Analysis: Lecture 9 1Probability, Bayes’ theorem 2Random variables and.
Geology 5670/6670 Inverse Theory 18 Mar 2015 © A.R. Lowry 2015 Last time: Review of Inverse Assignment 1; Constrained optimization for nonlinear problems.
Richard Kass/F02P416 Lecture 6 1 Lecture 6 Chi Square Distribution (  2 ) and Least Squares Fitting Chi Square Distribution (  2 ) (See Taylor Ch 8,
Geology 5670/6670 Inverse Theory 12 Jan 2015 © A.R. Lowry 2015 Read for Wed 14 Jan: Menke Ch 2 (15-37) Last time: Course Introduction (Cont’d) Goal is.
Computational Intelligence: Methods and Applications Lecture 26 Density estimation, Expectation Maximization. Włodzisław Duch Dept. of Informatics, UMK.
Regularized Least-Squares and Convex Optimization.
Geology 5670/6670 Inverse Theory 6 Feb 2015 © A.R. Lowry 2015 Read for Mon 9 Feb: Menke Ch 5 (89-114) Last time: The Generalized Inverse; Damped LS The.
Geology 5670/6670 Inverse Theory 20 Mar 2015 © A.R. Lowry 2015 Last time: Cooperative/Joint Inversion Cooperative or Joint Inversion uses two different.
Fundamentals of Data Analysis Lecture 11 Methods of parametric estimation.
Physics 114: Lecture 13 Probability Tests & Linear Fitting
Ch3: Model Building through Regression
Department of Civil and Environmental Engineering
Geodesy & Crustal Deformation
Modelling data and curve fitting
Where did we stop? The Bayes decision rule guarantees an optimal classification… … But it requires the knowledge of P(ci|x) (or p(x|ci) and P(ci)) We.
Estimation Error and Portfolio Optimization
Parametric Methods Berlin Chen, 2005 References:
Optimization under Uncertainty
Presentation transcript:

Geology 5670/6670 Inverse Theory 20 Feb 2015 © A.R. Lowry 2015 Read for Mon 23 Feb: Menke Ch 9 ( ) Last time: Nonlinear Inversion Solution appraisal for nonlinear problems is most comprehensively derived using deterministic approaches to forward modeling… E.g., standard grid search, spiral search; random methods including Monte Carlo… And then use the Likelihood Ratio Method (as before!) to map parameter-space contours of confidence interval: A combination of grid and gradient search approaches can be useful for other reasons also… E.g., to identify local and global minima that otherwise might be missed!

Example: Automated volcano deformation modeling at Taal volcano (Lowry et al. JVGR 2001)

Model had M = 7 & N = 9 so barely overdetermined… Found a global minimum using gradient search from starting models at 8 different locations!

Incorporating A Priori Information: Sometimes, we know enough about a problem before we start to evaluate what is or is not a reasonable answer, independent of our measurement (equality) constraints: We refer to this as “ geological knowledge ”. Example : From knowledge of geology we might infer that mass density in a study area will always be > 2200 kg m -3, and < 3000 kg m -3. Other times, we may observe outliers in our measurements that lead us to suspect the measurement errors have a LaPlacian instead of Gaussian probability density function (so that we want to use an L 1 - norm rather than L 2 -norm to solve). Both of these types of problems can be solved using Linear Programming

Linear Programming (LP) seeks to minimize: Subject to: Suppose we have K additional equality constraints : e.g., (Where e + are errors > 0 ; e - are errors < 0. Note all values in x must be positive! Including m !)  a matrix equation Fm = h

Now suppose further that we have L inequality constraints, or bounds, of the form: We introduce “ slack variables ” z li, z ui : and order these as: Then:

Here: Then we solve for M + 2L + 2N unknowns, minimizing (Do this using a linear programming algorithm, e.g. in Matlab)

Example : Wanted to solve the slow fault slip problem for southern Mexico, but using a discretized fault surface instead of one or two constant-slip patches: Note two components of slip at each pixel  a highly over-parameterized problem!!!

Useful “geological knowledge” for this problem includes: Expect dip-slip to be in a thrust direction ( S ds > 0 ) Expect dip-slip to exceed strike-slip ( S ds > S ss ) Expect strike-slip to be left-lateral based on Relative Plate Motion (Cocos-North America) ( S ss > 0 ) Expect slip patches to connect (i.e. “smooth” rather than “blocky”; can express as S i – S i+1 <  ) Also used: Estimates of measurement uncertainty (used 1/  i instead of  ’s in latter part of c T vector) Minimized the total moment release (used A  instead of 0 ’s in first slot of c T vector)

Comparison is useful just to see what is and is not required by the data, and what may be artefacts of the model parameterization… Also very useful to look at the difference in moment release for the two. The minimum- moment discretized case gives equivalent magnitude M w = 6.8 for the largest (2002) event; the two-patch solution gives M w = 7.5 ! And the GPS data sampling is clearly too sparse to completely constrain it.

Andaman coseismic moment release was so large, however, that a similar constrained solution (assuming a maximum of 20 m of slip) gives a smooth, well-connected solution despite relatively sparse GPS sampling.