Geology 5670/6670 Inverse Theory 12 Jan 2015 © A.R. Lowry 2015 Read for Wed 14 Jan: Menke Ch 2 (15-37) Last time: Course Introduction (Cont’d) Goal is.

Slides:



Advertisements
Similar presentations
Introduction to Data Assimilation NCEO Data-assimilation training days 5-7 July 2010 Peter Jan van Leeuwen Data Assimilation Research Center (DARC) University.
Advertisements

Modeling of Data. Basic Bayes theorem Bayes theorem relates the conditional probabilities of two events A, and B: A might be a hypothesis and B might.
State Space Models. Let { x t :t T} and { y t :t T} denote two vector valued time series that satisfy the system of equations: y t = A t x t + v t (The.
Linear Inverse Problems
Linear Programming. Introduction: Linear Programming deals with the optimization (max. or min.) of a function of variables, known as ‘objective function’,
1 12. Principles of Parameter Estimation The purpose of this lecture is to illustrate the usefulness of the various concepts introduced and studied in.
1 Regression Models & Loss Reserve Variability Prakash Narayan Ph.D., ACAS 2001 Casualty Loss Reserve Seminar.
Lecture 3 Review of Linear Algebra Simple least-squares.
Inverse Theory CIDER seismology lecture IV July 14, 2014
The Basics of Inversion
PHYS2020 NUMERICAL ALGORITHM NOTES ROOTS OF EQUATIONS.
Maximum likelihood (ML) and likelihood ratio (LR) test
Intro to Linear Methods Reading: DH&S, Ch 5.{1-4,8} hip to be hyperplanar...
Intro to Linear Methods Reading: Bishop, 3.0, 3.1, 4.0, 4.1 hip to be hyperplanar...
Maximum likelihood Conditional distribution and likelihood Maximum likelihood estimations Information in the data and likelihood Observed and Fisher’s.
Maximum likelihood (ML)
Maximum likelihood (ML) and likelihood ratio (LR) test
Review of Matrix Algebra
Engineering Computation Curve Fitting 1 Curve Fitting By Least-Squares Regression and Spline Interpolation Part 7.
Retrieval Theory Mar 23, 2008 Vijay Natraj. The Inverse Modeling Problem Optimize values of an ensemble of variables (state vector x ) using observations:
Basic Mathematics for Portfolio Management. Statistics Variables x, y, z Constants a, b Observations {x n, y n |n=1,…N} Mean.
Linear and generalised linear models
Maximum likelihood (ML)
Applications in GIS (Kriging Interpolation)
7.4 Function Notation and Linear Functions
2.1 The Addition Property of Equality
Today Wrap up of probability Vectors, Matrices. Calculus
1 Formation et Analyse d’Images Session 7 Daniela Hall 7 November 2005.
Introduction to Geophysical Inversion Huajian Yao USTC, 09/10/2013.
Physics 114: Lecture 15 Probability Tests & Linear Fitting Dale E. Gary NJIT Physics Department.
Geology 5670/6670 Inverse Theory 26 Jan 2015 © A.R. Lowry 2015 Read for Wed 28 Jan: Menke Ch 4 (69-88) Last time: Ordinary Least Squares (   Statistics)
GEO7600 Inverse Theory 09 Sep 2008 Inverse Theory: Goals are to (1) Solve for parameters from observational data; (2) Know something about the range of.
Machine Learning CUNY Graduate Center Lecture 3: Linear Regression.
Scientific Computing Linear Least Squares. Interpolation vs Approximation Recall: Given a set of (x,y) data points, Interpolation is the process of finding.
Linear(-ized) Inverse Problems
Curve Fitting and Interpolation: Lecture (I)
Extrapolation Models for Convergence Acceleration and Function ’ s Extension David Levin Tel-Aviv University MAIA Erice 2013.
ECE 8443 – Pattern Recognition ECE 8423 – Adaptive Signal Processing Objectives: Deterministic vs. Random Maximum A Posteriori Maximum Likelihood Minimum.
Curve-Fitting Regression
Thomas Knotts. Engineers often: Regress data  Analysis  Fit to theory  Data reduction Use the regression of others  Antoine Equation  DIPPR.
2014. Engineers often: Regress data  Analysis  Fit to theory  Data reduction Use the regression of others  Antoine Equation  DIPPR We need to be.
Geology 5670/6670 Inverse Theory 21 Jan 2015 © A.R. Lowry 2015 Read for Fri 23 Jan: Menke Ch 3 (39-68) Last time: Ordinary Least Squares Inversion Ordinary.
1 EEE 431 Computational Methods in Electrodynamics Lecture 17 By Dr. Rasime Uyguroglu
Geology 5670/6670 Inverse Theory 20 Feb 2015 © A.R. Lowry 2015 Read for Mon 23 Feb: Menke Ch 9 ( ) Last time: Nonlinear Inversion Solution appraisal.
Geology 5670/6670 Inverse Theory 27 Feb 2015 © A.R. Lowry 2015 Read for Wed 25 Feb: Menke Ch 9 ( ) Last time: The Sensitivity Matrix (Revisited)
Geology 5670/6670 Inverse Theory 28 Jan 2015 © A.R. Lowry 2015 Read for Fri 30 Jan: Menke Ch 4 (69-88) Last time: Ordinary Least Squares: Uncertainty The.
Geology 5670/6670 Inverse Theory 16 Mar 2015 © A.R. Lowry 2015 Last time: Review of Inverse Assignment 1 Expect Assignment 2 on Wed or Fri of this week!
Comparison Value vs Policy iteration
École Doctorale des Sciences de l'Environnement d’ Î le-de-France Année Modélisation Numérique de l’Écoulement Atmosphérique et Assimilation.
R. Kass/W03 P416 Lecture 5 l Suppose we are trying to measure the true value of some quantity (x T ). u We make repeated measurements of this quantity.
Geology 6600/7600 Signal Analysis 26 Oct 2015 © A.R. Lowry 2015 Last time: Wiener Filtering Digital Wiener Filtering seeks to design a filter h for a linear.
Geology 5670/6670 Inverse Theory 4 Feb 2015 © A.R. Lowry 2015 Read for Fri 6 Feb: Menke Ch 4 (69-88) Last time: The Generalized Inverse The Generalized.
Using Neumann Series to Solve Inverse Problems in Imaging Christopher Kumar Anand.
Geology 5640/6640 Introduction to Seismology 28 Jan 2015 © A.R. Lowry 2015 Read for Fri 30 Jan: S&W (§ ) Last time: The Strain Tensor Stress.
Powers and Exponents Intro to Algebra Farris.  I can write and evaluate expressions using exponents.
Colorado Center for Astrodynamics Research The University of Colorado 1 STATISTICAL ORBIT DETERMINATION Statistical Interpretation of Least Squares ASEN.
Geology 6600/7600 Signal Analysis Last time: Linear Systems The Frequency Response or Transfer Function of a linear SISO system can be estimated as (Note.
Data Modeling Patrice Koehl Department of Biological Sciences
EEE 431 Computational Methods in Electrodynamics
Physics 114: Lecture 13 Probability Tests & Linear Fitting
We will be looking for a solution to the system of linear differential equations with constant coefficients.
Sparse and Redundant Representations and Their Applications in
The Simple Linear Regression Model: Specification and Estimation
Sparse and Redundant Representations and Their Applications in
Chapter 3 Section 6.
Chapter 2 Section 1.
Parametric Methods Berlin Chen, 2005 References:
Algebra.
Chapter 2 Determinants.
Solving Linear Equations
Presentation transcript:

Geology 5670/6670 Inverse Theory 12 Jan 2015 © A.R. Lowry 2015 Read for Wed 14 Jan: Menke Ch 2 (15-37) Last time: Course Introduction (Cont’d) Goal is to solve for optimal model parameters from observational data … Usually involving physics of a PDE The gravity example: Linear inversion  linear algebra, and notation conventions for vectors/matrices in this class We define model parameters to be “optimal” based upon minimization of a norm of vector misfit between measurements and model predictions. The L 2 norm is commonly expressed as: or

Solve for T e … This example raises several important questions… Among them, how do we tell a “good” model from a “bad” model? Here used the L 2 norm of misfit between measured and modeled shoreline height differences: We might also ask, what is the uncertainty in the estimate? What are the “hidden” parameters? What physics did we neglect & does it matter? Gilbert Bonneville Provo

Consider another (for some) familiar example: Here, the linear operator on w is & q is the mass load… w + q T is observed Solve for T e & q ?… Part of q B observed…

Clearly the devil’s in the details. In this course we’ll examine: How to express physical relations between data and parameters to solve most easily How to deal with sparse &/or noisy data and spatially or temporally varying parameters How to evaluate the range of possible models that can fit the data within uncertainties (or “robustness” of the best-fit model), and the limitations of the measurements And we will focus on your individual research problems…

Let’s return to Example I: Gravity where G ij is a constant relating density and gravity, m j =  j is the model parameter we want to find. ( L{u} = f where L =  2 )

Note : Here we introduce some notation that will be used as a standard throughout the course. Let: d denote the observational data N be the number of observations m denote the model parameters M be the number of parameters G denote scalar ( kernel ) values relating m to d Then any linear modeling problem can be written as a set of N linear equations of the form: or in matrix notation,

So one can simply solve the set of linear equations: or in matrix notation, for i = 1, …, N equations in j = 1, …, M unknowns (observed)(known)(unknown) r2r2 r1r1 r4r4 r3r3 w

Example II is more difficult, because when parameters are inside the linear operator, the forward model (generally) will be nonlinear. In that case, (We’ll talk about how to solve this case later). For now let’s consider the linear problem: In practice, where m t are the “true” parameters and  are measurement errors. (Note this assumes physics is known and correct: No empiricisms, no simplifying approximations). Then if N = M and G -1 exists, So, if you know something about error in your measurements, you can estimate error in your model parameters…