Colorado Center for Astrodynamics Research The University of Colorado 1 STATISTICAL ORBIT DETERMINATION Statistical Interpretation of Least Squares ASEN.

Slides:



Advertisements
Similar presentations
The Maximum Likelihood Method
Advertisements

11-1 Empirical Models Many problems in engineering and science involve exploring the relationships between two or more variables. Regression analysis.
Colorado Center for Astrodynamics Research The University of Colorado ASEN 5070 OD Accuracy Assessment OD Overlap Example Effects of eliminating parameters.
ECE 8443 – Pattern Recognition LECTURE 05: MAXIMUM LIKELIHOOD ESTIMATION Objectives: Discrete Features Maximum Likelihood Resources: D.H.S: Chapter 3 (Part.
The adjustment of the observations
University of Colorado Boulder ASEN 5070 Statistical Orbit determination I Fall 2012 Professor George H. Born Professor Jeffrey S. Parker Lecture 8: Stat.
The Simple Linear Regression Model: Specification and Estimation
Lecture 6 Resolution and Generalized Inverses. Syllabus Lecture 01Describing Inverse Problems Lecture 02Probability and Measurement Error, Part 1 Lecture.
458 Fitting models to data – II (The Basics of Maximum Likelihood Estimation) Fish 458, Lecture 9.
AGC DSP AGC DSP Professor A G Constantinides© Estimation Theory We seek to determine from a set of data, a set of parameters such that their values would.
Lecture 8 The Principle of Maximum Likelihood. Syllabus Lecture 01Describing Inverse Problems Lecture 02Probability and Measurement Error, Part 1 Lecture.
Linear and generalised linear models
University of Colorado Boulder ASEN 5070: Statistical Orbit Determination I Fall 2014 Professor Brandon A. Jones Lecture 7: Linearization and the State.
Basic Mathematics for Portfolio Management. Statistics Variables x, y, z Constants a, b Observations {x n, y n |n=1,…N} Mean.
Linear and generalised linear models
Basics of regression analysis
Linear and generalised linear models Purpose of linear models Least-squares solution for linear models Analysis of diagnostics Exponential family and generalised.
Techniques for studying correlation and covariance structure
Modern Navigation Thomas Herring
Principles of the Global Positioning System Lecture 10 Prof. Thomas Herring Room A;
Separate multivariate observations
Adaptive Signal Processing
Principles of the Global Positioning System Lecture 11 Prof. Thomas Herring Room A;
Colorado Center for Astrodynamics Research The University of Colorado STATISTICAL ORBIT DETERMINATION Project Report Unscented kalman Filter Information.
Chapter 15 Modeling of Data. Statistics of Data Mean (or average): Variance: Median: a value x j such that half of the data are bigger than it, and half.
Linear Regression Andy Jacobson July 2006 Statistical Anecdotes: Do hospitals make you sick? Student’s story Etymology of “regression”
ECE 8443 – Pattern Recognition ECE 8423 – Adaptive Signal Processing Objectives: Deterministic vs. Random Maximum A Posteriori Maximum Likelihood Minimum.
Modern Navigation Thomas Herring
Chapter 21 R(x) Algorithm a) Anomaly Detection b) Matched Filter.
CS 782 – Machine Learning Lecture 4 Linear Models for Classification  Probabilistic generative models  Probabilistic discriminative models.
SUPA Advanced Data Analysis Course, Jan 6th – 7th 2009 Advanced Data Analysis for the Physical Sciences Dr Martin Hendry Dept of Physics and Astronomy.
University of Colorado Boulder ASEN 5070: Statistical Orbit Determination I Fall 2014 Professor Brandon A. Jones Lecture 18: Minimum Variance Estimator.
1 E. Fatemizadeh Statistical Pattern Recognition.
University of Colorado Boulder ASEN 5070: Statistical Orbit Determination I Fall 2014 Professor Brandon A. Jones Lecture 26: Singular Value Decomposition.
Colorado Center for Astrodynamics Research The University of Colorado 1 STATISTICAL ORBIT DETERMINATION ASEN 5070 LECTURE 11 9/16,18/09.
Colorado Center for Astrodynamics Research The University of Colorado 1 STATISTICAL ORBIT DETERMINATION The Minimum Variance Estimate ASEN 5070 LECTURE.
University of Colorado Boulder ASEN 5070 Statistical Orbit determination I Fall 2012 Professor George H. Born Professor Jeffrey S. Parker Lecture 11: Batch.
Geology 5670/6670 Inverse Theory 21 Jan 2015 © A.R. Lowry 2015 Read for Fri 23 Jan: Menke Ch 3 (39-68) Last time: Ordinary Least Squares Inversion Ordinary.
Colorado Center for Astrodynamics Research The University of Colorado 1 STATISTICAL ORBIT DETERMINATION Probability and statistics review ASEN 5070 LECTURE.
University of Colorado Boulder ASEN 5070: Statistical Orbit Determination I Fall 2015 Professor Brandon A. Jones Lecture 14: Probability and Statistics.
University of Colorado Boulder ASEN 5070: Statistical Orbit Determination I Fall 2015 Professor Brandon A. Jones Lecture 6: Linearization of OD Problem.
University of Colorado Boulder ASEN 5070: Statistical Orbit Determination I Fall 2014 Professor Brandon A. Jones Lecture 30: Lecture Quiz, Project Details,
SVY207: Lecture 10 Computation of Relative Position from Carrier Phase u Observation Equation u Linear dependence of observations u Baseline solution –Weighted.
Colorado Center for Astrodynamics Research The University of Colorado 1 STATISTICAL ORBIT DETERMINATION EKF and Observability ASEN 5070 LECTURE 23 10/21/09.
University of Colorado Boulder ASEN 5070: Statistical Orbit Determination I Fall 2015 Professor Brandon A. Jones Lecture 17: Minimum Variance Estimator.
University of Colorado Boulder ASEN 5070 Statistical Orbit determination I Fall 2012 Professor George H. Born Professor Jeffrey S. Parker Lecture 9: Least.
Colorado Center for Astrodynamics Research The University of Colorado 1 STATISTICAL ORBIT DETERMINATION Kalman Filter with Process Noise Gauss- Markov.
Week 21 Order Statistics The order statistics of a set of random variables X 1, X 2,…, X n are the same random variables arranged in increasing order.
University of Colorado Boulder ASEN 5070: Statistical Orbit Determination I Fall 2014 Professor Brandon A. Jones Lecture 10: Weighted LS and A Priori.
University of Colorado Boulder ASEN 5070 Statistical Orbit determination I Fall 2012 Professor George H. Born Professor Jeffrey S. Parker Lecture 10: Batch.
R. Kass/W03 P416 Lecture 5 l Suppose we are trying to measure the true value of some quantity (x T ). u We make repeated measurements of this quantity.
Learning Theory Reza Shadmehr Distribution of the ML estimates of model parameters Signal dependent noise models.
University of Colorado Boulder ASEN 5070: Statistical Orbit Determination I Fall 2015 Professor Brandon A. Jones Lecture 26: Cholesky and Singular Value.
Week 21 Statistical Model A statistical model for some data is a set of distributions, one of which corresponds to the true unknown distribution that produced.
Statistics 350 Lecture 2. Today Last Day: Section Today: Section 1.6 Homework #1: Chapter 1 Problems (page 33-38): 2, 5, 6, 7, 22, 26, 33, 34,
University of Colorado Boulder ASEN 5070: Statistical Orbit Determination I Fall 2015 Professor Brandon A. Jones Lecture 19: Examples with the Batch Processor.
University of Colorado Boulder ASEN 5070 Statistical Orbit Determination I Fall 2012 Professor Jeffrey S. Parker Professor George H. Born Lecture 18: CKF,
ASEN 5070: Statistical Orbit Determination I Fall 2014
STATISTICAL ORBIT DETERMINATION Kalman (sequential) filter
(5) Notes on the Least Squares Estimate
STATISTICAL ORBIT DETERMINATION Coordinate Systems and Time Kalman Filtering ASEN 5070 LECTURE 21 10/16/09.
ASEN 5070: Statistical Orbit Determination I Fall 2014
ASEN 5070: Statistical Orbit Determination I Fall 2015
Ch3: Model Building through Regression
CH 5: Multivariate Methods
The Maximum Likelihood Method
ASEN 5070: Statistical Orbit Determination I Fall 2015
The Regression Model Suppose we wish to estimate the parameters of the following relationship: A common method is to choose parameters to minimise the.
6.5 Taylor Series Linearization
Consider Covariance Analysis Example 6.9, Spring-Mass
Presentation transcript:

Colorado Center for Astrodynamics Research The University of Colorado 1 STATISTICAL ORBIT DETERMINATION Statistical Interpretation of Least Squares ASEN 5070 LECTURE 15 9/28/09

Colorado Center for Astrodynamics Research The University of Colorado 2 Statistical Interpretation of Least Squares Show that is an unbiased estimator of, i.e., where Assume that 1 st two moments of the probability density function for are known, i.e.,, From the least squares solution we have that But, i.e., is the true value Hence, and is an unbiased estimate of.

Colorado Center for Astrodynamics Research The University of Colorado 3 Statistical Interpretation of Least Squares Determine the mean and variance-covariance matrix of the estimation error,, for the weighted least squares estimate,. Because is unbiased With variance-covariance matrix (usually simply referred to as the “covariance matrix”), P From the normal equation

Colorado Center for Astrodynamics Research The University of Colorado 4 Statistical Interpretation of Least Squares (Cont.) Substitute into Eq (1) or If Then,

Colorado Center for Astrodynamics Research The University of Colorado 5 Statistical Interpretation of Least Squares If apriori information and are given, where True value Apriori value Error in Assume Then We have shown that the normal equation in this case is Recall that the estimation error is given by

Colorado Center for Astrodynamics Research The University of Colorado 6 Statistical Interpretation of Least Squares It can be shown that and, hence, and

Colorado Center for Astrodynamics Research The University of Colorado 7 Statistical Interpretation of Least Squares Define Then Assume that and are uncorrelated, then and

Colorado Center for Astrodynamics Research The University of Colorado 8 Statistical Interpretation of Least Squares Hence, the observation error covariance matrix in given by The quantity is called the information matrix,, i.e. For example, ifthen If are x and y unobservable?

Colorado Center for Astrodynamics Research The University of Colorado 9 Statistical Interpretation of Least Squares Recall that Generally will be a diagonal matrix If we do not wish to estimate a parameter (say ) we may leave it out of the state deviation vector or set its apriori variance to a very small number i.e., (say ) This will result in

Colorado Center for Astrodynamics Research The University of Colorado 10 Statistical Interpretation of Least Squares Demonstrate this for a 2-D case. Let, assume Where and so and

Colorado Center for Astrodynamics Research The University of Colorado 11 Statistical Interpretation of Least Squares let, then but,,, Thus

Colorado Center for Astrodynamics Research The University of Colorado 12 Statistical Interpretation of Least Squares with Hence Note that and is effected by

Colorado Center for Astrodynamics Research The University of Colorado 13 Statistical Interpretation of Least Squares Example Problem I. The state vector is given by where and are constants. An a priori value is given with its relative accuracy described by the matrix,. Three observations of the state are given by: The relative accuracy of the three observations is given by the weighting matrix, 1. Set up a step by step algorithm describing how you would solve for the weighted least squares estimate,, including use of the a priori information. Define the, and matrices (i.e., what is each element of the matrices).

Colorado Center for Astrodynamics Research The University of Colorado 14 Statistical Interpretation of Least Squares Answer the following questions: 2. Is the observation – state relationship linear or nonlinear? 3. Was it necessary to use both a state and observation deviation vector? 4. Do the and matrices differ for this problem? Why or why not? 5. Was it necessary to generated a computed observation for this problem? Why or why not?

Colorado Center for Astrodynamics Research The University of Colorado 15 Statistical Interpretation of Least Squares II. Given the system with the state vector defined by a.Write the linearized equations in state space form, b.How would you determine the state transition matrix for this system? Is additional information needed to generate the state transition matrix?

Colorado Center for Astrodynamics Research The University of Colorado Statistical Interpretation of Least Squares 16