University of Colorado Boulder ASEN 5070: Statistical Orbit Determination I Fall 2014 Professor Brandon A. Jones Lecture 26: Singular Value Decomposition.

Slides:



Advertisements
Similar presentations
Colorado Center for Astrodynamics Research The University of Colorado ASEN 5070 OD Accuracy Assessment OD Overlap Example Effects of eliminating parameters.
Advertisements

University of Colorado Boulder ASEN 5070: Statistical Orbit Determination I Fall 2014 Professor Brandon A. Jones Lecture 28: Orthogonal Transformations.
University of Colorado Boulder ASEN 5070: Statistical Orbit Determination I Fall 2014 Professor Brandon A. Jones Lecture 24: Numeric Considerations and.
University of Colorado Boulder ASEN 5070: Statistical Orbit Determination I Fall 2014 Professor Brandon A. Jones Lecture 20: Project Discussion and the.
University of Colorado Boulder ASEN 5070 Statistical Orbit determination I Fall 2012 Professor George H. Born Professor Jeffrey S. Parker Lecture 8: Stat.
The Simple Linear Regression Model: Specification and Estimation
Ordinary least squares regression (OLS)
Linear and generalised linear models
University of Colorado Boulder ASEN 5070: Statistical Orbit Determination I Fall 2014 Professor Brandon A. Jones Lecture 7: Linearization and the State.
University of Colorado Boulder ASEN 5070: Statistical Orbit Determination I Fall 2014 Professor Brandon A. Jones Lecture 41: Initial Orbit Determination.
Linear and generalised linear models Purpose of linear models Least-squares solution for linear models Analysis of diagnostics Exponential family and generalised.
Principles of the Global Positioning System Lecture 10 Prof. Thomas Herring Room A;
Principles of Least Squares
University of Colorado Boulder ASEN 5070: Statistical Orbit Determination I Fall 2014 Professor Brandon A. Jones Lecture 37: SNC Example and Solution Characterization.
University of Colorado Boulder ASEN 5070: Statistical Orbit Determination I Fall 2014 Professor Brandon A. Jones Lecture 38: Information Filter.
Principles of the Global Positioning System Lecture 11 Prof. Thomas Herring Room A;
Colorado Center for Astrodynamics Research The University of Colorado STATISTICAL ORBIT DETERMINATION Project Report Unscented kalman Filter Information.
University of Colorado Boulder ASEN 5070 Statistical Orbit Determination I Fall 2012 Professor Jeffrey S. Parker Professor George H. Born Lecture 25: Error.
Colorado Center for Astrodynamics Research The University of Colorado 1 STATISTICAL ORBIT DETERMINATION Satellite Tracking Example of SNC and DMC ASEN.
Bayesian inference review Objective –estimate unknown parameter  based on observations y. Result is given by probability distribution. Bayesian inference.
Linear Regression Andy Jacobson July 2006 Statistical Anecdotes: Do hospitals make you sick? Student’s story Etymology of “regression”
Modern Navigation Thomas Herring
CS 782 – Machine Learning Lecture 4 Linear Models for Classification  Probabilistic generative models  Probabilistic discriminative models.
SUPA Advanced Data Analysis Course, Jan 6th – 7th 2009 Advanced Data Analysis for the Physical Sciences Dr Martin Hendry Dept of Physics and Astronomy.
University of Colorado Boulder ASEN 5070: Statistical Orbit Determination I Fall 2014 Professor Brandon A. Jones Lecture 18: Minimum Variance Estimator.
University of Colorado Boulder ASEN 5070: Statistical Orbit Determination I Fall 2014 Professor Brandon A. Jones Lecture 14: Probability Wrap-Up and Statistical.
ELEC 303 – Random Signals Lecture 18 – Classical Statistical Inference, Dr. Farinaz Koushanfar ECE Dept., Rice University Nov 4, 2010.
Colorado Center for Astrodynamics Research The University of Colorado 1 STATISTICAL ORBIT DETERMINATION ASEN 5070 LECTURE 11 9/16,18/09.
Modern Navigation Thomas Herring MW 11:00-12:30 Room
University of Colorado Boulder ASEN 5070: Statistical Orbit Determination I Fall 2015 Professor Brandon A. Jones Lecture 11: Probability and Statistics.
University of Colorado Boulder ASEN 5070: Statistical Orbit Determination I Fall 2015 Professor Brandon A. Jones Lecture 21: A Bayesian Approach to the.
Colorado Center for Astrodynamics Research The University of Colorado 1 STATISTICAL ORBIT DETERMINATION The Minimum Variance Estimate ASEN 5070 LECTURE.
University of Colorado Boulder ASEN 5070 Statistical Orbit determination I Fall 2012 Professor George H. Born Professor Jeffrey S. Parker Lecture 11: Batch.
Geology 5670/6670 Inverse Theory 21 Jan 2015 © A.R. Lowry 2015 Read for Fri 23 Jan: Menke Ch 3 (39-68) Last time: Ordinary Least Squares Inversion Ordinary.
University of Colorado Boulder ASEN 5070: Statistical Orbit Determination I Fall 2015 Professor Brandon A. Jones Lecture 14: Probability and Statistics.
University of Colorado Boulder ASEN 5070: Statistical Orbit Determination I Fall 2015 Professor Brandon A. Jones Lecture 6: Linearization of OD Problem.
University of Colorado Boulder ASEN 5070 Statistical Orbit Determination I Fall 2012 Professor Jeffrey S. Parker Professor George H. Born Lecture 23: Process.
University of Colorado Boulder ASEN 5070: Statistical Orbit Determination I Fall 2014 Professor Brandon A. Jones Lecture 30: Lecture Quiz, Project Details,
Colorado Center for Astrodynamics Research The University of Colorado 1 STATISTICAL ORBIT DETERMINATION EKF and Observability ASEN 5070 LECTURE 23 10/21/09.
University of Colorado Boulder ASEN 5070: Statistical Orbit Determination I Fall 2015 Professor Brandon A. Jones Lecture 40: Elements of Attitude Estimation.
University of Colorado Boulder ASEN 6008 Interplanetary Mission Design Statistical Orbit Determination A brief overview 1.
University of Colorado Boulder ASEN 5070: Statistical Orbit Determination I Fall 2015 Professor Brandon A. Jones Lecture 17: Minimum Variance Estimator.
University of Colorado Boulder ASEN 5070: Statistical Orbit Determination I Fall 2015 Professor Brandon A. Jones Lecture 32: Gauss-Markov Processes and.
University of Colorado Boulder ASEN 5070 Statistical Orbit determination I Fall 2012 Professor George H. Born Professor Jeffrey S. Parker Lecture 9: Least.
University of Colorado Boulder ASEN 5070: Statistical Orbit Determination I Fall 2014 Professor Brandon A. Jones Lecture 29: Observability and Introduction.
Colorado Center for Astrodynamics Research The University of Colorado 1 STATISTICAL ORBIT DETERMINATION Kalman Filter with Process Noise Gauss- Markov.
University of Colorado Boulder ASEN 5070: Statistical Orbit Determination I Fall 2015 Professor Brandon A. Jones Lecture 22: Further Discussions of the.
University of Colorado Boulder ASEN 5070: Statistical Orbit Determination I Fall 2014 Professor Brandon A. Jones Lecture 10: Weighted LS and A Priori.
University of Colorado Boulder ASEN 5070 Statistical Orbit determination I Fall 2012 Professor George H. Born Professor Jeffrey S. Parker Lecture 10: Batch.
University of Colorado Boulder ASEN 5070: Statistical Orbit Determination I Fall 2015 Professor Brandon A. Jones Lecture 41: Information Filter.
University of Colorado Boulder ASEN 5070: Statistical Orbit Determination I Fall 2015 Professor Brandon A. Jones Lecture 26: Cholesky and Singular Value.
University of Colorado Boulder ASEN 5070: Statistical Orbit Determination I Fall 2015 Professor Brandon A. Jones Lecture 15: Statistical Least Squares.
Statistics 350 Lecture 2. Today Last Day: Section Today: Section 1.6 Homework #1: Chapter 1 Problems (page 33-38): 2, 5, 6, 7, 22, 26, 33, 34,
University of Colorado Boulder ASEN 5070: Statistical Orbit Determination I Fall 2015 Professor Brandon A. Jones Lecture 19: Examples with the Batch Processor.
Geology 5670/6670 Inverse Theory 6 Feb 2015 © A.R. Lowry 2015 Read for Mon 9 Feb: Menke Ch 5 (89-114) Last time: The Generalized Inverse; Damped LS The.
Colorado Center for Astrodynamics Research The University of Colorado 1 STATISTICAL ORBIT DETERMINATION Statistical Interpretation of Least Squares ASEN.
STA302/1001 week 11 Regression Models - Introduction In regression models, two types of variables that are studied:  A dependent variable, Y, also called.
University of Colorado Boulder ASEN 5070: Statistical Orbit Determination I Fall 2014 Professor Brandon A. Jones Lecture 39: Measurement Modeling and Combining.
University of Colorado Boulder ASEN 5070 Statistical Orbit Determination I Fall 2012 Professor Jeffrey S. Parker Professor George H. Born Lecture 18: CKF,
ASEN 5070: Statistical Orbit Determination I Fall 2014
STATISTICAL ORBIT DETERMINATION Kalman (sequential) filter
STATISTICAL ORBIT DETERMINATION Coordinate Systems and Time Kalman Filtering ASEN 5070 LECTURE 21 10/16/09.
ASEN 5070: Statistical Orbit Determination I Fall 2014
ASEN 5070: Statistical Orbit Determination I Fall 2015
Ch3: Model Building through Regression
ASEN 5070: Statistical Orbit Determination I Fall 2015
ASEN 5070: Statistical Orbit Determination I Fall 2014
ASEN 5070: Statistical Orbit Determination I Fall 2015
ASEN 5070: Statistical Orbit Determination I Fall 2015
Principles of the Global Positioning System Lecture 11
Presentation transcript:

University of Colorado Boulder ASEN 5070: Statistical Orbit Determination I Fall 2014 Professor Brandon A. Jones Lecture 26: Singular Value Decomposition and Filter Augmentations

University of Colorado Boulder  Homework due Friday  Lecture quiz due Friday  Exam 2 – Friday, November 7 ◦ No homework or lecture quiz due next week 2

University of Colorado Boulder 3 Lecture Quiz 5

University of Colorado Boulder 4  We recommend that those towards the bottom of the scale review lectures ◦ Next exam may include conceptual questions similar to these!

University of Colorado Boulder  Percent Correct: 68.18% 5  Given infinite precision, the Kalman filter is more accurate than the batch (after one iteration). ◦ True ◦ False

University of Colorado Boulder  Percent Correct: 86.36% 6  We are estimating one-dimensional position and velocity of an object with linear dynamics moving away from the origin in the positive X direction. Before receiving any observations, we have a mean and covariance matrix describing the initial state. We observe the instantaneous distance from the origin to the object over time. We also know the variance of the observation error, which is independent of the state estimate probability density function.  In the scenario above, using a Kalman filter yields a solution Bayes theorem for updating a state estimate PDF. ◦ True ◦ False

University of Colorado Boulder  In the derivation of the Kalman filter as a solution to the Bayesian estimation, what did we assume? 7

University of Colorado Boulder  Percent Correct: 72.73% 8  We have measurements with an observation error variance of 4.0. After processing observations in the batch, we expect the standard deviation of the unweighted post-fit residuals to be: ◦ 1 ◦ 2 ◦ 4 ◦ 8

University of Colorado Boulder  Should examine both the pre- and post-fit residuals: 9

University of Colorado Boulder 10  In the example problem presented before the lecture, we discussed the analysis of residuals.  We expect the statistics of the post-fit residuals to match the observation error statistics ◦ More on this today and Wednesday

University of Colorado Boulder  Percent Correct: 18.18% 11  Given an a priori estimated state for position and velocity (mean and covariance matrix), we can udate the state with a single observation using the minimum variance estimator because: ◦ The minimum norm estimator is mathematically equivalent to the minimum variance estimator. ◦ The information matrix is full rank. ◦ Conceptually, we consider the a priori information as a observation of the true state, thereby yielding more measurements than unknowns. ◦ The minimum variance estimator actually does not work in the scenario described. 41% 64% 73% 9%

University of Colorado Boulder  Minimum Variance: Yields the linear, unbiased, minimum variance estimate of the state  Minimum Norm: Add constraints to the cost function to uniquely determine an estimate state 12

University of Colorado Boulder  This is analogous to treating the a priori information as an observation of the estimated state at the epoch time 13

University of Colorado Boulder  Percent Correct: 31.82% 14  The CKF updates the reference trajectory sequentially, e.g., as observations become available over time. ◦ True ◦ False

University of Colorado Boulder 15 What are we doing with the reference trajectory at each update?

University of Colorado Boulder 16 Singular Value Decomposition

University of Colorado Boulder 17 Singular Value Decomposition-Based Least Squares (not in book)

University of Colorado Boulder  The SVD of any real m×n matrix H is 18

University of Colorado Boulder 19

University of Colorado Boulder  It turns out that we can solve the linear system 20 using the pseudoinverse given by the SVD

University of Colorado Boulder  For the linear system 21 the solution minimizes the least squares cost function

University of Colorado Boulder  Recall that for the normal solution, 22  This squares the condition number of H !  Instead, SVD operates on H, thereby improving solution accuracy

University of Colorado Boulder  The covariance matrix P with R the identity matrix is: 23 Home Practice Exercise: Derive the equation for P above

University of Colorado Boulder  Solving the LS problem via SVD provides one of (if not the most) numerically stable solutions  Also a square-root method (does not square the condition number of H )  Generating the SVD is more computationally intensive than most methods 24

University of Colorado Boulder 25 Predicted Residuals

University of Colorado Boulder  Previously, we have discussed the pre-fit and post-fit residuals:  How can this change in the context of the CKF? 26

University of Colorado Boulder  At each measurement time in the CKF, we can take a look at the prediction residual (sometimes called innovation):  Covariance of the prediction residual (derived in HW 7): 27

University of Colorado Boulder  How might we use the prediction residual PDF? 28

University of Colorado Boulder  Compute the prefit residual variance via 29  An observation may be ignored in the filter if (for example):

University of Colorado Boulder 30 Bias Estimation

University of Colorado Boulder  As shown in the homework, i.e., biased observations, yields a biased estimator.  To compensate, we can estimate the bias: 31

University of Colorado Boulder  What are some example sources of bias in an observation? 32

University of Colorado Boulder  GPS receiver solutions for Jason-2  Antenna is offset ~1.4 meters from COM  What could be causing the bias change after 80 hours? 33