ASEN 5070: Statistical Orbit Determination I Fall 2014

Slides:



Advertisements
Similar presentations
ECE 8443 – Pattern Recognition ECE 8423 – Adaptive Signal Processing Objectives: The Linear Prediction Model The Autocorrelation Method Levinson and Durbin.
Advertisements

University of Colorado Boulder ASEN 5070: Statistical Orbit Determination I Fall 2014 Professor Brandon A. Jones Lecture 28: Orthogonal Transformations.
University of Colorado Boulder ASEN 5070: Statistical Orbit Determination I Fall 2014 Professor Brandon A. Jones Lecture 24: Numeric Considerations and.
University of Colorado Boulder ASEN 5070: Statistical Orbit Determination I Fall 2014 Professor Brandon A. Jones Lecture 20: Project Discussion and the.
MATH 685/ CSI 700/ OR 682 Lecture Notes
Solving Linear Systems (Numerical Recipes, Chap 2)
Linear Systems What is the Matrix?. Outline Announcements: –Homework III: due Wed. by 5, by Office Hours: Today & tomorrow, 11-1 –Ideas for Friday?
ECIV 301 Programming & Graphics Numerical Methods for Engineers Lecture 19 Solution of Linear System of Equations - Iterative Methods.
3D Geometry for Computer Graphics
Math for CSTutorial 41 Contents: 1.Least squares solution for overcomplete linear systems. 2.… via normal equations 3.… via A = QR factorization 4.… via.
Ordinary least squares regression (OLS)
Linear and generalised linear models
Linear Least Squares QR Factorization. Systems of linear equations Problem to solve: M x = b Given M x = b : Is there a solution? Is the solution unique?
ECE 530 – Analysis Techniques for Large-Scale Electrical Systems
University of Colorado Boulder ASEN 5070: Statistical Orbit Determination I Fall 2014 Professor Brandon A. Jones Lecture 7: Linearization and the State.
Linear and generalised linear models Purpose of linear models Least-squares solution for linear models Analysis of diagnostics Exponential family and generalised.
Adaptive Signal Processing
University of Colorado Boulder ASEN 5070: Statistical Orbit Determination I Fall 2014 Professor Brandon A. Jones Lecture 38: Information Filter.
Principles of the Global Positioning System Lecture 13 Prof. Thomas Herring Room A;
Colorado Center for Astrodynamics Research The University of Colorado STATISTICAL ORBIT DETERMINATION Project Report Unscented kalman Filter Information.
University of Colorado Boulder ASEN 5070 Statistical Orbit Determination I Fall 2012 Professor Jeffrey S. Parker Professor George H. Born Lecture 25: Error.
Advanced Computer Graphics Spring 2014 K. H. Ko School of Mechatronics Gwangju Institute of Science and Technology.
Linear Regression Andy Jacobson July 2006 Statistical Anecdotes: Do hospitals make you sick? Student’s story Etymology of “regression”
University of Colorado Boulder ASEN 5070: Statistical Orbit Determination I Fall 2014 Professor Brandon A. Jones Lecture 18: Minimum Variance Estimator.
University of Colorado Boulder ASEN 5070: Statistical Orbit Determination I Fall 2014 Professor Brandon A. Jones Lecture 14: Probability Wrap-Up and Statistical.
University of Colorado Boulder ASEN 5070: Statistical Orbit Determination I Fall 2014 Professor Brandon A. Jones Lecture 26: Singular Value Decomposition.
MATH 685/ CSI 700/ OR 682 Lecture Notes Lecture 4. Least squares.
Linear Predictive Analysis 主講人:虞台文. Contents Introduction Basic Principles of Linear Predictive Analysis The Autocorrelation Method The Covariance Method.
Lesson 3 CSPP58001.
Introduction to Matrices Douglas N. Greve
Colorado Center for Astrodynamics Research The University of Colorado 1 STATISTICAL ORBIT DETERMINATION The Minimum Variance Estimate ASEN 5070 LECTURE.
University of Colorado Boulder ASEN 5070 Statistical Orbit determination I Fall 2012 Professor George H. Born Professor Jeffrey S. Parker Lecture 11: Batch.
Lecture 10 - Nonlinear gradient techniques and LU Decomposition CVEN 302 June 24, 2002.
Dept. E.E./ESAT-STADIUS, KU Leuven
University of Colorado Boulder ASEN 5070: Statistical Orbit Determination I Fall 2015 Professor Brandon A. Jones Lecture 14: Probability and Statistics.
University of Colorado Boulder ASEN 5070: Statistical Orbit Determination I Fall 2014 Professor Brandon A. Jones Lecture 30: Lecture Quiz, Project Details,
University of Colorado Boulder ASEN 5070: Statistical Orbit Determination I Fall 2015 Professor Brandon A. Jones Lecture 40: Elements of Attitude Estimation.
University of Colorado Boulder ASEN 5070: Statistical Orbit Determination I Fall 2015 Professor Brandon A. Jones Lecture 8: State Transition Matrix, Part.
University of Colorado Boulder ASEN 5070: Statistical Orbit Determination I Fall 2015 Professor Brandon A. Jones Lecture 17: Minimum Variance Estimator.
University of Colorado Boulder ASEN 5070 Statistical Orbit determination I Fall 2012 Professor George H. Born Professor Jeffrey S. Parker Lecture 9: Least.
University of Colorado Boulder ASEN 5070: Statistical Orbit Determination I Fall 2014 Professor Brandon A. Jones Lecture 29: Observability and Introduction.
Colorado Center for Astrodynamics Research The University of Colorado 1 STATISTICAL ORBIT DETERMINATION Kalman Filter with Process Noise Gauss- Markov.
University of Colorado Boulder ASEN 5070: Statistical Orbit Determination I Fall 2015 Professor Brandon A. Jones Lecture 22: Further Discussions of the.
University of Colorado Boulder ASEN 5070: Statistical Orbit Determination I Fall 2014 Professor Brandon A. Jones Lecture 10: Weighted LS and A Priori.
University of Colorado Boulder ASEN 5070 Statistical Orbit determination I Fall 2012 Professor George H. Born Professor Jeffrey S. Parker Lecture 10: Batch.
University of Colorado Boulder ASEN 5070: Statistical Orbit Determination I Fall 2015 Professor Brandon A. Jones Lecture 41: Information Filter.
ECE 530 – Analysis Techniques for Large-Scale Electrical Systems Prof. Hao Zhu Dept. of Electrical and Computer Engineering University of Illinois at Urbana-Champaign.
Geology 5670/6670 Inverse Theory 4 Feb 2015 © A.R. Lowry 2015 Read for Fri 6 Feb: Menke Ch 4 (69-88) Last time: The Generalized Inverse The Generalized.
University of Colorado Boulder ASEN 5070: Statistical Orbit Determination I Fall 2015 Professor Brandon A. Jones Lecture 26: Cholesky and Singular Value.
University of Colorado Boulder ASEN 5070: Statistical Orbit Determination I Fall 2015 Professor Brandon A. Jones Lecture 15: Statistical Least Squares.
DSP-CIS Part-III : Optimal & Adaptive Filters Chapter-9 : Kalman Filters Marc Moonen Dept. E.E./ESAT-STADIUS, KU Leuven
University of Colorado Boulder ASEN 5070: Statistical Orbit Determination I Fall 2015 Professor Brandon A. Jones Lecture 19: Examples with the Batch Processor.
Numerical Computation Lecture 6: Linear Systems – part II United International College.
Colorado Center for Astrodynamics Research The University of Colorado 1 STATISTICAL ORBIT DETERMINATION Statistical Interpretation of Least Squares ASEN.
Thomas F. Edgar (UT-Austin) RLS – Linear Models Virtual Control Book 12/06 Recursive Least Squares Parameter Estimation for Linear Steady State and Dynamic.
University of Colorado Boulder ASEN 5070 Statistical Orbit Determination I Fall 2012 Professor Jeffrey S. Parker Professor George H. Born Lecture 18: CKF,
STATISTICAL ORBIT DETERMINATION Kalman (sequential) filter
Introduction to Matrices
STATISTICAL ORBIT DETERMINATION Coordinate Systems and Time Kalman Filtering ASEN 5070 LECTURE 21 10/16/09.
ASEN 5070: Statistical Orbit Determination I Fall 2014
ASEN 5070: Statistical Orbit Determination I Fall 2015
ASEN 5070: Statistical Orbit Determination I Fall 2015
ASEN 5070: Statistical Orbit Determination I Fall 2015
ASEN 5070: Statistical Orbit Determination I Fall 2014
ASEN 5070: Statistical Orbit Determination I Fall 2015
ASEN 5070: Statistical Orbit Determination I Fall 2015
RECORD. RECORD Gaussian Elimination: derived system back-substitution.
Numerical Analysis Lecture 16.
Principles of the Global Positioning System Lecture 13
Major: All Engineering Majors Authors: Autar Kaw
Presentation transcript:

ASEN 5070: Statistical Orbit Determination I Fall 2014 Professor Brandon A. Jones Lecture 25: Potter Algorithm and Decomposition Methods

Announcements/Reminders Homework 8 Due Friday (10/31) Lecture Quizzes Due by 5pm Today Next one due by 5pm 10/31 Exam 2 – Friday, November 7

Announcements/Reminders

Xkcd Comic (http://xkcd.com/1132/)

Potter Algorithm (continued)

Covariance Condition Number The condition number of P may be described by With p significant digits, there are estimation difficulties as If we can’t change the condition number, is there something else we can do?

Square-Root Formulation For W above, the condition number is Is there something we can do to instead operate on W ?

Time Update for W (one method)

Derivation so far…

Potter Algorithm Assumptions We must process the observations one at a time If we have multiple observations at a single time, this requires that R be diagonal. What can we do if the observations at a single time have a non-zero correlation?

Potter Square-Root Filter Derivation

Potter Square-Root Filter Derivation

Potter Square-Root Filter Derivation

Potter Measurement Update Process the observations one at a time Repeat if multiple observations available at a single time More computationally expensive than Kalman, but more accurate W after the measurement update is not triangular! (Important for some algorithms) Motivates the derivation of the triangular square-root method (pp. 335-340)

How do we get W ? If we are given P as a priori information, how do we get W ? If P is diagonal, this is trivial: Great, but what if it isn’t diagonal? Cholesky decomposition

Cholesky Decomposition

Square-Root Methods Provides improved numeric stability Method defined by Atilde Potter algorithm assumed the processing of one measurement at a time

How do we get W ? If we are given P as a priori information, how do we get W ? If P is diagonal, this is easy: Great, but what if it isn’t diagonal? Cholesky decomposition

Cholesky Decomposition Cholesky Decomposition of p.d. matrix: MATLAB:

Solution Algorithm Algorithm found in book Eq. 5.2.6 Implementations readily available in most high-level languages: MATLAB: Be sure to check the documentation for default behavior (lower or upper)

Cholesky-Based Least Squares

Weighted LS w/ A Priori Recall the weighted least squares: Instead, we will write: M is the information matrix

Solution via Inversion Usually, we solve via matrix inversion If the number of estimated parameters is large, then this is expensive and possibly inaccurate Estimate gravity field of degree 360 n ≈ 129,600

Solution via Cholesky Decomposition Instead, let’s write the equations in terms of the Cholesky decomposition R here is not the obs. error covariance matrix!

Solve for z Using Forward Substitution Eq. 5.2.7 in the Book

Solve for x Using Backward Substitution Eq. 5.2.8 in the Book

Covariance Matrix Solution We may also solve for the covariance matrix using the Cholesky decomposition

Covariance Matrix Solution Using this directly still requires an n×n matrix inversion! Eq. 5.2.9 provides a simple algorithm to get S by leveraging

Covariance Matrix Solution Eq. 5.2.9:

SVD-Based Least Squares (not in book)

Singular Value Decomposition (SVD) The SVD of any real m×n matrix H is

Pseudoinverse via SVD

Pseudoinverse via SVD It turns out that we can solve the linear system using the pseudoinverse given by the SVD

LS Solution via SVD For the linear system the solution minimizes the least squares cost function

Improved Conditioning with SVD Recall that for the normal solution, This squares the condition number of H ! Instead, SVD operates on H, thereby improving solution accuracy

State Estimate Covariance via SVD The covariance matrix P with R the identity matrix is: Home Practice Exercise: Derive the equation for P above

Advantages/Disadvantages of SVD Solving the LS problem via SVD provides one of (if not the most) numerically stable solutions Also a square-root method (does not square the condition number of H ) Generating the SVD is more computationally intensive than most methods