Least Squares Measurement model Weighted LSQ  Optimal estimates  Linear  Unbiased  Minimum variance.

Slides:



Advertisements
Similar presentations
Modeling of Data. Basic Bayes theorem Bayes theorem relates the conditional probabilities of two events A, and B: A might be a hypothesis and B might.
Advertisements

State Space Models. Let { x t :t T} and { y t :t T} denote two vector valued time series that satisfy the system of equations: y t = A t x t + v t (The.
The Maximum Likelihood Method
Ordinary Least-Squares
Dates for term tests Friday, February 07 Friday, March 07
GPS Theory and applications
CmpE 104 SOFTWARE STATISTICAL TOOLS & METHODS MEASURING & ESTIMATING SOFTWARE SIZE AND RESOURCE & SCHEDULE ESTIMATING.
AGC DSP AGC DSP Professor A G Constantinides©1 Modern Spectral Estimation Modern Spectral Estimation is based on a priori assumptions on the manner, the.
OPTIMUM FILTERING.
Visual Recognition Tutorial
Simple Linear Regression
Point estimation, interval estimation
AGC DSP AGC DSP Professor A G Constantinides© Estimation Theory We seek to determine from a set of data, a set of parameters such that their values would.
SUMS OF RANDOM VARIABLES Changfei Chen. Sums of Random Variables Let be a sequence of random variables, and let be their sum:
SYSTEMS Identification
Probability theory 2011 The multivariate normal distribution  Characterizing properties of the univariate normal distribution  Different definitions.
Linear Regression and Correlation Analysis
GPS/Dead Reckoning Navigation with Kalman Filter Integration
Ordinary least squares regression (OLS)
Estimation and the Kalman Filter David Johnson. The Mean of a Discrete Distribution “I have more legs than average”
Linear and generalised linear models Purpose of linear models Least-squares solution for linear models Analysis of diagnostics Exponential family and generalised.
Probability theory 2008 Outline of lecture 5 The multivariate normal distribution  Characterizing properties of the univariate normal distribution  Different.
Principles of the Global Positioning System Lecture 10 Prof. Thomas Herring Room A;
Adaptive Signal Processing
Principles of the Global Positioning System Lecture 13 Prof. Thomas Herring Room A;
Chapter 15 Modeling of Data. Statistics of Data Mean (or average): Variance: Median: a value x j such that half of the data are bigger than it, and half.
Modern Navigation Thomas Herring MW 11:00-12:30 Room A
Geo479/579: Geostatistics Ch12. Ordinary Kriging (1)
Mathematical Preliminaries. 37 Matrix Theory Vectors nth element of vector u : u(n) Matrix mth row and nth column of A : a(m,n) column vector.
Kalman Filter (Thu) Joon Shik Kim Computational Models of Intelligence.
Linear Regression Andy Jacobson July 2006 Statistical Anecdotes: Do hospitals make you sick? Student’s story Etymology of “regression”
ECE 8443 – Pattern Recognition ECE 8423 – Adaptive Signal Processing Objectives: Deterministic vs. Random Maximum A Posteriori Maximum Likelihood Minimum.
Modern Navigation Thomas Herring
SUPA Advanced Data Analysis Course, Jan 6th – 7th 2009 Advanced Data Analysis for the Physical Sciences Dr Martin Hendry Dept of Physics and Astronomy.
The “ ” Paige in Kalman Filtering K. E. Schubert.
SVY 207: Lecture 7 Differential GPS By now you should understand: –How GPS point positioning works from first principles Aim of this lecture: –To understand.
Geology 5670/6670 Inverse Theory 21 Jan 2015 © A.R. Lowry 2015 Read for Fri 23 Jan: Menke Ch 3 (39-68) Last time: Ordinary Least Squares Inversion Ordinary.
Robotics Research Laboratory 1 Chapter 7 Multivariable and Optimal Control.
NCAF Manchester July 2000 Graham Hesketh Information Engineering Group Rolls-Royce Strategic Research Centre.
Principles of the Global Positioning System Lecture 12 Prof. Thomas Herring Room ;
SYSTEMS Identification Ali Karimpour Assistant Professor Ferdowsi University of Mashhad Reference: “System Identification Theory For The User” Lennart.
West Hills College Farm of the Future. West Hills College Farm of the Future Precision Agriculture – Lesson 2 What is GPS? Global Positioning System Operated.
Chapter 2 GPS Crop Science 6 Fall 2004 October 22, 2004.
An Introduction To The Kalman Filter By, Santhosh Kumar.
University of Colorado Boulder ASEN 5070: Statistical Orbit Determination I Fall 2015 Professor Brandon A. Jones Lecture 6: Linearization of OD Problem.
Pseudoranges to Four Satellites
1 SVY 207: Lecture 6 Point Positioning –By now you should understand: F How receiver knows GPS satellite coordinates F How receiver produces pseudoranges.
1 On the Channel Capacity of Wireless Fading Channels C. D. Charalambous and S. Z. Denic School of Information Technology and Engineering, University of.
University of Colorado Boulder ASEN 5070 Statistical Orbit determination I Fall 2012 Professor George H. Born Professor Jeffrey S. Parker Lecture 9: Least.
Colorado Center for Astrodynamics Research The University of Colorado 1 STATISTICAL ORBIT DETERMINATION Kalman Filter with Process Noise Gauss- Markov.
Method of Least Squares Advanced Topic of Lecture on Astrometry.
R. Kass/W03 P416 Lecture 5 l Suppose we are trying to measure the true value of some quantity (x T ). u We make repeated measurements of this quantity.
Computacion Inteligente Least-Square Methods for System Identification.
Week 21 Statistical Model A statistical model for some data is a set of distributions, one of which corresponds to the true unknown distribution that produced.
Econometrics III Evgeniya Anatolievna Kolomak, Professor.
Estimation Econometría. ADE.. Estimation We assume we have a sample of size T of: – The dependent variable (y) – The explanatory variables (x 1,x 2, x.
Presentation : “ Maximum Likelihood Estimation” Presented By : Jesu Kiran Spurgen Date :
Colorado Center for Astrodynamics Research The University of Colorado 1 STATISTICAL ORBIT DETERMINATION Statistical Interpretation of Least Squares ASEN.
CWR 6536 Stochastic Subsurface Hydrology Optimal Estimation of Hydrologic Parameters.
The Maximum Likelihood Method
ELG5377 Adaptive Signal Processing
Probability Theory and Parameter Estimation I
Global Positioning System Supplemental from JD Text
The Maximum Likelihood Method
Probabilistic Robotics
The Maximum Likelihood Method
The regression model in matrix form
Singular Value Decomposition SVD
Parametric Methods Berlin Chen, 2005 References:
Kalman Filter: Bayes Interpretation
Presentation transcript:

Least Squares Measurement model Weighted LSQ  Optimal estimates  Linear  Unbiased  Minimum variance

White Gaussian noise sequence Random sequence  Sequence of random variable:  Discrete random process  Let White noise sequence  If White Gaussian sequence  If it is white and each is normal

Measurement equation Observation eq. Of Linear system   where : the state sequence : the deterministic control sequence : measured data sequence : Constant known matrix : Zero mean white Gaussian measurement noise –With

Optimal Estimate Obtain optimal estimate of state vector from the information  What is optimal ?  Minimum estimation error:  Error free case 

Cost function We wish to minimize   Where Find such that   And optimum weight Note that if, then ordinary LSQ

Least Squares Estimates Let be nonsingular  Then show that (Exercise 1.11)   It has minimum when   Or What happens when is singular ?

Optimal Weight W k Define estimate error  Find W k which minimize 

W k = R k -1 For positive definite symmetric R k  SVD :  Schwarz inequality  with  Therefore, W k = R k -1  Since,

Least Squares Optimal Estimate With W k = R k -1, optimal estimates of x k  Unbiased estimate of x k  Minimum variance estimate of x k  Consistent estimate

Application of Least Squares Estimation Least Squares Estimation Definition of GDOP Variation of GDOP: PDOP, HDOP, …. 10

WLS at GPS Given Code measurement  or Linearizing at Nominal Point:  Taylor Series:  Code measurement becomes Define and  Then  where is LOS(line of Sight) vector between and Satellite 11

WLS at GPS (cont) For m Satellite  Let Covariance of measurement is   Then LSQ gives   where 12

WLS at GPS (cont) 13 S4 S2 S1 S3 (X 1,Y 1,Z 1 ) (X 2,Y 2,Z 2 ) (X 3,Y 3,Z 3 ) (X 4,Y 4,Z 4 ) PseudoRange Measurement PR=R TRUE +Bias B BB B R=True Distance between Satellite and User B=Distance Error Due to Clock Bias R1 R2 R3 R4 P0P0 h1h1 h2h2 h3h3 h4h4 P  = A  u

WLS at GPS (cont) Covariance of Estimates  Least Square Estimation  Assume performance of each channel is same:  Then Estimation Error is affected by  Receiver performance  C/A code:  Carrier Phase:  User-Satellite Geometry: Quantitative Measure?  14

Definition of GDOP Define where Definition of GDOP  Note  Estimation Error can be expressed  15

Meaning of Positioning Error = GDOP x UERE  UERE: User Equivalent Ranging Error  Ionospheric delay + Troposheric delay + Multipath + Receiver Noise  GDOP amplifies UERE  Design of Constellation is very important  Selection Satellites which gives small GDOP To reduce Positioning Error Both GDOP and UERE are concerned 16

Meaning of GDOP Bad GDOPGood GDOP 17 UERE

Coordinate Transformation Transform WGS-84 to ENU   where Covariance Transformation  Thus Errors in ENU 18 x y z N E E

GDOP in ENU Definition of GDOP  Other DOPs  19

Applications of GDOP Predicts Positioning Error Constellation Design Selection of Satellites 20