University of Colorado Boulder ASEN 5070: Statistical Orbit Determination I Fall 2015 Professor Brandon A. Jones Lecture 17: Minimum Variance Estimator.

Slides:



Advertisements
Similar presentations
University of Colorado Boulder ASEN 5070: Statistical Orbit Determination I Fall 2014 Professor Brandon A. Jones Lecture 5: State Deviations and Fundamentals.
Advertisements

The Simple Regression Model
Statistical Techniques I EXST7005 Simple Linear Regression.
University of Colorado Boulder ASEN 5070: Statistical Orbit Determination I Fall 2014 Professor Brandon A. Jones Lecture 28: Orthogonal Transformations.
Quantitative Methods 2 Lecture 3 The Simple Linear Regression Model Edmund Malesky, Ph.D., UCSD.
University of Colorado Boulder ASEN 5070: Statistical Orbit Determination I Fall 2014 Professor Brandon A. Jones Lecture 24: Numeric Considerations and.
Christopher Dougherty EC220 - Introduction to econometrics (chapter 7) Slideshow: exercise 7.5 Original citation: Dougherty, C. (2012) EC220 - Introduction.
University of Colorado Boulder ASEN 5070: Statistical Orbit Determination I Fall 2014 Professor Brandon A. Jones Lecture 20: Project Discussion and the.
The General Linear Model. The Simple Linear Model Linear Regression.
University of Colorado Boulder ASEN 5070 Statistical Orbit determination I Fall 2012 Professor George H. Born Professor Jeffrey S. Parker Lecture 8: Stat.
ISEN 601 Location Logistics Dr. Gary M. Gaukler Fall 2011.
Simple Linear Regression
AGC DSP AGC DSP Professor A G Constantinides© Estimation Theory We seek to determine from a set of data, a set of parameters such that their values would.
University of Colorado Boulder ASEN 5070: Statistical Orbit Determination I Fall 2014 Professor Brandon A. Jones Lecture 7: Linearization and the State.
Basic Mathematics for Portfolio Management. Statistics Variables x, y, z Constants a, b Observations {x n, y n |n=1,…N} Mean.
EC220 - Introduction to econometrics (review chapter)
1 UNBIASEDNESS AND EFFICIENCY Much of the analysis in this course will be concerned with three properties of estimators: unbiasedness, efficiency, and.
Today Wrap up of probability Vectors, Matrices. Calculus
University of Colorado Boulder ASEN 5070: Statistical Orbit Determination I Fall 2014 Professor Brandon A. Jones Lecture 38: Information Filter.
Colorado Center for Astrodynamics Research The University of Colorado STATISTICAL ORBIT DETERMINATION Project Report Unscented kalman Filter Information.
Introduction to Linear Regression and Correlation Analysis
University of Colorado Boulder ASEN 5070 Statistical Orbit Determination I Fall 2012 Professor Jeffrey S. Parker Professor George H. Born Lecture 25: Error.
Regression Analysis (2)
Geo479/579: Geostatistics Ch12. Ordinary Kriging (1)
University of Colorado Boulder ASEN 5070: Statistical Orbit Determination I Fall 2014 Professor Brandon A. Jones Lecture 34: Probability Ellipsoids.
University of Colorado Boulder ASEN 5070 Statistical Orbit determination I Fall 2012 Professor George H. Born Professor Jeffrey S. Parker Lecture 7: Spaceflight.
Linear Regression Andy Jacobson July 2006 Statistical Anecdotes: Do hospitals make you sick? Student’s story Etymology of “regression”
University of Colorado Boulder ASEN 5070: Statistical Orbit Determination I Fall 2014 Professor Brandon A. Jones Lecture 18: Minimum Variance Estimator.
University of Colorado Boulder ASEN 5070: Statistical Orbit Determination I Fall 2014 Professor Brandon A. Jones Lecture 14: Probability Wrap-Up and Statistical.
University of Colorado Boulder ASEN 5070: Statistical Orbit Determination I Fall 2014 Professor Brandon A. Jones Lecture 26: Singular Value Decomposition.
Colorado Center for Astrodynamics Research The University of Colorado 1 STATISTICAL ORBIT DETERMINATION ASEN 5070 LECTURE 11 9/16,18/09.
University of Colorado Boulder ASEN 5070: Statistical Orbit Determination I Fall 2015 Professor Brandon A. Jones Lecture 21: A Bayesian Approach to the.
Colorado Center for Astrodynamics Research The University of Colorado 1 STATISTICAL ORBIT DETERMINATION The Minimum Variance Estimate ASEN 5070 LECTURE.
University of Colorado Boulder ASEN 5070 Statistical Orbit determination I Fall 2012 Professor George H. Born Professor Jeffrey S. Parker Lecture 11: Batch.
5. Maximum Likelihood –II Prof. Yuille. Stat 231. Fall 2004.
University of Colorado Boulder ASEN 5070: Statistical Orbit Determination I Fall 2015 Professor Brandon A. Jones Lecture 14: Probability and Statistics.
University of Colorado Boulder ASEN 5070: Statistical Orbit Determination I Fall 2015 Professor Brandon A. Jones Lecture 6: Linearization of OD Problem.
Least Squares Estimate Additional Notes 1. Introduction The quality of an estimate can be judged using the expected value and the covariance matrix of.
Lecture 3: MLE, Bayes Learning, and Maximum Entropy
University of Colorado Boulder ASEN 5070: Statistical Orbit Determination I Fall 2014 Professor Brandon A. Jones Lecture 30: Lecture Quiz, Project Details,
Colorado Center for Astrodynamics Research The University of Colorado 1 STATISTICAL ORBIT DETERMINATION EKF and Observability ASEN 5070 LECTURE 23 10/21/09.
University of Colorado Boulder ASEN 5070: Statistical Orbit Determination I Fall 2015 Professor Brandon A. Jones Lecture 40: Elements of Attitude Estimation.
University of Colorado Boulder ASEN 5070: Statistical Orbit Determination I Fall 2015 Professor Brandon A. Jones Lecture 8: State Transition Matrix, Part.
University of Colorado Boulder ASEN 5070 Statistical Orbit determination I Fall 2012 Professor George H. Born Professor Jeffrey S. Parker Lecture 9: Least.
University of Colorado Boulder ASEN 5070: Statistical Orbit Determination I Fall 2014 Professor Brandon A. Jones Lecture 29: Observability and Introduction.
University of Colorado Boulder ASEN 5070: Statistical Orbit Determination I Fall 2015 Professor Brandon A. Jones Lecture 22: Further Discussions of the.
1 REPARAMETERIZATION OF A MODEL AND t TEST OF A LINEAR RESTRICTION Linear restrictions can also be tested using a t test. This involves the reparameterization.
University of Colorado Boulder ASEN 5070: Statistical Orbit Determination I Fall 2014 Professor Brandon A. Jones Lecture 10: Weighted LS and A Priori.
University of Colorado Boulder ASEN 5070 Statistical Orbit determination I Fall 2012 Professor George H. Born Professor Jeffrey S. Parker Lecture 10: Batch.
University of Colorado Boulder ASEN 5070: Statistical Orbit Determination I Fall 2015 Professor Brandon A. Jones Lecture 41: Information Filter.
MathematicalMarketing Slide 5.1 OLS Chapter 5: Ordinary Least Square Regression We will be discussing  The Linear Regression Model  Estimation of the.
University of Colorado Boulder ASEN 5070: Statistical Orbit Determination I Fall 2015 Professor Brandon A. Jones Lecture 26: Cholesky and Singular Value.
University of Colorado Boulder ASEN 5070: Statistical Orbit Determination I Fall 2015 Professor Brandon A. Jones Lecture 15: Statistical Least Squares.
Statistics 350 Lecture 2. Today Last Day: Section Today: Section 1.6 Homework #1: Chapter 1 Problems (page 33-38): 2, 5, 6, 7, 22, 26, 33, 34,
Econometrics III Evgeniya Anatolievna Kolomak, Professor.
University of Colorado Boulder ASEN 5070: Statistical Orbit Determination I Fall 2015 Professor Brandon A. Jones Lecture 19: Examples with the Batch Processor.
Colorado Center for Astrodynamics Research The University of Colorado 1 STATISTICAL ORBIT DETERMINATION Statistical Interpretation of Least Squares ASEN.
University of Colorado Boulder ASEN 5070 Statistical Orbit Determination I Fall 2012 Professor Jeffrey S. Parker Professor George H. Born Lecture 18: CKF,
ASEN 5070: Statistical Orbit Determination I Fall 2014
(5) Notes on the Least Squares Estimate
STATISTICAL ORBIT DETERMINATION Coordinate Systems and Time Kalman Filtering ASEN 5070 LECTURE 21 10/16/09.
ASEN 5070: Statistical Orbit Determination I Fall 2014
ASEN 5070: Statistical Orbit Determination I Fall 2015
Ch3: Model Building through Regression
ASEN 5070: Statistical Orbit Determination I Fall 2015
ASEN 5070: Statistical Orbit Determination I Fall 2014
Evgeniya Anatolievna Kolomak, Professor
Inference for Geostatistical Data: Kriging for Spatial Interpolation
The regression model in matrix form
Consider Covariance Analysis Example 6.9, Spring-Mass
Presentation transcript:

University of Colorado Boulder ASEN 5070: Statistical Orbit Determination I Fall 2015 Professor Brandon A. Jones Lecture 17: Minimum Variance Estimator

University of Colorado Boulder  Friday October 9 – Exam 1 ◦ Linearization (STM, A(t), H(t), etc.) ◦ Least Squares (weighted, with and without a priori, etc.) ◦ Probability and Statistics ◦ Linear Algebra ◦ Statistical Least Squares ◦ Minimum Variance Estimator 2

University of Colorado Boulder  Open book, open notes ◦ Bring a calculator! ◦ No internet enabled devices  Sample exams on website (under “Misc”) were created by a previous instructor ◦ They are not indicative of my exams, but are good practice  Very generous with partial credit ◦ The worst thing you can do is leave a problem blank! 3

University of Colorado Boulder 4 Minimum Variance Estimator

University of Colorado Boulder  With the least squares solution, we minimized the square of the residuals  Instead, what if we want the estimate that gives us the highest confidence in the solution: ◦ What is the linear, unbiased, minimum variance estimate of the state x? 5

University of Colorado Boulder  What is the linear, unbiased, minimum variance estimate of the state x ? ◦ This encompasses three elements  Linear  Unbiased, and  Minimum Variance  We consider each of these to formulate a solution 6

University of Colorado Boulder  To be linear, the estimated state is a linear combination of the observations: 7  What is the matrix M?  This ambiguous M matrix gives us the solution to the minimum variance estimator

University of Colorado Boulder  To be unbiased, then 8 Solution Constraint!

University of Colorado Boulder  Must satisfy previous requirements: 9

University of Colorado Boulder 10  Put into the context of scalars:

University of Colorado Boulder 11

University of Colorado Boulder  We seek to minimize: 12  Subject to the equality constraint:  Using the method of Lagrange Multipliers, we seek to minimize:

University of Colorado Boulder  Using calculus of variations, we need the first variation to vanish to achieve a minimum: 13

University of Colorado Boulder  In order for the above to be satisfied: 14  We will focus on the first

University of Colorado Boulder 15  We now have two constraints, which will give us a solution:

University of Colorado Boulder 16

University of Colorado Boulder  Showed that P satisfies the constraints, but do we have a “minimum” ◦ Must show that, for our solution, ◦ See book, p for proof 17

University of Colorado Boulder  Turns out, we get the weighted, statistical least squares!  Hence, the linear least squares gives us the minimum variance solution ◦ Of course, this is predicated on all of our statistical/linearization assumptions 18

University of Colorado Boulder 19 Propagation of Estimate and Covariance Matrix

University of Colorado Boulder  Well, we’ve kind of covered this one before: 20  Note: Yesterdays estimate can become today’s a priori… ◦ Not used much for the batch, but will be used for sequential processing

University of Colorado Boulder  How do we map our uncertainty forward in time? 21 X*X*

University of Colorado Boulder 22