Error Modeling Thomas Herring Room 54-611; 617-253-5941

Slides:



Advertisements
Similar presentations
Principles of the Global Positioning System Lecture 12 Prof. Thomas Herring Room A;
Advertisements

Colorado Center for Astrodynamics Research The University of Colorado ASEN 5070 OD Accuracy Assessment OD Overlap Example Effects of eliminating parameters.
Earth, Atmospheric and Planetary Sciences Massachusetts Institute of Technology 77 Massachusetts Avenue | A | Cambridge MA V F.
Kriging.
CmpE 104 SOFTWARE STATISTICAL TOOLS & METHODS MEASURING & ESTIMATING SOFTWARE SIZE AND RESOURCE & SCHEDULE ESTIMATING.
Use of Kalman filters in time and frequency analysis John Davis 1st May 2011.
FTP Biostatistics II Model parameter estimations: Confronting models with measurements.
1 Regression Models & Loss Reserve Variability Prakash Narayan Ph.D., ACAS 2001 Casualty Loss Reserve Seminar.
Cost of surrogates In linear regression, the process of fitting involves solving a set of linear equations once. For moving least squares, we need to.
AGC DSP AGC DSP Professor A G Constantinides©1 Modern Spectral Estimation Modern Spectral Estimation is based on a priori assumptions on the manner, the.
Generating velocity solutions with globk
“Real-time” Transient Detection Algorithms Dr. Kang Hyeun Ji, Thomas Herring MIT.
The Simple Linear Regression Model: Specification and Estimation
M. Floyd K. Palamartchouk
9. SIMPLE LINEAR REGESSION AND CORRELATION
G. Cowan Lectures on Statistical Data Analysis 1 Statistical Data Analysis: Lecture 10 1Probability, Bayes’ theorem, random variables, pdfs 2Functions.
A quick introduction to the analysis of questionnaire data John Richardson.
Long-Term Ambient Noise Statistics in the Gulf of Mexico Mark A. Snyder & Peter A. Orlin Naval Oceanographic Office Stennis Space Center, MS Anthony I.
Modern Navigation Thomas Herring
Principles of the Global Positioning System Lecture 10 Prof. Thomas Herring Room A;
Principles of the Global Positioning System Lecture 13 Prof. Thomas Herring Room A;
Principles of the Global Positioning System Lecture 11 Prof. Thomas Herring Room A;
Hydrologic Statistics
Colorado Center for Astrodynamics Research The University of Colorado STATISTICAL ORBIT DETERMINATION Project Report Unscented kalman Filter Information.
Issues in GPS Error Analysis What are the sources of the errors ? How much of the error can we remove by better modeling ? Do we have enough information.
Stat13-lecture 25 regression (continued, SE, t and chi-square) Simple linear regression model: Y=  0 +  1 X +  Assumption :  is normal with mean 0.
Chapter 15 Modeling of Data. Statistics of Data Mean (or average): Variance: Median: a value x j such that half of the data are bigger than it, and half.
Computational Methods of Scientific Programming Lecturers Thomas A Herring, Room A, Chris Hill, Room ,
Error analysis T. A. Herring R. W. King M. A. Floyd Massachusetts Institute of Technology GPS Data Processing and Analysis with GAMIT/GLOBK/TRACK UNAVCO.
1 Statistical Distribution Fitting Dr. Jason Merrick.
1 1 Slide © 2014 Cengage Learning. All Rights Reserved. May not be scanned, copied or duplicated, or posted to a publicly accessible website, in whole.
Modern Navigation Thomas Herring
Earth, Atmospheric and Planetary Sciences Massachusetts Institute of Technology 77 Massachusetts Avenue | Cambridge MA V F
SNARF: Theory and Practice, and Implications Thomas Herring Department of Earth Atmospheric and Planetary Sciences, MIT
Generating velocity solutions with GLOBK T. A. Herring R. W. King M. A. Floyd Massachusetts Institute of Technology GPS Data Processing and Analysis with.
Earth, Atmospheric and Planetary Sciences Massachusetts Institute of Technology 77 Massachusetts Avenue | Cambridge MA V F
Principles of the Global Positioning System Lecture 24 Prof. Thomas Herring Room ;
© Copyright McGraw-Hill 2000
Modern Navigation Thomas Herring MW 11:00-12:30 Room
0 - 1 © 2007 Texas Instruments Inc, Content developed in partnership with Tel-Aviv University From MATLAB ® and Simulink ® to Real Time with TI DSPs Spectrum.
Issues in GPS Error Analysis What are the sources of the errors ? How much of the error can we remove by better modeling ? Do we have enough information.
Error Models Lecture 06 Thomas Herring
Principles of the Global Positioning System Lecture 12 Prof. Thomas Herring Room ;
Z bigniew Leonowicz, Wroclaw University of Technology Z bigniew Leonowicz, Wroclaw University of Technology, Poland XXIX  IC-SPETO.
Earth, Atmospheric and Planetary Sciences Massachusetts Institute of Technology 77 Massachusetts Avenue | Cambridge MA V F
Estimation Method of Moments (MM) Methods of Moment estimation is a general method where equations for estimating parameters are found by equating population.
PBO Frame Definition using SNARF Version 1.0 Tom Herring MIT.
5/18/2994G21D-04 Spring AGU Realization of a Stable North America Reference Frame Thomas Herring Department of Earth Atmospheric and Planetary, Sciences,
Assessing the GIA Contribution to SNARF Mark Tamisiea and Jim Davis Harvard-Smithsonian Center for Astrophysics.
Principles of the Global Positioning System Lecture 09 Prof. Thomas Herring Room A;
12/12/01Fall AGU Vertical Reference Frames for Sea Level Monitoring Thomas Herring Department of Earth, Atmosphere and Planetary Sciences
Aug 6, 2002APSG Irkutsk Contemporary Horizontal and Vertical Deformation of the Tien Shan Thomas Herring, Bradford H. Hager, Brendan Meade, Massachusetts.
Global predictors of regression fidelity A single number to characterize the overall quality of the surrogate. Equivalence measures –Coefficient of multiple.
Issues in GPS Error Analysis What are the sources of the errors ? How much of the error can we remove by better modeling ? Do we have enough information.
MODEL DIAGNOSTICS By Eni Sumarminingsih, Ssi, MM.
Earth, Atmospheric and Planetary Sciences Massachusetts Institute of Technology 77 Massachusetts Avenue | Cambridge MA V F
Issues in GPS Error Analysis What are the sources of the errors ? How much of the error can we remove by better modeling ? Do we have enough information.
09/24/2008Unavco Track Intro1 TRACK: GAMIT Kinematic GPS processing module R King overview from longer T Herring.
Variability.
Contemporary Horizontal and Vertical Deformation of the Tien Shan
ASEN 5070: Statistical Orbit Determination I Fall 2014
The Simple Linear Regression Model: Specification and Estimation
GLOBK Velocity Solutions
Understanding what sh_gamit does
Track Output Interpretation
SNARF Ver 2.0 Construction
Principles of the Global Positioning System Lecture 11
Principles of the Global Positioning System Lecture 13
GLOBK Velocity and Coordinate Solutions
Track Output Interpretation
Presentation transcript:

Error Modeling Thomas Herring Room ;

06/13/06Unavco GG Lec 032 Overview Notations Error modeling of GPS phase measurements Error modeling in time series analyses

06/13/06Unavco GG Lec 033 Notations Terms that are used in gamit/globk Weighted-root-mean-square (WRMS) scatter: square root of the mean of residuals squared weighted by the estimated variance of the residuals. Normalized-root-mean-square (NRMS) scatter: square root of mean of sum of residuals divided by their standard deviations squared. Square-root of chi- squared per degree of freedom. Should be near unity.

06/13/06Unavco GG Lec 034 GPS phase noise modeling A common assumption in GPS analyses is to assume that all phase data has the same random noise level. Examination of phase residuals (phs_res_root option in autcln.cmd) shows this is not the case. Default gamit processing uses a site dependent elevation angle dependent model The model is computed in autcln and passed to solve through the n-file (noise file). The noise levels are increased so that gamit NRMS of phase residuals is Short-term scatter of position estimates suggest sigma 1-2 times too small. (Positions estimates do not depend on sampling rate to about 4 minutes).

06/13/06Unavco GG Lec 035 Globk re-weighting There are methods in globk to change the standard deviations of the position (and other parameter) estimates. Complete solutions: –In the gdl files, variance rescaling factor and diagonal rescaling factors can be added. –First factor scales the whole covariance matrix. Useful when Using SINEX files from different programs Accounting for different sampling rates –Second factor is not normally needed and is used to solve numerical instability problems. Scales diagonal of covariance matrix. Needed in some SINEX files Large globk combinations (negative chi-square increments) Large combinations are best done with pre-combinations in to weekly or monthly solutions Individual sites with sig_neu command. Wild cards allowded in site names (both beginning and end)

06/13/06Unavco GG Lec 036 Time series noise The most complicated aspect of GPS timeseries analysis: Basic problem: Errors in GPS position estimates are both spatially and temporally correlated Spatial correlations: –Handled in glorg by using a local definition of reference frame. Stable sites in the area are used in the determining translation and rotation of local frame. Generally, the smaller the area the smaller the RMS scatter of position estimates. (Median WRMS scatter for sites in Southern California <1 mm horizontal and <3 mm vertical; Same sites for North America frame ~1 mm and 3 mm. Temporal correlations: –More difficult because stochastic process of noise(s) not known and for velocity sigma estimates lowest (least well determined part of spectrum needed)

06/13/06Unavco GG Lec 037

06/13/06Unavco GG Lec 038

06/13/06Unavco GG Lec 039 Spectrum for Non-stable GPS site California frame: Non-Stable site

06/13/06Unavco GG Lec 0310 PSD: North America Frame

06/13/06Unavco GG Lec 0311

06/13/06Unavco GG Lec 0312

06/13/06Unavco GG Lec 0313

06/13/06Unavco GG Lec 0314

06/13/06Unavco GG Lec 0315 Example Power Spectral Density Southern California reference frame Very stable sites

06/13/06Unavco GG Lec 0316 PSD of same site in North America frame

06/13/06Unavco GG Lec 0317 “Realistic Sigma” Algorithm Motivation was to develop an algorithm that could quickly estimate standard deviations of parameters estimated from time series that could have gaps and variable quality data Concept: Common practice is to scale standard deviations of parameter estimates by the scatter of the post-fit residuals: Valid if residuals are white noise. Scatter of residuals is characterized by chi-squared per degree of freedom: should near unity. If data are averaged over some interval (e.g., 1 week or month), then fit of parameters (such as rate) rarely affected but the chi- squared of averaged residuals will increase if residuals are not white noise: Hence scale by new chi-squared: But if longer averages are used, chi-squared keeps increasing so scale standard deviations by chi-squared obtained with infinite time averaging. Later step requires as method for extrapolating chi- squared estimates from short averaging times to long ones. We use a first-order Gauss Markov model to this.

06/13/06Unavco GG Lec 0318 Algorithm Time series parameters are estimated using standard weighted least squares Postfit residuals from this fit are averaged from successive longer intervals and chi-squared computed for the averaged residuals. A first-order Gauss Markov process model (characterized by a variance and correlation time) is fit to the estimates of chi-squared. The chi-squared value for infinite averaging time predicted from this model is used to scale the white- noise sigma estimates from the original fit. Example: CVHS (part of the Baldwin Park event)

06/13/06Unavco GG Lec 0319 Raw times series (error bars not shown)

06/13/06Unavco GG Lec 0320

06/13/06Unavco GG Lec 0321 Red Lines are realistic sigma of rate estimates

06/13/06Unavco GG Lec 0322 Realistic Sigma chi-squares for East component

06/13/06Unavco GG Lec 0323 Site with post-2005 data. Notice realistic error estimate

06/13/06Unavco GG Lec 0324 Chi-square with averaging for pre and post-2005 data

06/13/06Unavco GG Lec 0325 How well to estimate agree? Rate comparisons: Comp 2005 mm/yr  mm/yr North ± ± East ± ± Height ± ± Adding the additional data after 2005, make rate sigma increase factor 5. In this case, algorithm seems to do a reasonable job of computing sigma.

06/13/06Unavco GG Lec 0326 Summary All algorithms for computing estimates of standard deviations have various problems: Fundamentally, rate standard deviations are dependent on low frequency part of noise spectrum which is poorly determined. Assumptions of stationarity are often not valid (example shown) “Realistic sigma” algorithm implemented in tsview and enfit/ensum; sh_gen_stats generates mar_neu commands for globk based on the noise estimates