Singular value decomposition (SVD) – a tool for VLBI simulations Markus Vennebusch VLBI – group of the Geodetic Institute of the University of Bonn M.

Slides:



Advertisements
Similar presentations
Eigen Decomposition and Singular Value Decomposition
Advertisements

Chapter 28 – Part II Matrix Operations. Gaussian elimination Gaussian elimination LU factorization LU factorization Gaussian elimination with partial.
Algebraic, transcendental (i.e., involving trigonometric and exponential functions), ordinary differential equations, or partial differential equations...
On the alternative approaches to ITRF formulation. A theoretical comparison. Department of Geodesy and Surveying Aristotle University of Thessaloniki Athanasios.
Solving Linear Systems (Numerical Recipes, Chap 2)
Bayesian Robust Principal Component Analysis Presenter: Raghu Ranganathan ECE / CMR Tennessee Technological University January 21, 2011 Reading Group (Xinghao.
Slides by Olga Sorkine, Tel Aviv University. 2 The plan today Singular Value Decomposition  Basic intuition  Formal definition  Applications.
Psychology 202b Advanced Psychological Statistics, II January 25, 2011.
3D Geometry for Computer Graphics
Some useful linear algebra. Linearly independent vectors span(V): span of vector space V is all linear combinations of vectors v i, i.e.
Curve-Fitting Regression
Procrustes analysis Purpose of procrustes analysis Algorithm Various modifications.
ECIV 301 Programming & Graphics Numerical Methods for Engineers Lecture 14 Elimination Methods.
TFIDF-space  An obvious way to combine TF-IDF: the coordinate of document in axis is given by  General form of consists of three parts: Local weight.
CS232.
IR Models: Latent Semantic Analysis. IR Model Taxonomy Non-Overlapping Lists Proximal Nodes Structured Models U s e r T a s k Set Theoretic Fuzzy Extended.
The Terms that You Have to Know! Basis, Linear independent, Orthogonal Column space, Row space, Rank Linear combination Linear transformation Inner product.
GG313 Lecture 12 Matrix Operations Sept 29, 2005.
3D Geometry for Computer Graphics
ECIV 520 Structural Analysis II Review of Matrix Algebra.
Lecture 11 Vector Spaces and Singular Value Decomposition.
Ordinary least squares regression (OLS)
ECE 530 – Analysis Techniques for Large-Scale Electrical Systems
Basic Mathematics for Portfolio Management. Statistics Variables x, y, z Constants a, b Observations {x n, y n |n=1,…N} Mean.
Basics of regression analysis
Principal component analysis (PCA) Purpose of PCA Covariance and correlation matrices PCA using eigenvalues PCA using singular value decompositions Selection.
Linear and generalised linear models Purpose of linear models Least-squares solution for linear models Analysis of diagnostics Exponential family and generalised.
Introduction The central problems of Linear Algebra are to study the properties of matrices and to investigate the solutions of systems of linear equations.
SVD(Singular Value Decomposition) and Its Applications
Projection exercises Stable age distribution and population growth rate Reproductive value of different ages Not all matrices yield a stable age distribution.
Chapter 2 Dimensionality Reduction. Linear Methods
THEORETICAL STUDY OF SOUND FIELD RECONSTRUCTION F.M. Fazi P.A. Nelson.
Advanced Computer Graphics Spring 2014 K. H. Ko School of Mechatronics Gwangju Institute of Science and Technology.
1 SVY207: Lecture 18 Network Solutions Given many GPS solutions for vectors between pairs of observed stations Compute a unique network solution (for many.
Algorithms for a large sparse nonlinear eigenvalue problem Yusaku Yamamoto Dept. of Computational Science & Engineering Nagoya University.
Fast Low-Frequency Impedance Extraction using a Volumetric 3D Integral Formulation A.MAFFUCCI, A. TAMBURRINO, S. VENTRE, F. VILLONE EURATOM/ENEA/CREATE.
© 2005 Yusuf Akgul Gebze Institute of Technology Department of Computer Engineering Computer Vision Geometric Camera Calibration.
Review of Matrices Or A Fast Introduction.
Multivariate Statistics Matrix Algebra II W. M. van der Veld University of Amsterdam.
SVD: Singular Value Decomposition
Progress in identification of damping: Energy-based method with incomplete and noisy data Marco Prandina University of Liverpool.
SINGULAR VALUE DECOMPOSITION (SVD)
MATH 685/ CSI 700/ OR 682 Lecture Notes Lecture 4. Least squares.
Quality of model and Error Analysis in Variational Data Assimilation François-Xavier LE DIMET Victor SHUTYAEV Université Joseph Fourier+INRIA Projet IDOPT,
Chapter 28 Cononical Correction Regression Analysis used for Temperature Retrieval.
Introduction to Linear Algebra Mark Goldman Emily Mackevicius.
3.6 Solving Systems Using Matrices You can use a matrix to represent and solve a system of equations without writing the variables. A matrix is a rectangular.
Review of Matrix Operations Vector: a sequence of elements (the order is important) e.g., x = (2, 1) denotes a vector length = sqrt(2*2+1*1) orientation.
EIGENSYSTEMS, SVD, PCA Big Data Seminar, Dedi Gadot, December 14 th, 2014.
1. Systems of Linear Equations and Matrices (8 Lectures) 1.1 Introduction to Systems of Linear Equations 1.2 Gaussian Elimination 1.3 Matrices and Matrix.
Matrix Factorization & Singular Value Decomposition Bamshad Mobasher DePaul University Bamshad Mobasher DePaul University.
ECE 530 – Analysis Techniques for Large-Scale Electrical Systems Prof. Hao Zhu Dept. of Electrical and Computer Engineering University of Illinois at Urbana-Champaign.
Singular Value Decomposition and Numerical Rank. The SVD was established for real square matrices in the 1870’s by Beltrami & Jordan for complex square.
Parameter estimation class 5 Multiple View Geometry CPSC 689 Slides modified from Marc Pollefeys’ Comp
University of Colorado Boulder ASEN 5070: Statistical Orbit Determination I Fall 2015 Professor Brandon A. Jones Lecture 26: Cholesky and Singular Value.
Chapter 12: Data Analysis by linear least squares Overview: Formulate problem as an over-determined linear system of equations Solve the linear system.
Alexandra Moshou, Panayotis Papadimitriou and Kostas Makropoulos MOMENT TENSOR DETERMINATION USING A NEW WAVEFORM INVERSION TECHNIQUE Department of Geophysics.
1 1.3 © 2016 Pearson Education, Ltd. Linear Equations in Linear Algebra VECTOR EQUATIONS.
Using General Inverse Theory to Calibrate the Island Recharge Problem in EXCEL.
ASEN 5070: Statistical Orbit Determination I Fall 2014
Introduction The central problems of Linear Algebra are to study the properties of matrices and to investigate the solutions of systems of linear equations.
Introduction The central problems of Linear Algebra are to study the properties of matrices and to investigate the solutions of systems of linear equations.
Lecture 8:Eigenfaces and Shared Features
Two-view geometry Computer Vision Spring 2018, Lecture 10
CHAPTER OBJECTIVES The primary objective of this chapter is to show how to compute the matrix inverse and to illustrate how it can be.
Unfolding Problem: A Machine Learning Approach
Some useful linear algebra
Further Matrix Algebra
Maths for Signals and Systems Linear Algebra in Engineering Lectures 13 – 14, Tuesday 8th November 2016 DR TANIA STATHAKI READER (ASSOCIATE PROFFESOR)
Unfolding with system identification
Presentation transcript:

Singular value decomposition (SVD) – a tool for VLBI simulations Markus Vennebusch VLBI – group of the Geodetic Institute of the University of Bonn M. Vennebusch – singular value decomposition – a tool for VLBI simulationsJanuary 9, 2006slide 1 IVS-General Meeting 2006

Idea Idea: - Use of an advanced (not very popular) method for parameter estimation (without normal equations) - So far: Investigations of parameters (cofactors, EVD, correlations,....) - Now: Investigation of parameters AND observations (entire schedule) - Goals: - Improvement of Schedules by (direct) investigations of design matrix - Gain insight into adjustment process: „Which observation affects which parameter? Is a particular observation more important than another observation?“ - This talk: No explanations of theoretical background, just applications M. Vennebusch – singular value decomposition – a tool for VLBI simulationsslide 2January 9, 2006

Least-squares adjustment Least-squares adjustment: Overdetermined system of linear equations: Normal equation method: Solution of normal equations: + simple + fast + yields accuracy of parameters - inversion necessary - numerical problems (condition becomes worse) direct methods (design matrix used) : + numerically more stable (even with bad condition) + no inversion (S = diagonal) + yields geometrical insight into adjustment process - complex, slowly QR-decomposition Singular value decomposition M. Vennebusch – singular value decomposition – a tool for VLBI simulationsslide 3January 9, 2006

Linear Algebra: - provides different methods for solution of (overdetermined) systems of linear equations: Matrix decompositions: Cholesky, LU (Gauß-Algorithm), QR, EVD, SVD,... - Singular value decomposition (Extended EVD for rectangular matrices): Least-squares adjustment Jacobi-Matrix / Designmatrix Left singular vectors Singular values Right singular vectors (= eigenvectors of NEQ) = M. Vennebusch – singular value decomposition – a tool for VLBI simulationsslide 4January 9, 2006

Singular value decomposition Least-Squares-solution by SVD: = r = Rank elements = scaling factors M. Vennebusch – singular value decomposition – a tool for VLBI simulationsslide 5 Left and right singular vectors (u i and v i ): - u i shows impact (or weight) of observations - v i shows parameters affected - s i shows whether v i can be determined or not SVD yields geometrical insight into LSM-adjustment: - Vector spaces, bases of vector spaces, projections - column space = Data space, row space = Model space => further investigations January 9, 2006

Data resolution matrix (= U r U r T, U r = U(:,1:r)): - shows „importance“ of observations in general (information of observation already contained?) - shows observations which might be neglected - system / solution is very sensitive to errors in observations with large importance (!) Model resolution matrix (= V r V r T, V r = V(:,1:r)): - shows dependencies (correlations, separability) between parameters (even in case of rank deficiency) Q xl -Matrix (= V r S r -1 U r T ): - shows „correlations“/dependencies between observations and unknowns (more precise: common stochastic behaviour) - shows impact of variations in observations on parameters (measure of sensitivity to errors) M. Vennebusch – singular value decomposition – a tool for VLBI simulationsslide 6 Singular value decomposition January 9, 2006

Example Example I04267 (04SEP23XU): M. Vennebusch – singular value decomposition – a tool for VLBI simulationsslide 7 1 hour duration: 16 observations, 6 pseudo-observations (not necessary) SVD of (22 x 5)-design matrix (from OCCAM) yields: - Matrix U: Dimension 22 x 22 - Matrix S: Dimension 22 x 5 (Singular values on main diagonal) - Matrix V: Dimension 5 x 5 => Rank r = 5 January 9, 2006

Example M. Vennebusch – singular value decomposition – a tool for VLBI simulationsslide 8 ZD KOKEE ZD WETTZELL CL0 KOKEE XPOL DUT1 Number of observation v1v1 u1u1 v2v2 v3v3 u2u2 u3u3 Singular vectors 1 – 3 (out of 5): January 9, 2006

Data resolution matrix M. Vennebusch – singular value decomposition – a tool for VLBI simulationsslide 9 Source statistics: Largest importance January 9, 2006

Outlook Problems: - Parameters must have the same unit (=> parameter rates are difficult to investigate) - SVD heavily depends on parametrisation Further investigations: - Piecewise linear parameters: useful parametrisation? - Comparison of different schedules - Identification of important observations - Identification of undeterminable parameters - Impact of datum constraints -... Conclusion: - SVD is a very useful tool to understand adjustment processes - Contribution to improve VLBI schedules and data analysis => Suitable method for VLBI simulations M. Vennebusch – singular value decomposition – a tool for VLBI simulationsslide 10January 9, 2006

Singular value decomposition – a tool for VLBI simulations Markus Vennebusch VLBI – group of the Geodetic Institute of the University of Bonn M. Vennebusch – singular value decomposition – a tool for VLBI simulationsslide 11 IVS-General Meeting 2006 January 9, 2006

Q xl -Matrix M. Vennebusch – singular value decomposition – a tool for VLBI simulationsslide 12 Q xl -Matrix: - impact of variations in observations on parameters (sensitivity on errors) January 9, 2006