Geometric Mean Decomposition and Generalized Triangular Decomposition Yi JiangWilliam W. HagerJian Li

Slides:



Advertisements
Similar presentations
Chapter 28 – Part II Matrix Operations. Gaussian elimination Gaussian elimination LU factorization LU factorization Gaussian elimination with partial.
Advertisements

Chapter 2 Solutions of Systems of Linear Equations / Matrix Inversion
Scientific Computing QR Factorization Part 2 – Algorithm to Find Eigenvalues.
Generalised Inverses Modal Analysis and Modal Testing S. Ziaei Rad.
Doc.: IEEE /1090/r2 Submission September 2013 Submission Zhanji Wu, et. Al. Non-linear pre-coding MIMO scheme for next generation WLAN Date:
Solving Linear Systems (Numerical Recipes, Chap 2)
Lecture 13 - Eigen-analysis CVEN 302 July 1, 2002.
SOLVING SYSTEMS OF LINEAR EQUATIONS. Overview A matrix consists of a rectangular array of elements represented by a single symbol (example: [A]). An individual.
Lecture 17 Introduction to Eigenvalue Problems
Slides by Olga Sorkine, Tel Aviv University. 2 The plan today Singular Value Decomposition  Basic intuition  Formal definition  Applications.
Linear Algebraic Equations
3D Geometry for Computer Graphics
Some useful linear algebra. Linearly independent vectors span(V): span of vector space V is all linear combinations of vectors v i, i.e.
An equivalent reduction of a 2-D symmetric polynomial matrix N. P. Karampetakis Department of Mathematics Aristotle University of Thessaloniki Thessaloniki.
Math for CSLecture 41 Linear Least Squares Problem Over-determined systems Minimization problem: Least squares norm Normal Equations Singular Value Decomposition.
ECIV 301 Programming & Graphics Numerical Methods for Engineers Lecture 12 System of Linear Equations.
Matrix Operations. Matrix Notation Example Equality of Matrices.
Information Retrieval in Text Part III Reference: Michael W. Berry and Murray Browne. Understanding Search Engines: Mathematical Modeling and Text Retrieval.
ECIV 301 Programming & Graphics Numerical Methods for Engineers Lecture 20 Solution of Linear System of Equations - Iterative Methods.
ECIV 301 Programming & Graphics Numerical Methods for Engineers Lecture 14 Elimination Methods.
Chapter 3 Determinants and Matrices
The Terms that You Have to Know! Basis, Linear independent, Orthogonal Column space, Row space, Rank Linear combination Linear transformation Inner product.
Previously Two view geometry: epipolar geometry Stereo vision: 3D reconstruction epipolar lines Baseline O O’ epipolar plane.
3D Geometry for Computer Graphics
DSP Group, EE, Caltech, Pasadena CA1 Precoded V-BLAST for ISI MIMO Channels Chun-yang Chen and P. P. Vaidyanathan California Institute of Technology.
Ordinary least squares regression (OLS)
MATH 685/ CSI 700/ OR 682 Lecture Notes Lecture 6. Eigenvalue problems.
CE 311 K - Introduction to Computer Methods Daene C. McKinney
5.1 Orthogonality.
Center for Machine Perception Department of Cybernetics, Faculty of Electrical Engineering Czech Technical University in Prague Methods for Solving Systems.
Introduction The central problems of Linear Algebra are to study the properties of matrices and to investigate the solutions of systems of linear equations.
CHAPTER SIX Eigenvalues
© 2005 Yusuf Akgul Gebze Institute of Technology Department of Computer Engineering Computer Vision Geometric Camera Calibration.
CMPS 1371 Introduction to Computing for Engineers MATRICES.
Lecture 28: Mathematical Insight and Engineering.
Chapter 10 Real Inner Products and Least-Square (cont.) In this handout: Angle between two vectors Revised Gram-Schmidt algorithm QR-decompoistion of matrices.
Lecture 8 Matrix Inverse and LU Decomposition
Co. Chapter 3 Determinants Linear Algebra. Ch03_2 Let A be an n  n matrix and c be a nonzero scalar. (a)If then |B| = …….. (b)If then |B| = …..... (c)If.
Scientific Computing Singular Value Decomposition SVD.
4.4 Identify and Inverse Matrices Algebra 2. Learning Target I can find and use inverse matrix.
1 Matrix Algebra and Random Vectors Shyh-Kang Jeng Department of Electrical Engineering/ Graduate Institute of Communication/ Graduate Institute of Networking.
ECE 530 – Analysis Techniques for Large-Scale Electrical Systems Prof. Hao Zhu Dept. of Electrical and Computer Engineering University of Illinois at Urbana-Champaign.
BART VANLUYTEN, JAN C. WILLEMS, BART DE MOOR 44 th IEEE Conference on Decision and Control December 2005 Model Reduction of Systems with Symmetries.
Fall 1999 Copyright © R. H. Taylor Given a linear systemAx -b = e, Linear Least Squares (sometimes written Ax  b) We want to minimize the sum.
ECE 530 – Analysis Techniques for Large-Scale Electrical Systems Prof. Hao Zhu Dept. of Electrical and Computer Engineering University of Illinois at Urbana-Champaign.
ECE 530 – Analysis Techniques for Large-Scale Electrical Systems Prof. Hao Zhu Dept. of Electrical and Computer Engineering University of Illinois at Urbana-Champaign.
Advanced Computer Graphics Spring 2014 K. H. Ko School of Mechatronics Gwangju Institute of Science and Technology.
STATIC ANALYSIS OF UNCERTAIN STRUCTURES USING INTERVAL EIGENVALUE DECOMPOSITION Mehdi Modares Tufts University Robert L. Mullen Case Western Reserve University.
Linear Systems Dinesh A.
WORKSHOP ERCIM Global convergence for iterative aggregation – disaggregation method Ivana Pultarova Czech Technical University in Prague, Czech Republic.
2.5 – Determinants and Multiplicative Inverses of Matrices.
ECE 530 – Analysis Techniques for Large-Scale Electrical Systems Prof. Hao Zhu Dept. of Electrical and Computer Engineering University of Illinois at Urbana-Champaign.
Singular Value Decomposition and Numerical Rank. The SVD was established for real square matrices in the 1870’s by Beltrami & Jordan for complex square.
Matrices. Variety of engineering problems lead to the need to solve systems of linear equations matrixcolumn vectors.
CHAPTER 7 Determinant s. Outline - Permutation - Definition of the Determinant - Properties of Determinants - Evaluation of Determinants by Elementary.
Introduction The central problems of Linear Algebra are to study the properties of matrices and to investigate the solutions of systems of linear equations.
Introduction The central problems of Linear Algebra are to study the properties of matrices and to investigate the solutions of systems of linear equations.
Elementary Linear Algebra
CS479/679 Pattern Recognition Dr. George Bebis
Linear Equations.
Orthogonality and Least Squares
RECORD. RECORD Gaussian Elimination: derived system back-substitution.
Some useful linear algebra
SVD, PCA, AND THE NFL By: Andrew Zachary.
Numerical Analysis Lecture10.
Maths for Signals and Systems Linear Algebra in Engineering Lectures 9, Friday 28th October 2016 DR TANIA STATHAKI READER (ASSOCIATE PROFFESOR) IN SIGNAL.
Linear Algebra Lecture 41.
DETERMINANT MATH 80 - Linear Algebra.
Lecture 8 Matrix Inverse and LU Decomposition
Linear Algebra Lecture 28.
Presentation transcript:

Geometric Mean Decomposition and Generalized Triangular Decomposition Yi JiangWilliam W. HagerJian Li Department of Electrical & Computer Engineering Department of Mathematics University of Florida July 14, 2004

SIAM /13 H = QRP* Matrix Decomposition H = QRP* Matrix Decomposition H = QRP* –Q, P: matrices with orthonormal columns –R: upper triangular Some Special Cases Some Special Cases –Singular value decomposition R: diagonal matrix containing singular values of H –Schur decomposition R: upper triangular with eigenvalues of H on the diagonal –QR decomposition P: identity matrix

July 14, 2004SIAM /13 Motivation – Joint Transceiver Design for MIMO Communications Multi-input Multi-output Communications Multi-input Multi-output Communications Received data Channel matrix

July 14, 2004SIAM /13 MIMO Transceiver MIMO Transceiver MIMO Transceiver –Decomposition H=QRP* –Linear precoder P, x = P s –Linear equalizer Q, v = Q*y Equivalent Channel Equivalent Channel –v = R s + Q* z Overall System Performance Limited by Overall System Performance Limited by

July 14, 2004SIAM /13 Problem Formulation Generalized Maximin problem Generalized Maximin problem The Solution is Geometric Mean Decomposition The Solution is Geometric Mean Decomposition –P, Q: matrices with orthonormal columns –R: upper triangular with equal diagonal elements

July 14, 2004SIAM /13 GMD Algorithm Starts with SVD Starts with SVD Applies Givens Rotations and Permutations to Applies Givens Rotations and Permutations to –If –Illustration of k-th step –K-1 iterations –Non-unique

July 14, 2004SIAM /13 A Numerical Research Problem A numerical research problem by Higham (1996) A numerical research problem by Higham (1996) –Develop an efficient algorithm for computing a unit upper triangular K x K matrix with prescribed singular values A solution was given by [Kosowski and Smoktunowicz, Computing, 2000] A solution was given by [Kosowski and Smoktunowicz, Computing, 2000] GMD is a new solution to Higham ’ s problem GMD is a new solution to Higham ’ s problem

July 14, 2004SIAM /13 Advantages Advantages of GMD Advantages of GMD GMD transceiver has superior performance compared with any other published transceiver schemes GMD transceiver has superior performance compared with any other published transceiver schemes Computationally efficient – needs only an additional O((M+N)K) flops compared with SVD Computationally efficient – needs only an additional O((M+N)K) flops compared with SVD Numerically stable – involves 2K-2 Givens rotations Numerically stable – involves 2K-2 Givens rotations The technique can be easily extended to the generalized triangular decomposition (GTD) The technique can be easily extended to the generalized triangular decomposition (GTD)

July 14, 2004SIAM /13 GTD : H = QRP* Two Questions Two Questions Q1: What is the achievable set for the diagonal of R ? Q2: Is there a systematic approach to get any achievable decomposition? Two Observations Two Observations O1: H and R share the same singular values O2: The diagonal are the eigenvalues of R

July 14, 2004SIAM /13 Weyl-Horn Theorem Weyl-Horn Theorem Weyl-Horn Theorem

July 14, 2004SIAM /13 GTD Theorem Generalized Triangular Decomposition [Jiang et. al. 2004] Generalized Triangular Decomposition [Jiang et. al. 2004]

July 14, 2004SIAM /13 GTD Algorithm Starts with SVD Starts with SVD Applies Givens Rotations and Permutations to Applies Givens Rotations and Permutations to –If –Illustration of k-th step –K-1 iterations –Key difference from GMD is the permutation matrices

July 14, 2004SIAM /13 Applications of GTD A New Solution to Inverse Eigenvalue Problem A New Solution to Inverse Eigenvalue Problem –Constructing matrices with prescribed eigenvalues and singular values [Chu, SIAM J. Numer. Anal. 2000] Design MIMO Transceiver with Quality of Service (QoS) Constraints [Jiang, et. al., Asilomar, 2004] Design MIMO Transceiver with Quality of Service (QoS) Constraints [Jiang, et. al., Asilomar, 2004]